2023-11-28T17:23:21.124 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T17:23:21.124 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397 --verbose --name vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi --owner scheduled_vshankar@teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/orig.config.yaml 2023-11-28T17:23:21.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T17:23:21.256 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397 branch: wip-vshankar-testing-20231127.102654 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7469397' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102654 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 47c1c547372ed5bff7984647dc200bac0e019caf ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 47c1c547372ed5bff7984647dc200bac0e019caf kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102654 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf owner: scheduled_vshankar@teuthology priority: 100 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1098 sha1: 47c1c547372ed5bff7984647dc200bac0e019caf sleep_before_teardown: 0 subset: 854/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102654 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 47c1c547372ed5bff7984647dc200bac0e019caf syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi016.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEONz5/0REs4kaPFzuqc3CUzT2Iui4Fc5bEN24go+O6oR4tcmVqOOp6Ezg1reI0HtVSWrgDd9K4GuUbgNapwaI= smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlPwKfI8SIgiQx/P75SqVsuwDtjp9touOtALSJxcXOwZ/cTe0oNGrXEX6TjeM9LEvSwmX9eGi0fJbwXaDoB48c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:23:42 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T17:23:21.256 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa; will attempt to use it 2023-11-28T17:23:21.257 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks 2023-11-28T17:23:21.257 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T17:23:21.258 INFO:teuthology.task.internal:Checking packages... 2023-11-28T17:23:21.285 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '47c1c547372ed5bff7984647dc200bac0e019caf' 2023-11-28T17:23:21.285 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T17:23:21.285 INFO:teuthology.packaging:ref: None 2023-11-28T17:23:21.285 INFO:teuthology.packaging:tag: None 2023-11-28T17:23:21.285 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102654 2023-11-28T17:23:21.285 INFO:teuthology.packaging:sha1: 47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T17:23:21.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102654 2023-11-28T17:23:21.512 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:23:21.512 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T17:23:21.519 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T17:23:21.520 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T17:23:21.543 INFO:teuthology.task.internal:Saving configuration 2023-11-28T17:23:21.560 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T17:23:21.566 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T17:23:21.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 17:17:45.391072', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICwRIdHMclmj1HYs6a+1cGwqV7VirzfxsejKtUkvniIp'} 2023-11-28T17:23:21.615 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 17:17:45.389613', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIATLf4gQOWIbWKoOCYKnP/FCX+xsS2NGmFk9n4J2JUFw'} 2023-11-28T17:23:21.615 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T17:23:21.622 INFO:teuthology.task.internal:roles: ubuntu@smithi016.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-28T17:23:21.622 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-28T17:23:21.622 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T17:23:21.697 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff2b9d15040>, signals=[15]) 2023-11-28T17:23:21.697 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T17:23:21.704 INFO:teuthology.task.internal:Opening connections... 2023-11-28T17:23:21.704 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:23:21.705 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:23:21.781 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:23:21.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:23:21.858 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T17:23:21.865 DEBUG:teuthology.orchestra.run.smithi016:> uname -m 2023-11-28T17:23:21.872 INFO:teuthology.orchestra.run.smithi016.stdout:x86_64 2023-11-28T17:23:21.872 DEBUG:teuthology.orchestra.run.smithi016:> cat /etc/os-release 2023-11-28T17:23:21.919 INFO:teuthology.orchestra.run.smithi016.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:NAME="Ubuntu" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_ID="22.04" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:VERSION_CODENAME=jammy 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:ID=ubuntu 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:ID_LIKE=debian 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T17:23:21.920 INFO:teuthology.orchestra.run.smithi016.stdout:UBUNTU_CODENAME=jammy 2023-11-28T17:23:21.921 INFO:teuthology.lock.ops:Updating smithi016.front.sepia.ceph.com on lock server 2023-11-28T17:23:21.938 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-11-28T17:23:21.943 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-11-28T17:23:21.944 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-11-28T17:23:21.992 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T17:23:21.993 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="Ubuntu" 2023-11-28T17:23:21.993 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="22.04" 2023-11-28T17:23:21.993 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T17:23:21.994 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_CODENAME=jammy 2023-11-28T17:23:21.994 INFO:teuthology.orchestra.run.smithi064.stdout:ID=ubuntu 2023-11-28T17:23:21.994 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE=debian 2023-11-28T17:23:21.994 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T17:23:21.995 INFO:teuthology.orchestra.run.smithi064.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T17:23:21.995 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T17:23:21.995 INFO:teuthology.orchestra.run.smithi064.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T17:23:21.995 INFO:teuthology.orchestra.run.smithi064.stdout:UBUNTU_CODENAME=jammy 2023-11-28T17:23:21.996 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-11-28T17:23:22.021 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T17:23:22.031 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T17:23:22.037 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T17:23:22.037 DEBUG:teuthology.orchestra.run.smithi016:> test '!' -e /home/ubuntu/cephtest 2023-11-28T17:23:22.040 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2023-11-28T17:23:22.047 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T17:23:22.053 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T17:23:22.053 DEBUG:teuthology.orchestra.run.smithi016:> test -z $(ls -A /var/lib/ceph) 2023-11-28T17:23:22.089 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2023-11-28T17:23:22.096 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T17:23:22.142 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T17:23:22.158 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T17:23:22.158 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-11-28T17:23:22.158 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-11-28T17:23:22.158 DEBUG:teuthology.orchestra.run.smithi016:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T17:23:22.159 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T17:23:22.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:23:22.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:23:22.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T17:23:22.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T17:23:22.385 DEBUG:teuthology.task.kernel:sha1 for client.1 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T17:23:22.385 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T17:23:22.385 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2023-11-28T17:23:22.391 INFO:teuthology.orchestra.run.smithi064.stdout:5.15.0-56-generic 2023-11-28T17:23:22.392 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T17:23:22.392 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T17:23:22.392 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-11-28T17:23:22.392 DEBUG:teuthology.orchestra.run.smithi064:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T17:23:22.453 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T17:23:22.470 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T17:23:22.471 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T17:23:22.471 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2023-11-28T17:23:22.476 INFO:teuthology.orchestra.run.smithi016.stdout:5.15.0-56-generic 2023-11-28T17:23:22.477 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T17:23:22.477 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T17:23:22.477 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-28T17:23:22.477 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T17:23:22.537 INFO:teuthology.orchestra.run.smithi016.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T17:23:22.593 INFO:teuthology.orchestra.run.smithi064.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: git config --global init.defaultBranch 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: 2023-11-28T17:23:22.594 INFO:teuthology.orchestra.run.smithi064.stderr:hint: git branch -m 2023-11-28T17:23:22.595 INFO:teuthology.orchestra.run.smithi064.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T17:23:22.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T17:23:22.668 DEBUG:teuthology.orchestra.run.smithi064:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T17:23:22.675 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T17:23:22.675 INFO:teuthology.orchestra.run.smithi016.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T17:23:22.675 INFO:teuthology.orchestra.run.smithi016.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T17:23:22.675 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git config --global init.defaultBranch 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stderr:hint: 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stderr:hint: git branch -m 2023-11-28T17:23:22.676 INFO:teuthology.orchestra.run.smithi016.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T17:23:22.678 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T17:23:22.726 DEBUG:teuthology.orchestra.run.smithi064:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T17:23:22.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T17:23:22.801 DEBUG:teuthology.orchestra.run.smithi016:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T17:24:08.493 INFO:teuthology.orchestra.run.smithi064.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T17:24:08.493 INFO:teuthology.orchestra.run.smithi064.stderr: * [new branch] main -> origin/main 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T17:24:08.526 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T17:24:08.527 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T17:24:08.527 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T17:24:08.530 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T17:24:08.531 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T17:24:08.532 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T17:24:08.534 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T17:24:08.535 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T17:24:08.535 INFO:teuthology.orchestra.run.smithi064.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T17:24:08.965 INFO:teuthology.orchestra.run.smithi016.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T17:24:08.965 INFO:teuthology.orchestra.run.smithi016.stderr: * [new branch] main -> origin/main 2023-11-28T17:24:08.997 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T17:24:08.997 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T17:24:08.997 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T17:24:08.998 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T17:24:09.004 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T17:24:09.004 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T17:24:09.004 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T17:24:09.004 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T17:24:09.004 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T17:24:09.004 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T17:24:09.005 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T17:24:09.005 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T17:24:09.005 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T17:24:09.005 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T17:24:09.008 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T17:24:09.009 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T17:24:09.010 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T17:24:09.011 INFO:teuthology.orchestra.run.smithi016.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T17:24:12.726 INFO:teuthology.orchestra.run.smithi064.stderr:Updating files: 49% (1593/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 63% (2075/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 80% (2615/3250) Updating files: 81% (2633/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 86% (2823/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T17:24:12.731 INFO:teuthology.orchestra.run.smithi064.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T17:24:12.753 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T17:24:12.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T17:24:12.989 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T17:24:12.989 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T17:24:12.992 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi064.front.sepia.ceph.com to complete... 2023-11-28T17:24:13.188 INFO:teuthology.orchestra.run.smithi016.stderr:Updating files: 49% (1597/3250) Updating files: 50% (1625/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 63% (2077/3250) Updating files: 64% (2080/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2642/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 89% (2912/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T17:24:13.193 INFO:teuthology.orchestra.run.smithi016.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T17:24:13.216 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T17:24:13.216 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T17:24:13.365 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T17:24:13.365 DEBUG:teuthology.orchestra.run.smithi016:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T17:24:13.368 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi016.front.sepia.ceph.com to complete... 2023-11-28T17:24:15.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28 17:24:14 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T17:24:15.009 INFO:teuthology.orchestra.run.smithi064.stderr:FINISHED --2023-11-28 17:24:14-- 2023-11-28T17:24:15.009 INFO:teuthology.orchestra.run.smithi064.stderr:Total wall clock time: 2.0s 2023-11-28T17:24:15.009 INFO:teuthology.orchestra.run.smithi064.stderr:Downloaded: 1 files, 37M in 1.8s (20.8 MB/s) 2023-11-28T17:24:15.012 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.1... 2023-11-28T17:24:15.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T17:24:15.253 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T17:24:16.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28 17:24:15 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T17:24:16.182 INFO:teuthology.orchestra.run.smithi016.stderr:FINISHED --2023-11-28 17:24:15-- 2023-11-28T17:24:16.182 INFO:teuthology.orchestra.run.smithi016.stderr:Total wall clock time: 2.8s 2023-11-28T17:24:16.182 INFO:teuthology.orchestra.run.smithi016.stderr:Downloaded: 1 files, 37M in 2.6s (14.3 MB/s) 2023-11-28T17:24:16.185 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T17:24:16.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T17:24:16.413 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T17:24:17.207 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T17:24:17.211 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T17:24:17.304 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T17:24:18.387 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T17:24:18.391 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T17:24:18.488 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T17:24:20.460 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T17:24:20.574 INFO:teuthology.orchestra.run.smithi064.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:24:21.989 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T17:24:22.100 INFO:teuthology.orchestra.run.smithi016.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:24:40.143 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub' 2023-11-28T17:24:40.161 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T17:24:40.186 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2023-11-28T17:24:40.516 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T17:24:40.541 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:24:40.812 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T17:24:40.818 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T17:24:40.876 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T17:24:40.880 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T17:24:41.045 INFO:teuthology.orchestra.run.smithi064.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T17:24:41.045 INFO:teuthology.orchestra.run.smithi064.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T17:24:41.045 INFO:teuthology.orchestra.run.smithi064.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T17:24:41.098 INFO:teuthology.orchestra.run.smithi064.stderr:done 2023-11-28T17:24:41.259 DEBUG:teuthology.orchestra.run.smithi064:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T17:24:41.267 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T17:24:41.267 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T17:24:41.267 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T17:24:41.277 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T17:24:41.278 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T17:24:41.296 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T17:24:41.297 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T17:24:41.297 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T17:24:41.297 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T17:24:41.300 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T17:24:41.301 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T17:24:41.302 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T17:24:41.302 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T17:24:41.302 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T17:24:41.302 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T17:24:41.302 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T17:24:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T17:24:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T17:24:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T17:24:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T17:24:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T17:24:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T17:24:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T17:24:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T17:24:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T17:24:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T17:24:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T17:24:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T17:24:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T17:24:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T17:24:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T17:24:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T17:24:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T17:24:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T17:24:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T17:24:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T17:24:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T17:24:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T17:24:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T17:24:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T17:24:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T17:24:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T17:24:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T17:24:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T17:24:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T17:24:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T17:24:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T17:24:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T17:24:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T17:24:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T17:24:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T17:24:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T17:24:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T17:24:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T17:24:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T17:24:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T17:24:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T17:24:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T17:24:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T17:24:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T17:24:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T17:24:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T17:24:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T17:24:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T17:24:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T17:24:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T17:24:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T17:24:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T17:24:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T17:24:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T17:24:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T17:24:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T17:24:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T17:24:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T17:24:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T17:24:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T17:24:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T17:24:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T17:24:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T17:24:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T17:24:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T17:24:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T17:24:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T17:24:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T17:24:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T17:24:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T17:24:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T17:24:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T17:24:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T17:24:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T17:24:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T17:24:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T17:24:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T17:24:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T17:24:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T17:24:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T17:24:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T17:24:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T17:24:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T17:24:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T17:24:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T17:24:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T17:24:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T17:24:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T17:24:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T17:24:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T17:24:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T17:24:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T17:24:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T17:24:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T17:24:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T17:24:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T17:24:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T17:24:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T17:24:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T17:24:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T17:24:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T17:24:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T17:24:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T17:24:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T17:24:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T17:24:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T17:24:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T17:24:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T17:24:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T17:24:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T17:24:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T17:24:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T17:24:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T17:24:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T17:24:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T17:24:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T17:24:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T17:24:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T17:24:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T17:24:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T17:24:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T17:24:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T17:24:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T17:24:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T17:24:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T17:24:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T17:24:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T17:24:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T17:24:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T17:24:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T17:24:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T17:24:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T17:24:41.591 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T17:24:41.592 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T17:24:41.593 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T17:24:41.594 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T17:24:41.595 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T17:24:41.596 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T17:24:41.597 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T17:24:41.598 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T17:24:41.599 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T17:24:41.600 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T17:24:41.601 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T17:24:41.602 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T17:24:41.603 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T17:24:41.604 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T17:24:41.605 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T17:24:41.606 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T17:24:41.607 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T17:24:41.608 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T17:24:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T17:24:41.610 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T17:24:41.611 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T17:24:41.612 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T17:24:41.613 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T17:24:41.614 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T17:24:41.615 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T17:24:41.616 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T17:24:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T17:24:41.618 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T17:24:41.619 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T17:24:41.620 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T17:24:41.621 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T17:24:41.621 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T17:24:41.648 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T17:24:41.649 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T17:24:41.650 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T17:24:41.650 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T17:24:41.650 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T17:24:41.683 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T17:24:41.684 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T17:24:41.685 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T17:24:41.686 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T17:24:41.687 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T17:24:41.688 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T17:24:41.689 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T17:24:41.690 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T17:24:41.691 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T17:24:41.692 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T17:24:41.693 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T17:24:41.694 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T17:24:41.695 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T17:24:41.696 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T17:24:41.697 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T17:24:41.698 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T17:24:41.699 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T17:24:41.700 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T17:24:41.701 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T17:24:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T17:24:41.703 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T17:24:41.704 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T17:24:41.705 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T17:24:41.706 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T17:24:41.707 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T17:24:41.708 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T17:24:41.709 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T17:24:41.710 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T17:24:41.711 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T17:24:41.712 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T17:24:41.713 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T17:24:41.714 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T17:24:41.715 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T17:24:41.716 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T17:24:41.717 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T17:24:41.718 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T17:24:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T17:24:41.720 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T17:24:41.721 INFO:teuthology.orchestra.run.smithi064.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T17:24:41.722 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T17:24:41.722 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T17:24:41.722 DEBUG:teuthology.orchestra.run.smithi064:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T17:24:41.729 INFO:teuthology.orchestra.run.smithi064.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T17:24:41.730 INFO:teuthology.orchestra.run.smithi064.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T17:24:41.730 INFO:teuthology.orchestra.run.smithi064.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T17:24:41.730 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T17:24:41.730 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T17:24:41.731 DEBUG:teuthology.orchestra.run.smithi064:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T17:24:41.772 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi064.front.sepia.ceph.com to complete... 2023-11-28T17:24:42.192 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub' 2023-11-28T17:24:42.193 INFO:teuthology.orchestra.run.smithi064.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T17:24:42.218 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2023-11-28T17:24:42.403 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T17:24:42.410 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:24:42.638 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T17:24:42.643 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T17:24:42.684 INFO:teuthology.orchestra.run.smithi064.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T17:24:42.689 INFO:teuthology.orchestra.run.smithi064.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T17:24:42.791 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2023-11-28T17:24:42.806 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T17:24:42.824 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2023-11-28T17:24:42.828 INFO:teuthology.orchestra.run.smithi064.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T17:24:42.829 INFO:teuthology.orchestra.run.smithi064.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T17:24:42.829 INFO:teuthology.orchestra.run.smithi064.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T17:24:42.851 INFO:teuthology.orchestra.run.smithi064.stderr:done 2023-11-28T17:24:43.149 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T17:24:43.165 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:24:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T17:24:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T17:24:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T17:24:43.513 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T17:24:43.654 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T17:24:43.654 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T17:24:43.654 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T17:24:43.685 INFO:teuthology.orchestra.run.smithi016.stderr:done 2023-11-28T17:24:43.870 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T17:24:43.878 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T17:24:43.878 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T17:24:43.878 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T17:24:43.890 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T17:24:43.891 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T17:24:43.912 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T17:24:43.912 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T17:24:43.913 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T17:24:43.914 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T17:24:43.915 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T17:24:43.915 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T17:24:43.915 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T17:24:43.916 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T17:24:43.917 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T17:24:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T17:24:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T17:24:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T17:24:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T17:24:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T17:24:43.918 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T17:24:43.935 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T17:24:43.935 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T17:24:43.935 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T17:24:43.936 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T17:24:43.937 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T17:24:43.938 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T17:24:43.939 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T17:24:43.940 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T17:24:43.941 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T17:24:43.942 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T17:24:43.943 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T17:24:43.944 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T17:24:43.945 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T17:24:43.946 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T17:24:43.947 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T17:24:43.948 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T17:24:43.949 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T17:24:43.950 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T17:24:43.951 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T17:24:43.952 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T17:24:43.952 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T17:24:43.952 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T17:24:43.952 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T17:24:43.952 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T17:24:43.999 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T17:24:44.000 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T17:24:44.001 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T17:24:44.002 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T17:24:44.003 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T17:24:44.004 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T17:24:44.005 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T17:24:44.006 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T17:24:44.007 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T17:24:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T17:24:44.009 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T17:24:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T17:24:44.011 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T17:24:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T17:24:44.013 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T17:24:44.014 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T17:24:44.015 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T17:24:44.016 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T17:24:44.017 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T17:24:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T17:24:44.019 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T17:24:44.020 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T17:24:44.021 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T17:24:44.022 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T17:24:44.023 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T17:24:44.024 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T17:24:44.025 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T17:24:44.026 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T17:24:44.027 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T17:24:44.028 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T17:24:44.029 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T17:24:44.030 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T17:24:44.031 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T17:24:44.032 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T17:24:44.033 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T17:24:44.034 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T17:24:44.035 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T17:24:44.036 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T17:24:44.037 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T17:24:44.038 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T17:24:44.039 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T17:24:44.040 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T17:24:44.041 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T17:24:44.042 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T17:24:44.043 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T17:24:44.044 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T17:24:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T17:24:44.046 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T17:24:44.047 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T17:24:44.048 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T17:24:44.049 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T17:24:44.050 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T17:24:44.051 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T17:24:44.052 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T17:24:44.053 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T17:24:44.084 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T17:24:44.085 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T17:24:44.086 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T17:24:44.087 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T17:24:44.088 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T17:24:44.089 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T17:24:44.090 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T17:24:44.091 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T17:24:44.093 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T17:24:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T17:24:44.095 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T17:24:44.096 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T17:24:44.097 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T17:24:44.098 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T17:24:44.099 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T17:24:44.100 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T17:24:44.101 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T17:24:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T17:24:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T17:24:44.104 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T17:24:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T17:24:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T17:24:44.107 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T17:24:44.108 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T17:24:44.109 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T17:24:44.110 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T17:24:44.111 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T17:24:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T17:24:44.113 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T17:24:44.114 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T17:24:44.115 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T17:24:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T17:24:44.117 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T17:24:44.118 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T17:24:44.119 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T17:24:44.120 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T17:24:44.121 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T17:24:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T17:24:44.123 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T17:24:44.124 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T17:24:44.125 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T17:24:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T17:24:44.127 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T17:24:44.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T17:24:44.165 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T17:24:44.165 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T17:24:44.166 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T17:24:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T17:24:44.168 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T17:24:44.169 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T17:24:44.170 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T17:24:44.171 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T17:24:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T17:24:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T17:24:44.174 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T17:24:44.175 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T17:24:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T17:24:44.177 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T17:24:44.178 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T17:24:44.179 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T17:24:44.180 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T17:24:44.181 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T17:24:44.182 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T17:24:44.183 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T17:24:44.184 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T17:24:44.185 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T17:24:44.186 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T17:24:44.187 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T17:24:44.188 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T17:24:44.189 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T17:24:44.190 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T17:24:44.191 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T17:24:44.192 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T17:24:44.193 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T17:24:44.194 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T17:24:44.195 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T17:24:44.196 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T17:24:44.197 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T17:24:44.198 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T17:24:44.199 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T17:24:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T17:24:44.201 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T17:24:44.202 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T17:24:44.203 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T17:24:44.204 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T17:24:44.205 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T17:24:44.206 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T17:24:44.207 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T17:24:44.208 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T17:24:44.209 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T17:24:44.210 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T17:24:44.211 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T17:24:44.212 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T17:24:44.213 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T17:24:44.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T17:24:44.213 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T17:24:44.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T17:24:44.213 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T17:24:44.213 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T17:24:44.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T17:24:44.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T17:24:44.244 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T17:24:44.244 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T17:24:44.245 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T17:24:44.246 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T17:24:44.247 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T17:24:44.248 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T17:24:44.249 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T17:24:44.250 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T17:24:44.251 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T17:24:44.252 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T17:24:44.253 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T17:24:44.254 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T17:24:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T17:24:44.256 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T17:24:44.257 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T17:24:44.258 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T17:24:44.259 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T17:24:44.260 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T17:24:44.261 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T17:24:44.262 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T17:24:44.263 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T17:24:44.264 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T17:24:44.265 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T17:24:44.266 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T17:24:44.267 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T17:24:44.268 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T17:24:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T17:24:44.270 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T17:24:44.271 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T17:24:44.272 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T17:24:44.273 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T17:24:44.274 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T17:24:44.275 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T17:24:44.276 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T17:24:44.277 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T17:24:44.278 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T17:24:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T17:24:44.280 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T17:24:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T17:24:44.282 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T17:24:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T17:24:44.284 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T17:24:44.285 INFO:teuthology.orchestra.run.smithi016.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T17:24:44.286 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T17:24:44.286 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T17:24:44.286 DEBUG:teuthology.orchestra.run.smithi016:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T17:24:44.292 INFO:teuthology.orchestra.run.smithi016.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T17:24:44.292 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T17:24:44.293 INFO:teuthology.orchestra.run.smithi016.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T17:24:44.293 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T17:24:44.293 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T17:24:44.293 DEBUG:teuthology.orchestra.run.smithi016:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T17:24:44.336 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi016.front.sepia.ceph.com to complete... 2023-11-28T17:24:44.716 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub' 2023-11-28T17:24:44.717 INFO:teuthology.orchestra.run.smithi016.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T17:24:44.748 INFO:teuthology.orchestra.run.smithi016.stderr:Generating grub configuration file ... 2023-11-28T17:24:44.956 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T17:24:44.962 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:24:45.196 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T17:24:45.201 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T17:24:45.246 INFO:teuthology.orchestra.run.smithi016.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T17:24:45.252 INFO:teuthology.orchestra.run.smithi016.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T17:24:45.409 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T17:24:45.409 INFO:teuthology.orchestra.run.smithi016.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T17:24:45.409 INFO:teuthology.orchestra.run.smithi016.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T17:24:45.431 INFO:teuthology.orchestra.run.smithi016.stderr:done 2023-11-28T17:25:14.011 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-11-28T17:25:14.011 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:25:14.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:25:16.557 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T17:25:16.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-11-28T17:25:16.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:25:32.386 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-28T17:25:34.946 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.16 2023-11-28T17:25:41.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:25:41.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:25:43.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-11-28T17:25:43.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:25:44.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-28T17:25:56.466 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:25:56.467 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:26:14.883 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-11-28T17:26:29.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:26:29.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:26:30.258 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-11-28T17:26:31.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:26:31.162 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g8247bbb5b470"... 2023-11-28T17:26:31.162 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2023-11-28T17:26:31.212 INFO:teuthology.orchestra.run.smithi064.stdout:6.6.0-g8247bbb5b470 2023-11-28T17:26:31.213 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T17:26:31.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T17:26:31.213 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T17:26:32.214 DEBUG:teuthology.parallel:result is None 2023-11-28T17:26:43.952 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T17:26:55.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-11-28T17:26:55.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:26:56.158 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-11-28T17:26:56.890 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-11-28T17:26:56.890 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T17:26:56.891 DEBUG:teuthology.orchestra.run.smithi016:> uname -r 2023-11-28T17:26:56.939 INFO:teuthology.orchestra.run.smithi016.stdout:6.6.0-g8247bbb5b470 2023-11-28T17:26:56.939 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T17:26:56.939 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T17:26:56.939 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T17:26:57.940 DEBUG:teuthology.parallel:result is None 2023-11-28T17:26:57.940 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T17:26:57.948 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T17:26:57.948 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T17:26:57.952 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T17:26:57.962 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T17:26:57.969 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T17:26:57.977 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T17:26:57.977 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T17:26:58.006 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T17:26:58.037 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T17:26:58.045 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T17:26:58.045 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T17:26:58.079 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T17:26:58.139 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T17:26:58.160 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T17:26:58.189 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T17:26:58.207 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T17:26:58.210 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T17:26:58.217 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T17:26:58.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T17:26:58.221 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T17:26:58.244 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T17:26:58.253 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T17:26:58.253 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T17:26:58.291 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T17:26:58.300 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T17:26:58.349 DEBUG:teuthology.orchestra.run.smithi016:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T17:26:58.401 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:26:58.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T17:26:58.479 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T17:26:58.489 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T17:26:58.542 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:26:58.542 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T17:26:58.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo service rsyslog restart 2023-11-28T17:26:58.617 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2023-11-28T17:26:58.744 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T17:26:58.752 INFO:teuthology.task.internal:Starting timer... 2023-11-28T17:26:58.752 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T17:26:58.762 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T17:26:58.770 DEBUG:teuthology.task.selinux:Excluding smithi016: OS 'ubuntu' does not support SELinux 2023-11-28T17:26:58.770 DEBUG:teuthology.task.selinux:Excluding smithi064: OS 'ubuntu' does not support SELinux 2023-11-28T17:26:58.771 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T17:26:58.771 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T17:26:58.771 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T17:26:58.771 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T17:26:58.779 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-28T17:26:58.785 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-28T17:26:58.911 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T17:26:58.926 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T17:26:58.927 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi016.front.sepia.ceph.com,smithi064.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T17:35:42.551 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi016.front.sepia.ceph.com'), Remote(name='ubuntu@smithi064.front.sepia.ceph.com')] 2023-11-28T17:35:42.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-11-28T17:35:42.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi016.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:35:42.638 DEBUG:teuthology.orchestra.run.smithi016:> true 2023-11-28T17:35:42.781 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi016.front.sepia.ceph.com' 2023-11-28T17:35:42.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:35:42.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T17:35:42.859 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-11-28T17:35:42.989 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-11-28T17:35:42.989 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T17:35:42.999 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T17:35:43.000 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T17:35:43.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T17:35:43.004 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T17:35:43.004 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T17:35:43.041 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Command line: ntpd -gq 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: ---------------------------------------------------- 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: corporation. Support and training for ntp-4 are 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: available at https://www.nwtime.org/support 2023-11-28T17:35:43.042 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: ---------------------------------------------------- 2023-11-28T17:35:43.043 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: proto: precision = 0.044 usec (-24) 2023-11-28T17:35:43.043 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: basedate set to 2022-02-04 2023-11-28T17:35:43.043 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: gps base set to 2022-02-06 (week 2196) 2023-11-28T17:35:43.043 INFO:teuthology.orchestra.run.smithi016.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T17:35:43.044 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T17:35:43.044 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T17:35:43.044 INFO:teuthology.orchestra.run.smithi016.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listen normally on 3 ens1f0 172.21.15.16:123 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listen normally on 4 lo [::1]:123 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1564%4]:123 2023-11-28T17:35:43.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:43 ntpd[27887]: Listening on routing socket on fd #22 for interface updates 2023-11-28T17:35:43.075 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Command line: ntpd -gq 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: ---------------------------------------------------- 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: corporation. Support and training for ntp-4 are 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: available at https://www.nwtime.org/support 2023-11-28T17:35:43.076 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: ---------------------------------------------------- 2023-11-28T17:35:43.077 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: proto: precision = 0.044 usec (-24) 2023-11-28T17:35:43.077 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: basedate set to 2022-02-04 2023-11-28T17:35:43.077 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: gps base set to 2022-02-06 (week 2196) 2023-11-28T17:35:43.077 INFO:teuthology.orchestra.run.smithi064.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T17:35:43.078 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T17:35:43.078 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T17:35:43.078 INFO:teuthology.orchestra.run.smithi064.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listen normally on 3 enp3s0f1 172.21.15.64:123 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listen normally on 4 lo [::1]:123 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8df%5]:123 2023-11-28T17:35:43.079 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:43 ntpd[27965]: Listening on routing socket on fd #22 for interface updates 2023-11-28T17:35:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:44 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:44 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:44 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:44 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:44 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:44 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:44 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:44 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:44 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:44 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:44 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:44 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:46 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:46 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:46 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:46 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:46 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:46.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:46 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:46.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:46 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:46.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:46 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:46.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:46 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:46.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:46 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:46.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:46 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:46.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:46 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:47 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:47 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:47 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:47 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:47 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:47 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:48.046 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:48 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:48.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:48 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:49.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:49 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:49.076 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:49 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:49 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:49 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:49 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:49.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:49 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:50.043 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.044 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:50.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:28 Nov 17:35:50 ntpd[27887]: ntpd: time slew -0.001083 s 2023-11-28T17:35:50.045 INFO:teuthology.orchestra.run.smithi016.stdout:ntpd: time slew -0.001083s 2023-11-28T17:35:50.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T17:35:50.045 INFO:teuthology.orchestra.run.smithi016.stderr:28 Nov 17:35:50 ntpd[27887]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T17:35:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stdout:28 Nov 17:35:50 ntpd[27965]: ntpd: time slew -0.001451 s 2023-11-28T17:35:50.078 INFO:teuthology.orchestra.run.smithi064.stdout:ntpd: time slew -0.001451s 2023-11-28T17:35:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T17:35:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:28 Nov 17:35:50 ntpd[27965]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T17:35:50.150 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T17:35:50.150 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2023-11-28T17:35:50.150 INFO:teuthology.orchestra.run.smithi016.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.150 INFO:teuthology.orchestra.run.smithi016.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.150 INFO:teuthology.orchestra.run.smithi016.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.150 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.180 INFO:teuthology.orchestra.run.smithi064.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T17:35:50.180 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================== 2023-11-28T17:35:50.180 INFO:teuthology.orchestra.run.smithi064.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.181 INFO:teuthology.orchestra.run.smithi064.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.181 INFO:teuthology.orchestra.run.smithi064.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.181 INFO:teuthology.orchestra.run.smithi064.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T17:35:50.182 INFO:teuthology.run_tasks:Running task install... 2023-11-28T17:35:50.192 DEBUG:teuthology.task.install:project ceph 2023-11-28T17:35:50.192 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}} 2023-11-28T17:35:50.192 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'} 2023-11-28T17:35:50.192 INFO:teuthology.task.install:Using flavor: default 2023-11-28T17:35:50.200 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T17:35:50.200 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T17:35:50.201 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-key list | grep Ceph 2023-11-28T17:35:50.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo apt-key list | grep Ceph 2023-11-28T17:35:50.311 INFO:teuthology.orchestra.run.smithi016.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T17:35:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T17:35:50.366 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T17:35:50.367 INFO:teuthology.orchestra.run.smithi016.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T17:35:50.368 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T17:35:50.368 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T17:35:50.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T17:35:50.389 INFO:teuthology.orchestra.run.smithi064.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T17:35:50.389 INFO:teuthology.orchestra.run.smithi064.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T17:35:50.390 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T17:35:50.390 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T17:35:50.391 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T17:35:50.738 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-11-28T17:35:50.739 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:35:50.753 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default/ 2023-11-28T17:35:50.753 INFO:teuthology.task.install.deb:Package version is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:35:50.850 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:35:50.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T17:35:50.859 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:35:50.859 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T17:35:50.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get update 2023-11-28T17:35:50.882 DEBUG:teuthology.orchestra.run.smithi064:> sudo apt-get update 2023-11-28T17:35:51.101 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T17:35:51.121 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T17:35:51.150 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T17:35:51.185 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T17:35:51.194 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T17:35:51.209 INFO:teuthology.orchestra.run.smithi016.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T17:35:51.276 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T17:35:51.302 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T17:35:51.312 INFO:teuthology.orchestra.run.smithi064.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T17:35:51.353 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-28T17:35:51.357 INFO:teuthology.orchestra.run.smithi064.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T17:35:51.364 INFO:teuthology.orchestra.run.smithi064.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-11-28T17:35:51.405 INFO:teuthology.orchestra.run.smithi016.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T17:35:51.420 INFO:teuthology.orchestra.run.smithi064.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T17:35:51.477 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-28T17:35:51.491 INFO:teuthology.orchestra.run.smithi064.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T17:35:51.565 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T17:35:51.651 INFO:teuthology.orchestra.run.smithi064.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,403 B] 2023-11-28T17:35:51.752 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 28.6 kB in 1s (44.2 kB/s) 2023-11-28T17:35:51.763 INFO:teuthology.orchestra.run.smithi064.stdout:Fetched 28.6 kB in 1s (44.2 kB/s) 2023-11-28T17:35:52.714 INFO:teuthology.orchestra.run.smithi064.stdout:Reading package lists... 2023-11-28T17:35:52.715 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2023-11-28T17:35:52.728 DEBUG:teuthology.orchestra.run.smithi064:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:35:52.730 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7531-g47c1c547-1jammy cephadm=18.0.0-7531-g47c1c547-1jammy ceph-mds=18.0.0-7531-g47c1c547-1jammy ceph-mgr=18.0.0-7531-g47c1c547-1jammy ceph-common=18.0.0-7531-g47c1c547-1jammy ceph-fuse=18.0.0-7531-g47c1c547-1jammy ceph-test=18.0.0-7531-g47c1c547-1jammy ceph-volume=18.0.0-7531-g47c1c547-1jammy radosgw=18.0.0-7531-g47c1c547-1jammy python3-rados=18.0.0-7531-g47c1c547-1jammy python3-rgw=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy python3-rbd=18.0.0-7531-g47c1c547-1jammy libcephfs2=18.0.0-7531-g47c1c547-1jammy libcephfs-dev=18.0.0-7531-g47c1c547-1jammy librados2=18.0.0-7531-g47c1c547-1jammy librbd1=18.0.0-7531-g47c1c547-1jammy rbd-fuse=18.0.0-7531-g47c1c547-1jammy python3-cephfs=18.0.0-7531-g47c1c547-1jammy cephfs-shell=18.0.0-7531-g47c1c547-1jammy cephfs-top=18.0.0-7531-g47c1c547-1jammy cephfs-mirror=18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:35:52.807 INFO:teuthology.orchestra.run.smithi064.stdout:Reading package lists... 2023-11-28T17:35:52.808 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2023-11-28T17:35:52.975 INFO:teuthology.orchestra.run.smithi064.stdout:Building dependency tree... 2023-11-28T17:35:52.976 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2023-11-28T17:35:52.976 INFO:teuthology.orchestra.run.smithi064.stdout:Reading state information... 2023-11-28T17:35:52.977 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2023-11-28T17:35:53.135 INFO:teuthology.orchestra.run.smithi064.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T17:35:53.135 INFO:teuthology.orchestra.run.smithi064.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T17:35:53.135 INFO:teuthology.orchestra.run.smithi064.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T17:35:53.135 INFO:teuthology.orchestra.run.smithi064.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T17:35:53.135 INFO:teuthology.orchestra.run.smithi064.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T17:35:53.136 INFO:teuthology.orchestra.run.smithi064.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T17:35:53.136 INFO:teuthology.orchestra.run.smithi064.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T17:35:53.136 INFO:teuthology.orchestra.run.smithi064.stdout:The following additional packages will be installed: 2023-11-28T17:35:53.136 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T17:35:53.137 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T17:35:53.137 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T17:35:53.138 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T17:35:53.138 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T17:35:53.138 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T17:35:53.138 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T17:35:53.138 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T17:35:53.139 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T17:35:53.140 INFO:teuthology.orchestra.run.smithi064.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout:Suggested packages: 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T17:35:53.141 INFO:teuthology.orchestra.run.smithi064.stdout:Recommended packages: 2023-11-28T17:35:53.142 INFO:teuthology.orchestra.run.smithi064.stdout: btrfs-tools 2023-11-28T17:35:53.143 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2023-11-28T17:35:53.143 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T17:35:53.143 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T17:35:53.144 INFO:teuthology.orchestra.run.smithi016.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T17:35:53.145 INFO:teuthology.orchestra.run.smithi016.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T17:35:53.146 INFO:teuthology.orchestra.run.smithi016.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T17:35:53.147 INFO:teuthology.orchestra.run.smithi016.stdout:Recommended packages: 2023-11-28T17:35:53.147 INFO:teuthology.orchestra.run.smithi016.stdout: btrfs-tools 2023-11-28T17:35:53.291 INFO:teuthology.orchestra.run.smithi064.stdout:The following NEW packages will be installed: 2023-11-28T17:35:53.291 INFO:teuthology.orchestra.run.smithi064.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T17:35:53.291 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T17:35:53.292 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T17:35:53.292 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T17:35:53.292 INFO:teuthology.orchestra.run.smithi064.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T17:35:53.292 INFO:teuthology.orchestra.run.smithi064.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T17:35:53.292 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T17:35:53.292 INFO:teuthology.orchestra.run.smithi064.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T17:35:53.293 INFO:teuthology.orchestra.run.smithi064.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T17:35:53.293 INFO:teuthology.orchestra.run.smithi064.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T17:35:53.293 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T17:35:53.293 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T17:35:53.294 INFO:teuthology.orchestra.run.smithi064.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi064.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi064.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi064.stdout: socat unzip xmlstarlet zip 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T17:35:53.295 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T17:35:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T17:35:53.296 INFO:teuthology.orchestra.run.smithi016.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T17:35:53.297 INFO:teuthology.orchestra.run.smithi016.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T17:35:53.298 INFO:teuthology.orchestra.run.smithi016.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T17:35:53.299 INFO:teuthology.orchestra.run.smithi016.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T17:35:53.300 INFO:teuthology.orchestra.run.smithi016.stdout: socat unzip xmlstarlet zip 2023-11-28T17:35:53.365 INFO:teuthology.orchestra.run.smithi016.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T17:35:53.365 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 187 MB of archives. 2023-11-28T17:35:53.365 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T17:35:53.365 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T17:35:53.383 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T17:35:53.383 INFO:teuthology.orchestra.run.smithi064.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T17:35:53.384 INFO:teuthology.orchestra.run.smithi064.stdout:Need to get 187 MB of archives. 2023-11-28T17:35:53.384 INFO:teuthology.orchestra.run.smithi064.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T17:35:53.384 INFO:teuthology.orchestra.run.smithi064.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T17:35:53.392 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T17:35:53.414 INFO:teuthology.orchestra.run.smithi064.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T17:35:53.430 INFO:teuthology.orchestra.run.smithi064.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T17:35:53.435 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T17:35:53.455 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T17:35:53.458 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T17:35:53.469 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T17:35:53.505 INFO:teuthology.orchestra.run.smithi064.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T17:35:53.507 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T17:35:53.510 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T17:35:53.517 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T17:35:53.519 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T17:35:53.520 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T17:35:53.526 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T17:35:53.531 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T17:35:53.531 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T17:35:53.531 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T17:35:53.531 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T17:35:53.543 INFO:teuthology.orchestra.run.smithi064.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T17:35:53.543 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T17:35:53.545 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T17:35:53.547 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T17:35:53.547 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T17:35:53.549 INFO:teuthology.orchestra.run.smithi064.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T17:35:53.560 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T17:35:53.562 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T17:35:53.562 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T17:35:53.562 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T17:35:53.563 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T17:35:53.563 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T17:35:53.566 INFO:teuthology.orchestra.run.smithi064.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-11-28T17:35:53.566 INFO:teuthology.orchestra.run.smithi064.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T17:35:53.577 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T17:35:53.578 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T17:35:53.580 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T17:35:53.580 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T17:35:53.582 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7531-g47c1c547-1jammy [3,466 kB] 2023-11-28T17:35:53.594 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T17:35:53.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T17:35:53.595 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T17:35:53.596 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T17:35:53.596 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T17:35:53.597 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T17:35:53.611 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T17:35:53.611 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T17:35:53.616 INFO:teuthology.orchestra.run.smithi016.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T17:35:53.616 INFO:teuthology.orchestra.run.smithi016.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T17:35:53.628 INFO:teuthology.orchestra.run.smithi016.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T17:35:53.629 INFO:teuthology.orchestra.run.smithi016.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T17:35:53.630 INFO:teuthology.orchestra.run.smithi016.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T17:35:53.630 INFO:teuthology.orchestra.run.smithi064.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T17:35:53.631 INFO:teuthology.orchestra.run.smithi016.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T17:35:53.632 INFO:teuthology.orchestra.run.smithi016.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T17:35:53.633 INFO:teuthology.orchestra.run.smithi016.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T17:35:53.634 INFO:teuthology.orchestra.run.smithi064.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T17:35:53.645 INFO:teuthology.orchestra.run.smithi016.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T17:35:53.647 INFO:teuthology.orchestra.run.smithi064.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T17:35:53.647 INFO:teuthology.orchestra.run.smithi016.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T17:35:53.647 INFO:teuthology.orchestra.run.smithi016.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T17:35:53.648 INFO:teuthology.orchestra.run.smithi016.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T17:35:53.650 INFO:teuthology.orchestra.run.smithi064.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T17:35:53.650 INFO:teuthology.orchestra.run.smithi064.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T17:35:53.660 INFO:teuthology.orchestra.run.smithi064.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T17:35:53.662 INFO:teuthology.orchestra.run.smithi016.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T17:35:53.663 INFO:teuthology.orchestra.run.smithi064.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T17:35:53.665 INFO:teuthology.orchestra.run.smithi064.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T17:35:53.667 INFO:teuthology.orchestra.run.smithi064.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T17:35:53.670 INFO:teuthology.orchestra.run.smithi064.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T17:35:53.690 INFO:teuthology.orchestra.run.smithi064.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T17:35:53.691 INFO:teuthology.orchestra.run.smithi064.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T17:35:53.693 INFO:teuthology.orchestra.run.smithi064.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T17:35:53.694 INFO:teuthology.orchestra.run.smithi064.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T17:35:53.694 INFO:teuthology.orchestra.run.smithi064.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T17:35:53.698 INFO:teuthology.orchestra.run.smithi064.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T17:35:53.698 INFO:teuthology.orchestra.run.smithi064.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T17:35:53.698 INFO:teuthology.orchestra.run.smithi064.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T17:35:53.698 INFO:teuthology.orchestra.run.smithi064.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T17:35:53.707 INFO:teuthology.orchestra.run.smithi016.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T17:35:53.708 INFO:teuthology.orchestra.run.smithi016.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T17:35:53.709 INFO:teuthology.orchestra.run.smithi016.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T17:35:53.710 INFO:teuthology.orchestra.run.smithi016.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T17:35:53.711 INFO:teuthology.orchestra.run.smithi016.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T17:35:53.717 INFO:teuthology.orchestra.run.smithi064.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T17:35:53.717 INFO:teuthology.orchestra.run.smithi064.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T17:35:53.717 INFO:teuthology.orchestra.run.smithi064.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T17:35:53.730 INFO:teuthology.orchestra.run.smithi016.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T17:35:53.733 INFO:teuthology.orchestra.run.smithi016.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T17:35:53.734 INFO:teuthology.orchestra.run.smithi016.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T17:35:53.739 INFO:teuthology.orchestra.run.smithi064.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T17:35:53.740 INFO:teuthology.orchestra.run.smithi064.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T17:35:53.740 INFO:teuthology.orchestra.run.smithi064.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T17:35:53.741 INFO:teuthology.orchestra.run.smithi064.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T17:35:53.742 INFO:teuthology.orchestra.run.smithi064.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T17:35:53.742 INFO:teuthology.orchestra.run.smithi064.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T17:35:53.743 INFO:teuthology.orchestra.run.smithi064.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T17:35:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T17:35:53.750 INFO:teuthology.orchestra.run.smithi016.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T17:35:53.751 INFO:teuthology.orchestra.run.smithi016.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T17:35:53.751 INFO:teuthology.orchestra.run.smithi016.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T17:35:53.752 INFO:teuthology.orchestra.run.smithi016.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T17:35:53.752 INFO:teuthology.orchestra.run.smithi016.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T17:35:53.760 INFO:teuthology.orchestra.run.smithi016.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T17:35:53.761 INFO:teuthology.orchestra.run.smithi016.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T17:35:53.763 INFO:teuthology.orchestra.run.smithi064.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T17:35:53.764 INFO:teuthology.orchestra.run.smithi064.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T17:35:53.764 INFO:teuthology.orchestra.run.smithi016.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T17:35:53.764 INFO:teuthology.orchestra.run.smithi064.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T17:35:53.777 INFO:teuthology.orchestra.run.smithi016.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T17:35:53.778 INFO:teuthology.orchestra.run.smithi016.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T17:35:53.779 INFO:teuthology.orchestra.run.smithi016.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T17:35:53.783 INFO:teuthology.orchestra.run.smithi016.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T17:35:53.785 INFO:teuthology.orchestra.run.smithi016.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T17:35:53.786 INFO:teuthology.orchestra.run.smithi016.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T17:35:53.787 INFO:teuthology.orchestra.run.smithi016.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T17:35:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T17:35:53.787 INFO:teuthology.orchestra.run.smithi064.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T17:35:53.788 INFO:teuthology.orchestra.run.smithi064.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T17:35:53.788 INFO:teuthology.orchestra.run.smithi064.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T17:35:53.789 INFO:teuthology.orchestra.run.smithi064.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T17:35:53.791 INFO:teuthology.orchestra.run.smithi064.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T17:35:53.792 INFO:teuthology.orchestra.run.smithi064.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T17:35:53.794 INFO:teuthology.orchestra.run.smithi016.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T17:35:53.798 INFO:teuthology.orchestra.run.smithi016.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T17:35:53.799 INFO:teuthology.orchestra.run.smithi016.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T17:35:53.808 INFO:teuthology.orchestra.run.smithi064.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T17:35:53.808 INFO:teuthology.orchestra.run.smithi064.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T17:35:53.810 INFO:teuthology.orchestra.run.smithi064.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T17:35:53.811 INFO:teuthology.orchestra.run.smithi016.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T17:35:53.811 INFO:teuthology.orchestra.run.smithi016.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T17:35:53.812 INFO:teuthology.orchestra.run.smithi016.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T17:35:53.812 INFO:teuthology.orchestra.run.smithi016.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T17:35:53.814 INFO:teuthology.orchestra.run.smithi016.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T17:35:53.816 INFO:teuthology.orchestra.run.smithi016.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T17:35:53.822 INFO:teuthology.orchestra.run.smithi016.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T17:35:53.827 INFO:teuthology.orchestra.run.smithi064.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T17:35:53.827 INFO:teuthology.orchestra.run.smithi064.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T17:35:53.828 INFO:teuthology.orchestra.run.smithi016.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T17:35:53.828 INFO:teuthology.orchestra.run.smithi016.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T17:35:53.829 INFO:teuthology.orchestra.run.smithi064.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T17:35:53.830 INFO:teuthology.orchestra.run.smithi016.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T17:35:53.845 INFO:teuthology.orchestra.run.smithi016.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T17:35:53.904 INFO:teuthology.orchestra.run.smithi064.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T17:35:53.905 INFO:teuthology.orchestra.run.smithi064.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T17:35:53.909 INFO:teuthology.orchestra.run.smithi064.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T17:35:53.909 INFO:teuthology.orchestra.run.smithi064.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T17:35:53.910 INFO:teuthology.orchestra.run.smithi064.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T17:35:53.940 INFO:teuthology.orchestra.run.smithi064.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T17:35:53.942 INFO:teuthology.orchestra.run.smithi064.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T17:35:53.943 INFO:teuthology.orchestra.run.smithi064.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T17:35:53.969 INFO:teuthology.orchestra.run.smithi064.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T17:35:53.974 INFO:teuthology.orchestra.run.smithi064.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T17:35:53.975 INFO:teuthology.orchestra.run.smithi064.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T17:35:53.975 INFO:teuthology.orchestra.run.smithi064.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T17:35:53.976 INFO:teuthology.orchestra.run.smithi064.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T17:35:53.977 INFO:teuthology.orchestra.run.smithi064.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T17:35:53.997 INFO:teuthology.orchestra.run.smithi064.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T17:35:53.997 INFO:teuthology.orchestra.run.smithi064.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T17:35:54.001 INFO:teuthology.orchestra.run.smithi064.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T17:35:54.003 INFO:teuthology.orchestra.run.smithi064.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T17:35:54.005 INFO:teuthology.orchestra.run.smithi064.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T17:35:54.020 INFO:teuthology.orchestra.run.smithi064.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T17:35:54.027 INFO:teuthology.orchestra.run.smithi064.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T17:35:54.031 INFO:teuthology.orchestra.run.smithi064.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T17:35:54.031 INFO:teuthology.orchestra.run.smithi064.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T17:35:54.035 INFO:teuthology.orchestra.run.smithi064.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T17:35:54.054 INFO:teuthology.orchestra.run.smithi064.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T17:35:54.060 INFO:teuthology.orchestra.run.smithi064.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T17:35:54.060 INFO:teuthology.orchestra.run.smithi064.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T17:35:54.064 INFO:teuthology.orchestra.run.smithi064.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T17:35:54.064 INFO:teuthology.orchestra.run.smithi064.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T17:35:54.094 INFO:teuthology.orchestra.run.smithi064.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T17:35:54.094 INFO:teuthology.orchestra.run.smithi064.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T17:35:54.096 INFO:teuthology.orchestra.run.smithi064.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T17:35:54.096 INFO:teuthology.orchestra.run.smithi064.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T17:35:54.105 INFO:teuthology.orchestra.run.smithi064.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T17:35:54.134 INFO:teuthology.orchestra.run.smithi064.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T17:35:54.135 INFO:teuthology.orchestra.run.smithi064.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T17:35:54.137 INFO:teuthology.orchestra.run.smithi064.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T17:35:54.138 INFO:teuthology.orchestra.run.smithi064.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T17:35:54.532 INFO:teuthology.orchestra.run.smithi064.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-11-28T17:35:54.711 INFO:teuthology.orchestra.run.smithi016.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7531-g47c1c547-1jammy [3,111 kB] 2023-11-28T17:35:55.126 INFO:teuthology.orchestra.run.smithi064.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-11-28T17:35:55.214 INFO:teuthology.orchestra.run.smithi064.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-11-28T17:35:55.312 INFO:teuthology.orchestra.run.smithi064.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-11-28T17:35:55.313 INFO:teuthology.orchestra.run.smithi064.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-11-28T17:35:55.319 INFO:teuthology.orchestra.run.smithi064.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-11-28T17:35:55.398 INFO:teuthology.orchestra.run.smithi016.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7531-g47c1c547-1jammy [690 kB] 2023-11-28T17:35:55.400 INFO:teuthology.orchestra.run.smithi064.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-11-28T17:35:55.412 INFO:teuthology.orchestra.run.smithi064.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-11-28T17:35:55.596 INFO:teuthology.orchestra.run.smithi016.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7531-g47c1c547-1jammy [356 kB] 2023-11-28T17:35:55.684 INFO:teuthology.orchestra.run.smithi016.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7531-g47c1c547-1jammy [32.8 kB] 2023-11-28T17:35:55.685 INFO:teuthology.orchestra.run.smithi016.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7531-g47c1c547-1jammy [180 kB] 2023-11-28T17:35:55.687 INFO:teuthology.orchestra.run.smithi016.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7531-g47c1c547-1jammy [63.5 kB] 2023-11-28T17:35:55.688 INFO:teuthology.orchestra.run.smithi016.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7531-g47c1c547-1jammy [330 kB] 2023-11-28T17:35:55.781 INFO:teuthology.orchestra.run.smithi016.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7531-g47c1c547-1jammy [6,233 kB] 2023-11-28T17:35:56.154 INFO:teuthology.orchestra.run.smithi064.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-11-28T17:35:56.179 INFO:teuthology.orchestra.run.smithi064.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-11-28T17:35:56.211 INFO:teuthology.orchestra.run.smithi064.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-11-28T17:35:56.436 INFO:teuthology.orchestra.run.smithi016.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7531-g47c1c547-1jammy [112 kB] 2023-11-28T17:35:56.441 INFO:teuthology.orchestra.run.smithi016.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7531-g47c1c547-1jammy [439 kB] 2023-11-28T17:35:56.510 INFO:teuthology.orchestra.run.smithi016.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7531-g47c1c547-1jammy [22.6 MB] 2023-11-28T17:35:57.715 INFO:teuthology.orchestra.run.smithi064.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-11-28T17:35:58.149 INFO:teuthology.orchestra.run.smithi064.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-11-28T17:35:58.156 INFO:teuthology.orchestra.run.smithi016.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7531-g47c1c547-1jammy [6,900 kB] 2023-11-28T17:35:58.157 INFO:teuthology.orchestra.run.smithi064.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-11-28T17:35:58.161 INFO:teuthology.orchestra.run.smithi064.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-11-28T17:35:58.252 INFO:teuthology.orchestra.run.smithi064.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-11-28T17:35:58.651 INFO:teuthology.orchestra.run.smithi016.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7531-g47c1c547-1jammy [238 kB] 2023-11-28T17:35:58.661 INFO:teuthology.orchestra.run.smithi016.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7531-g47c1c547-1jammy [124 kB] 2023-11-28T17:35:58.672 INFO:teuthology.orchestra.run.smithi016.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7531-g47c1c547-1jammy [1,496 kB] 2023-11-28T17:35:58.787 INFO:teuthology.orchestra.run.smithi016.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7531-g47c1c547-1jammy [9,957 kB] 2023-11-28T17:35:58.876 INFO:teuthology.orchestra.run.smithi064.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-11-28T17:35:59.537 INFO:teuthology.orchestra.run.smithi016.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7531-g47c1c547-1jammy [31.9 MB] 2023-11-28T17:36:00.955 INFO:teuthology.orchestra.run.smithi064.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-11-28T17:36:00.956 INFO:teuthology.orchestra.run.smithi064.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-11-28T17:36:00.981 INFO:teuthology.orchestra.run.smithi064.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-11-28T17:36:01.127 INFO:teuthology.orchestra.run.smithi064.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-11-28T17:36:01.188 INFO:teuthology.orchestra.run.smithi064.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-11-28T17:36:01.193 INFO:teuthology.orchestra.run.smithi064.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-11-28T17:36:01.298 INFO:teuthology.orchestra.run.smithi064.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-11-28T17:36:01.860 INFO:teuthology.orchestra.run.smithi064.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-11-28T17:36:01.860 INFO:teuthology.orchestra.run.smithi064.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-11-28T17:36:01.999 INFO:teuthology.orchestra.run.smithi016.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7531-g47c1c547-1jammy [14.0 kB] 2023-11-28T17:36:01.999 INFO:teuthology.orchestra.run.smithi016.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7531-g47c1c547-1jammy [839 kB] 2023-11-28T17:36:02.054 INFO:teuthology.orchestra.run.smithi016.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7531-g47c1c547-1jammy [2,144 kB] 2023-11-28T17:36:02.214 INFO:teuthology.orchestra.run.smithi016.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7531-g47c1c547-1jammy [802 kB] 2023-11-28T17:36:02.281 INFO:teuthology.orchestra.run.smithi016.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7531-g47c1c547-1jammy [139 kB] 2023-11-28T17:36:02.290 INFO:teuthology.orchestra.run.smithi016.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7531-g47c1c547-1jammy [1,900 kB] 2023-11-28T17:36:02.428 INFO:teuthology.orchestra.run.smithi016.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7531-g47c1c547-1jammy [8,625 kB] 2023-11-28T17:36:03.057 INFO:teuthology.orchestra.run.smithi016.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7531-g47c1c547-1jammy [14.2 kB] 2023-11-28T17:36:03.057 INFO:teuthology.orchestra.run.smithi016.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7531-g47c1c547-1jammy [48.7 MB] 2023-11-28T17:36:04.852 INFO:teuthology.orchestra.run.smithi064.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-11-28T17:36:04.853 INFO:teuthology.orchestra.run.smithi064.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-11-28T17:36:04.855 INFO:teuthology.orchestra.run.smithi064.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-11-28T17:36:04.855 INFO:teuthology.orchestra.run.smithi064.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-11-28T17:36:04.856 INFO:teuthology.orchestra.run.smithi064.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-11-28T17:36:04.858 INFO:teuthology.orchestra.run.smithi064.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-11-28T17:36:05.598 INFO:teuthology.orchestra.run.smithi064.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-11-28T17:36:06.062 INFO:teuthology.orchestra.run.smithi016.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7531-g47c1c547-1jammy [121 kB] 2023-11-28T17:36:06.063 INFO:teuthology.orchestra.run.smithi016.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7531-g47c1c547-1jammy [225 kB] 2023-11-28T17:36:06.065 INFO:teuthology.orchestra.run.smithi016.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7531-g47c1c547-1jammy [34.0 kB] 2023-11-28T17:36:06.066 INFO:teuthology.orchestra.run.smithi016.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7531-g47c1c547-1jammy [23.4 kB] 2023-11-28T17:36:06.066 INFO:teuthology.orchestra.run.smithi016.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7531-g47c1c547-1jammy [38.3 kB] 2023-11-28T17:36:06.067 INFO:teuthology.orchestra.run.smithi016.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7531-g47c1c547-1jammy [12.3 MB] 2023-11-28T17:36:06.253 INFO:teuthology.orchestra.run.smithi064.stdout:Fetched 187 MB in 12s (15.2 MB/s) 2023-11-28T17:36:06.384 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T17:36:06.457 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T17:36:06.459 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T17:36:06.481 INFO:teuthology.orchestra.run.smithi016.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102654/47c1c547372ed5bff7984647dc200bac0e019caf/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7531-g47c1c547-1jammy [91.4 kB] 2023-11-28T17:36:06.624 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T17:36:06.943 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T17:36:06.958 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T17:36:07.002 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T17:36:07.143 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 187 MB in 13s (14.2 MB/s) 2023-11-28T17:36:07.293 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T17:36:07.321 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T17:36:07.336 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T17:36:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T17:36:07.369 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T17:36:07.379 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T17:36:07.425 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T17:36:07.719 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T17:36:07.724 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T17:36:07.733 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T17:36:07.739 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T17:36:07.778 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T17:36:07.816 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T17:36:08.039 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T17:36:08.053 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T17:36:08.086 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T17:36:08.089 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T17:36:08.101 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T17:36:08.136 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T17:36:08.400 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T17:36:08.415 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T17:36:08.447 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T17:36:08.463 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T17:36:08.509 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T17:36:08.524 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T17:36:08.846 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T17:36:08.861 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T17:36:08.904 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T17:36:08.959 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T17:36:08.975 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T17:36:09.025 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:36:09.349 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T17:36:09.364 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T17:36:09.407 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T17:36:09.412 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T17:36:09.428 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T17:36:09.470 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:36:09.811 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T17:36:09.815 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T17:36:09.826 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T17:36:09.830 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T17:36:09.911 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:36:09.911 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:36:10.160 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T17:36:10.175 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T17:36:10.218 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T17:36:10.289 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T17:36:10.304 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T17:36:10.348 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:36:10.529 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librados2. 2023-11-28T17:36:10.544 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:10.604 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:10.676 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T17:36:10.691 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T17:36:10.743 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:36:11.157 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librbd1. 2023-11-28T17:36:11.174 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:11.207 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:11.287 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T17:36:11.303 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T17:36:11.346 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T17:36:11.551 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T17:36:11.566 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:11.626 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:11.665 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librados2. 2023-11-28T17:36:11.681 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../010-librados2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:11.723 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:11.904 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rados. 2023-11-28T17:36:11.919 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:11.962 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:12.152 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librbd1. 2023-11-28T17:36:12.167 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../011-librbd1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:12.202 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:12.281 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T17:36:12.297 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:12.340 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:12.579 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T17:36:12.584 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T17:36:12.595 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:12.599 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:12.638 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:12.659 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:12.907 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rados. 2023-11-28T17:36:12.911 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T17:36:12.922 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:12.926 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:12.965 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:12.970 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:13.285 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T17:36:13.290 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T17:36:13.301 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:13.305 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T17:36:13.343 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:13.348 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T17:36:13.587 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T17:36:13.603 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:13.608 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T17:36:13.624 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:13.637 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:13.684 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:13.957 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T17:36:13.972 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:14.018 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:14.019 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T17:36:14.037 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T17:36:14.070 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T17:36:14.314 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T17:36:14.329 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T17:36:14.335 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T17:36:14.351 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T17:36:14.364 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T17:36:14.393 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T17:36:14.646 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T17:36:14.661 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:14.669 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T17:36:14.685 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T17:36:14.704 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:14.734 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T17:36:15.016 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T17:36:15.031 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T17:36:15.062 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua5.1. 2023-11-28T17:36:15.077 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T17:36:15.091 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T17:36:15.120 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T17:36:15.326 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T17:36:15.342 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T17:36:15.393 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T17:36:15.423 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua-any. 2023-11-28T17:36:15.438 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T17:36:15.473 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T17:36:15.700 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package zip. 2023-11-28T17:36:15.716 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T17:36:15.721 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T17:36:15.737 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T17:36:15.767 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T17:36:15.779 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T17:36:16.062 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package unzip. 2023-11-28T17:36:16.077 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T17:36:16.120 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T17:36:16.368 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua5.1. 2023-11-28T17:36:16.384 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T17:36:16.433 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T17:36:16.508 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package luarocks. 2023-11-28T17:36:16.523 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T17:36:16.566 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T17:36:16.795 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-any. 2023-11-28T17:36:16.810 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T17:36:16.861 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T17:36:16.990 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package librgw2. 2023-11-28T17:36:17.004 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:17.048 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:17.131 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package zip. 2023-11-28T17:36:17.146 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T17:36:17.190 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T17:36:17.459 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T17:36:17.473 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:17.500 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package unzip. 2023-11-28T17:36:17.509 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:17.516 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T17:36:17.559 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T17:36:17.853 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T17:36:17.868 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T17:36:17.912 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T17:36:17.946 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package luarocks. 2023-11-28T17:36:17.962 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T17:36:18.004 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T17:36:18.215 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T17:36:18.230 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:18.273 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:18.362 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package librgw2. 2023-11-28T17:36:18.377 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../027-librgw2_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:18.412 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:18.626 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-common. 2023-11-28T17:36:18.641 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:18.676 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:18.882 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T17:36:18.896 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:18.957 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:19.318 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T17:36:19.333 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T17:36:19.376 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T17:36:19.654 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T17:36:19.670 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:19.690 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-base. 2023-11-28T17:36:19.704 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:19.705 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:19.757 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:20.099 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-common. 2023-11-28T17:36:20.115 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:20.158 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:20.427 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T17:36:20.441 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T17:36:20.485 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T17:36:20.771 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T17:36:20.786 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T17:36:20.855 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T17:36:21.300 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T17:36:21.315 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T17:36:21.350 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T17:36:21.405 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-base. 2023-11-28T17:36:21.421 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:21.498 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:21.602 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T17:36:21.618 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T17:36:21.661 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T17:36:21.990 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T17:36:22.006 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T17:36:22.049 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T17:36:22.176 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T17:36:22.191 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T17:36:22.234 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T17:36:22.318 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T17:36:22.334 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T17:36:22.368 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T17:36:22.621 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T17:36:22.637 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T17:36:22.654 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-portend. 2023-11-28T17:36:22.670 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T17:36:22.687 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T17:36:22.712 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T17:36:23.066 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T17:36:23.081 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T17:36:23.091 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T17:36:23.106 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T17:36:23.124 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T17:36:23.157 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T17:36:23.410 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T17:36:23.425 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T17:36:23.468 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T17:36:23.527 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T17:36:23.542 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T17:36:23.593 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T17:36:23.796 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T17:36:23.811 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T17:36:23.855 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T17:36:23.922 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T17:36:23.937 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T17:36:23.988 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T17:36:24.200 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T17:36:24.215 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T17:36:24.258 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T17:36:24.391 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T17:36:24.407 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T17:36:24.458 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T17:36:24.561 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T17:36:24.576 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T17:36:24.619 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T17:36:24.820 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-portend. 2023-11-28T17:36:24.835 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T17:36:24.886 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T17:36:24.905 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-mako. 2023-11-28T17:36:24.920 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T17:36:24.972 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T17:36:25.206 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T17:36:25.224 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T17:36:25.258 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T17:36:25.264 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T17:36:25.274 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T17:36:25.317 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T17:36:25.603 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T17:36:25.618 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T17:36:25.650 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T17:36:25.661 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T17:36:25.666 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T17:36:25.717 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T17:36:26.060 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-webob. 2023-11-28T17:36:26.076 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T17:36:26.095 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T17:36:26.111 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T17:36:26.614 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T17:36:26.729 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T17:36:26.998 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T17:36:27.014 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T17:36:27.041 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T17:36:27.056 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T17:36:27.061 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T17:36:27.100 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T17:36:27.360 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T17:36:27.369 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T17:36:27.376 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T17:36:27.385 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T17:36:27.410 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T17:36:27.428 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T17:36:27.689 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-paste. 2023-11-28T17:36:27.705 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T17:36:27.713 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-mako. 2023-11-28T17:36:27.729 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T17:36:27.739 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T17:36:27.772 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T17:36:28.076 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T17:36:28.091 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T17:36:28.125 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T17:36:28.133 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T17:36:28.141 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T17:36:28.183 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T17:36:28.437 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T17:36:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T17:36:28.469 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T17:36:28.485 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T17:36:28.494 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T17:36:28.528 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T17:36:28.764 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webob. 2023-11-28T17:36:28.772 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T17:36:28.780 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T17:36:28.788 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T17:36:28.822 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T17:36:28.822 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T17:36:29.134 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T17:36:29.142 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T17:36:29.149 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T17:36:29.158 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T17:36:29.192 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T17:36:29.203 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T17:36:29.522 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T17:36:29.537 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T17:36:29.562 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T17:36:29.577 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T17:36:29.580 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T17:36:29.620 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T17:36:29.900 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-idna. 2023-11-28T17:36:29.915 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T17:36:29.923 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-paste. 2023-11-28T17:36:29.939 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T17:36:29.958 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T17:36:29.981 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T17:36:30.293 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T17:36:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T17:36:30.309 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T17:36:30.309 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T17:36:30.351 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T17:36:30.352 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T17:36:30.672 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-requests. 2023-11-28T17:36:30.679 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T17:36:30.687 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T17:36:30.695 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T17:36:30.730 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T17:36:30.737 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T17:36:31.016 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T17:36:31.032 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T17:36:31.065 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T17:36:31.100 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T17:36:31.115 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T17:36:31.158 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T17:36:31.510 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T17:36:31.526 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T17:36:31.568 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T17:36:31.620 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T17:36:31.635 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:31.678 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:31.915 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T17:36:31.932 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T17:36:31.973 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T17:36:32.024 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T17:36:32.039 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:32.085 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:32.285 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-idna. 2023-11-28T17:36:32.301 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T17:36:32.343 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T17:36:32.421 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T17:36:32.434 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T17:36:32.477 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T17:36:32.637 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T17:36:32.653 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T17:36:32.696 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T17:36:32.780 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T17:36:32.795 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T17:36:32.837 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T17:36:33.024 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests. 2023-11-28T17:36:33.040 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T17:36:33.107 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T17:36:33.166 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T17:36:33.181 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:33.215 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:33.377 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T17:36:33.393 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T17:36:33.427 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T17:36:33.577 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T17:36:33.593 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:33.635 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:33.690 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T17:36:33.706 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:33.740 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:34.137 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T17:36:34.152 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:34.195 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:34.439 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T17:36:34.454 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:34.497 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:34.506 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T17:36:34.522 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T17:36:34.556 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T17:36:34.784 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T17:36:34.799 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T17:36:34.834 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T17:36:35.162 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T17:36:35.177 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:35.220 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:35.650 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph. 2023-11-28T17:36:35.665 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:35.698 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T17:36:35.700 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:35.715 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:35.765 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:35.994 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T17:36:36.010 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:36.052 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:36.439 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T17:36:36.454 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:36.647 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:36.944 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T17:36:36.959 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:37.000 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephadm. 2023-11-28T17:36:37.010 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:37.017 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:37.049 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:37.336 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T17:36:37.352 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T17:36:37.394 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T17:36:37.696 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T17:36:37.712 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T17:36:37.746 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T17:36:38.447 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph. 2023-11-28T17:36:38.462 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../068-ceph_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:38.521 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:38.734 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-babel. 2023-11-28T17:36:38.749 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T17:36:38.793 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T17:36:38.924 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T17:36:38.940 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:38.991 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:39.087 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T17:36:39.101 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T17:36:39.146 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T17:36:39.427 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T17:36:39.443 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:39.490 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T17:36:39.504 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:39.510 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:39.548 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:39.877 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T17:36:39.891 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T17:36:39.905 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephadm. 2023-11-28T17:36:39.921 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../071-cephadm_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:39.926 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T17:36:39.963 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:40.179 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-routes. 2023-11-28T17:36:40.194 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T17:36:40.229 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T17:36:40.350 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T17:36:40.366 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T17:36:40.416 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T17:36:40.565 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T17:36:40.580 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:40.615 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:40.727 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T17:36:40.743 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T17:36:40.810 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T17:36:41.035 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T17:36:41.050 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T17:36:41.094 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T17:36:41.622 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T17:36:41.636 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T17:36:41.680 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T17:36:41.766 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-babel. 2023-11-28T17:36:41.780 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T17:36:41.824 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T17:36:42.042 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T17:36:42.056 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T17:36:42.168 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T17:36:42.177 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T17:36:42.183 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T17:36:42.227 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T17:36:42.530 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T17:36:42.545 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T17:36:42.546 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T17:36:42.561 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:42.580 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T17:36:42.605 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:42.958 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T17:36:42.974 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T17:36:43.016 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T17:36:43.256 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T17:36:43.270 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:43.277 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-routes. 2023-11-28T17:36:43.293 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T17:36:43.314 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:43.352 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T17:36:43.689 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T17:36:43.704 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:43.747 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:44.142 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T17:36:44.157 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T17:36:44.200 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T17:36:44.284 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T17:36:44.300 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T17:36:44.342 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T17:36:44.662 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T17:36:44.678 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T17:36:44.720 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T17:36:44.821 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T17:36:44.836 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T17:36:44.878 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T17:36:45.065 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T17:36:45.081 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T17:36:45.123 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T17:36:45.207 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T17:36:45.225 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T17:36:45.334 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T17:36:45.434 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T17:36:45.450 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T17:36:45.493 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T17:36:45.637 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T17:36:45.652 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T17:36:45.695 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T17:36:45.830 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T17:36:45.846 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T17:36:45.880 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T17:36:46.166 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T17:36:46.181 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T17:36:46.216 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T17:36:46.371 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T17:36:46.386 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:46.429 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:46.552 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T17:36:46.568 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T17:36:46.610 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T17:36:47.156 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T17:36:47.172 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T17:36:47.213 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T17:36:47.524 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T17:36:47.540 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T17:36:47.582 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T17:36:47.885 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T17:36:47.902 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T17:36:47.943 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T17:36:47.944 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T17:36:47.959 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:48.002 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:48.272 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T17:36:48.289 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T17:36:48.305 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T17:36:48.319 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T17:36:48.330 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T17:36:48.355 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T17:36:48.650 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T17:36:48.657 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T17:36:48.665 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T17:36:48.672 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T17:36:48.700 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T17:36:48.716 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T17:36:48.952 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package jq. 2023-11-28T17:36:48.962 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T17:36:48.967 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T17:36:48.978 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T17:36:49.010 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T17:36:49.020 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T17:36:49.271 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package socat. 2023-11-28T17:36:49.287 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T17:36:49.329 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T17:36:49.340 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T17:36:49.356 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T17:36:49.398 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T17:36:49.641 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T17:36:49.657 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T17:36:49.699 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T17:36:49.709 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T17:36:49.725 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T17:36:49.768 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T17:36:50.053 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-test. 2023-11-28T17:36:50.068 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:50.111 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:50.129 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T17:36:50.146 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T17:36:50.187 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T17:36:50.810 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T17:36:50.825 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:50.860 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:51.212 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T17:36:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T17:36:51.270 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T17:36:51.616 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T17:36:51.631 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T17:36:51.674 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T17:36:51.874 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T17:36:51.890 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:51.910 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package jq. 2023-11-28T17:36:51.926 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T17:36:51.949 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:51.959 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T17:36:52.179 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package socat. 2023-11-28T17:36:52.195 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T17:36:52.237 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T17:36:52.311 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T17:36:52.328 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:52.369 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:52.566 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T17:36:52.582 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T17:36:52.624 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T17:36:52.681 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T17:36:52.697 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T17:36:52.738 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T17:36:52.919 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-test. 2023-11-28T17:36:52.934 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:52.978 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:53.041 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T17:36:53.057 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:53.099 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:53.344 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T17:36:53.360 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:53.402 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:53.654 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T17:36:53.670 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:53.712 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:54.040 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T17:36:54.057 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T17:36:54.090 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T17:36:54.370 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T17:36:54.386 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T17:36:54.420 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T17:36:54.732 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T17:36:54.748 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:54.782 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T17:36:54.798 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T17:36:54.798 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:54.840 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T17:36:55.203 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T17:36:55.219 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:55.261 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:55.295 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package pkg-config. 2023-11-28T17:36:55.311 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T17:36:55.353 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T17:36:55.522 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T17:36:55.538 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T17:36:55.572 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T17:36:55.590 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T17:36:55.606 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T17:36:55.648 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T17:36:55.833 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T17:36:55.849 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:55.891 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:56.034 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T17:36:56.050 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T17:36:56.101 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T17:36:56.135 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T17:36:56.151 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7531-g47c1c547-1jammy_all.deb ... 2023-11-28T17:36:56.193 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:56.403 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T17:36:56.420 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T17:36:56.461 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T17:36:56.462 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T17:36:56.479 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:36:56.521 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:36:56.782 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T17:36:56.798 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T17:36:56.798 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T17:36:56.815 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T17:36:56.839 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T17:36:56.857 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T17:36:57.142 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T17:36:57.159 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T17:36:57.186 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T17:36:57.201 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T17:36:57.202 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T17:36:57.244 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T17:36:57.529 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-py. 2023-11-28T17:36:57.545 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T17:36:57.578 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T17:36:57.840 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T17:36:57.856 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T17:36:57.873 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T17:36:57.889 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T17:36:57.898 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T17:36:57.931 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T17:36:58.321 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pkg-config. 2023-11-28T17:36:58.337 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T17:36:58.378 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T17:36:58.454 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T17:36:58.471 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T17:36:58.512 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T17:36:58.623 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T17:36:58.639 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T17:36:58.681 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T17:36:58.823 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-toml. 2023-11-28T17:36:58.840 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T17:36:58.881 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T17:36:59.159 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T17:36:59.176 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T17:36:59.184 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T17:36:59.201 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T17:36:59.217 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T17:36:59.242 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T17:36:59.504 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T17:36:59.520 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T17:36:59.553 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T17:36:59.580 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T17:36:59.596 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T17:36:59.637 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T17:36:59.840 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T17:36:59.857 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T17:36:59.898 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T17:36:59.907 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T17:36:59.923 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T17:36:59.965 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T17:37:00.260 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T17:37:00.276 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T17:37:00.319 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T17:37:00.629 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-py. 2023-11-28T17:37:00.646 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T17:37:00.687 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T17:37:00.727 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package radosgw. 2023-11-28T17:37:00.742 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:37:00.785 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:01.008 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T17:37:01.024 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T17:37:01.065 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T17:37:01.472 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T17:37:01.488 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:37:01.521 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:01.561 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T17:37:01.577 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T17:37:01.619 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T17:37:01.791 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T17:37:01.930 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-toml. 2023-11-28T17:37:01.947 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T17:37:01.989 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T17:37:02.052 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T17:37:02.292 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T17:37:02.308 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T17:37:02.350 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T17:37:02.460 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T17:37:02.735 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T17:37:02.741 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T17:37:02.751 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T17:37:02.795 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T17:37:03.081 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T17:37:03.097 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T17:37:03.139 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T17:37:03.170 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T17:37:03.840 INFO:teuthology.orchestra.run.smithi064.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T17:37:03.853 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package radosgw. 2023-11-28T17:37:03.854 INFO:teuthology.orchestra.run.smithi064.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T17:37:03.867 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../122-radosgw_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:37:03.896 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:03.910 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:04.482 INFO:teuthology.orchestra.run.smithi064.stdout:Adding system user cephadm....done 2023-11-28T17:37:04.488 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T17:37:04.503 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7531-g47c1c547-1jammy_amd64.deb ... 2023-11-28T17:37:04.546 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:04.643 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T17:37:04.834 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T17:37:04.961 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T17:37:05.093 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T17:37:05.219 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T17:37:05.229 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T17:37:05.355 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T17:37:05.517 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T17:37:05.648 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T17:37:05.940 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T17:37:05.952 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T17:37:06.049 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T17:37:06.351 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T17:37:06.555 INFO:teuthology.orchestra.run.smithi016.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T17:37:06.590 INFO:teuthology.orchestra.run.smithi016.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T17:37:06.637 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:06.728 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T17:37:07.004 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T17:37:07.272 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T17:37:07.299 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user cephadm....done 2023-11-28T17:37:07.435 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T17:37:07.565 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T17:37:07.728 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T17:37:07.800 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T17:37:07.988 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T17:37:08.076 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T17:37:08.088 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T17:37:08.353 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T17:37:08.381 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T17:37:08.620 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:08.649 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T17:37:08.750 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T17:37:08.896 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T17:37:09.030 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T17:37:09.069 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T17:37:09.156 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T17:37:09.424 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T17:37:09.471 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T17:37:09.554 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T17:37:09.739 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T17:37:09.801 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T17:37:09.990 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T17:37:10.146 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T17:37:10.181 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T17:37:10.262 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T17:37:10.274 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T17:37:10.388 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T17:37:10.526 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T17:37:10.781 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T17:37:10.794 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T17:37:10.898 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T17:37:11.070 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T17:37:11.167 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T17:37:11.329 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-argparse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:11.429 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T17:37:11.605 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T17:37:11.743 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T17:37:11.748 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T17:37:11.865 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T17:37:11.869 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T17:37:12.117 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T17:37:12.226 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T17:37:12.510 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T17:37:12.597 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T17:37:12.885 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T17:37:12.889 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T17:37:12.916 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T17:37:13.014 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T17:37:13.015 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T17:37:13.116 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T17:37:13.132 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T17:37:13.425 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T17:37:13.818 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T17:37:13.824 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T17:37:13.950 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T17:37:14.078 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T17:37:14.263 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T17:37:14.479 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T17:37:14.544 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T17:37:14.789 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T17:37:14.863 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T17:37:14.963 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T17:37:15.115 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T17:37:15.466 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T17:37:15.665 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T17:37:15.725 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T17:37:15.851 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:15.933 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T17:37:16.059 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T17:37:16.161 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T17:37:16.185 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T17:37:16.511 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T17:37:16.512 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T17:37:16.929 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T17:37:17.180 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T17:37:17.556 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T17:37:17.868 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T17:37:17.978 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T17:37:18.194 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T17:37:18.227 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:37:18.370 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T17:37:18.563 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T17:37:18.655 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T17:37:18.811 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T17:37:18.880 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T17:37:18.940 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T17:37:19.006 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:19.224 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T17:37:19.307 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T17:37:19.484 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T17:37:19.683 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T17:37:19.751 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:37:19.902 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T17:37:20.229 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T17:37:20.497 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T17:37:20.773 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T17:37:20.981 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T17:37:21.065 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T17:37:21.225 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:37:21.316 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T17:37:21.358 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T17:37:21.575 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T17:37:21.635 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T17:37:21.701 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T17:37:21.761 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T17:37:21.887 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T17:37:21.994 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T17:37:22.129 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T17:37:22.222 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T17:37:22.447 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T17:37:22.489 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T17:37:22.764 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T17:37:22.765 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:37:22.891 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T17:37:23.032 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T17:37:23.141 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T17:37:23.234 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T17:37:23.242 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T17:37:23.331 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T17:37:23.513 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T17:37:23.577 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T17:37:23.711 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T17:37:23.787 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T17:37:24.030 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T17:37:24.121 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T17:37:24.280 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T17:37:24.397 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T17:37:24.523 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T17:37:24.565 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T17:37:24.691 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T17:37:24.774 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:37:24.875 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T17:37:24.983 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T17:37:25.110 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T17:37:25.218 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T17:37:25.411 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T17:37:25.537 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T17:37:25.737 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T17:37:25.829 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T17:37:26.030 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T17:37:26.056 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T17:37:26.156 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T17:37:26.273 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T17:37:26.316 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T17:37:26.346 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T17:37:26.567 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T17:37:26.592 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T17:37:26.718 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T17:37:26.835 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T17:37:27.128 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T17:37:27.229 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T17:37:27.396 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T17:37:27.496 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T17:37:27.538 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T17:37:27.747 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T17:37:27.865 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T17:37:27.899 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T17:37:28.041 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:28.151 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:28.174 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T17:37:28.277 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T17:37:28.476 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T17:37:28.622 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:28.747 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:28.777 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T17:37:28.865 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T17:37:29.005 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T17:37:29.143 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:29.260 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:29.265 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T17:37:29.386 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:29.557 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T17:37:29.602 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T17:37:29.603 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T17:37:29.867 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T17:37:30.260 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T17:37:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:30.562 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T17:37:30.713 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:30.848 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:30.923 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T17:37:30.973 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:31.049 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librados2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:31.149 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T17:37:31.175 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:31.301 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T17:37:31.637 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:31.738 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libradosstriper1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:31.839 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T17:37:32.132 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librbd1 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.284 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-modules-core (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.409 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.486 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.612 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.641 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T17:37:32.641 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T17:37:32.738 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.864 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:32.990 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:33.269 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcephfs-dev (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:33.395 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rados (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:33.485 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:33.554 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up librgw2 (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:33.680 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-top (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:33.798 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T17:37:34.006 INFO:teuthology.orchestra.run.smithi064.stdout:Adding group ceph....done 2023-11-28T17:37:34.382 INFO:teuthology.orchestra.run.smithi064.stdout:Adding system user ceph....done 2023-11-28T17:37:34.542 INFO:teuthology.orchestra.run.smithi064.stdout:Setting system user ceph properties....done 2023-11-28T17:37:34.557 INFO:teuthology.orchestra.run.smithi064.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T17:37:34.707 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T17:37:35.127 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rbd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:35.130 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T17:37:35.253 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up rbd-fuse (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:35.379 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-rgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:35.505 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up python3-cephfs (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:35.631 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-shell (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:35.749 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-common (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:35.811 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:36.019 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T17:37:36.019 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T17:37:36.286 INFO:teuthology.orchestra.run.smithi016.stdout:Adding group ceph....done 2023-11-28T17:37:36.611 INFO:teuthology.orchestra.run.smithi016.stdout:Adding system user ceph....done 2023-11-28T17:37:36.629 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:36.755 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:36.773 INFO:teuthology.orchestra.run.smithi016.stdout:Setting system user ceph properties....done 2023-11-28T17:37:36.792 INFO:teuthology.orchestra.run.smithi016.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T17:37:36.943 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T17:37:37.310 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T17:37:37.310 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T17:37:37.348 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T17:37:37.948 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:38.058 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up cephfs-mirror (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:38.274 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T17:37:38.274 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T17:37:38.279 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T17:37:38.918 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-test (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:38.985 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:39.052 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up radosgw (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:39.215 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T17:37:39.215 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T17:37:39.870 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:39.882 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T17:37:39.882 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T17:37:40.094 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T17:37:40.094 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T17:37:40.506 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-base (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:40.747 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:40.872 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T17:37:41.081 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T17:37:41.081 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T17:37:41.550 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mds (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:41.723 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:41.788 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T17:37:41.788 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T17:37:41.849 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:42.000 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:42.219 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T17:37:42.219 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T17:37:42.443 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:42.647 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T17:37:42.647 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T17:37:42.868 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:43.002 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:43.129 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:43.254 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:43.303 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-osd (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:43.599 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T17:37:43.612 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T17:37:43.612 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T17:37:43.699 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T17:37:43.851 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T17:37:44.255 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:44.380 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:44.855 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mon (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:44.994 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T17:37:45.056 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T17:37:45.056 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T17:37:45.705 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-cephadm (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:45.709 INFO:teuthology.orchestra.run.smithi064.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T17:37:45.714 DEBUG:teuthology.orchestra.run.smithi064:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T17:37:45.791 INFO:teuthology.orchestra.run.smithi064.stdout:Reading package lists... 2023-11-28T17:37:45.848 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:45.962 INFO:teuthology.orchestra.run.smithi064.stdout:Building dependency tree... 2023-11-28T17:37:45.962 INFO:teuthology.orchestra.run.smithi064.stdout:Reading state information... 2023-11-28T17:37:45.974 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-mgr-dashboard (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:46.120 INFO:teuthology.orchestra.run.smithi064.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T17:37:46.120 INFO:teuthology.orchestra.run.smithi064.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T17:37:46.120 INFO:teuthology.orchestra.run.smithi064.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:37:46.120 INFO:teuthology.orchestra.run.smithi064.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:37:46.121 INFO:teuthology.orchestra.run.smithi064.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T17:37:46.121 INFO:teuthology.orchestra.run.smithi064.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T17:37:46.121 INFO:teuthology.orchestra.run.smithi064.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T17:37:46.121 INFO:teuthology.orchestra.run.smithi064.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T17:37:46.121 INFO:teuthology.orchestra.run.smithi064.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T17:37:46.121 INFO:teuthology.orchestra.run.smithi064.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T17:37:46.122 INFO:teuthology.orchestra.run.smithi064.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T17:37:46.122 INFO:teuthology.orchestra.run.smithi064.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T17:37:46.122 INFO:teuthology.orchestra.run.smithi064.stdout:The following additional packages will be installed: 2023-11-28T17:37:46.122 INFO:teuthology.orchestra.run.smithi064.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T17:37:46.122 INFO:teuthology.orchestra.run.smithi064.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T17:37:46.122 INFO:teuthology.orchestra.run.smithi064.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T17:37:46.123 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T17:37:46.123 INFO:teuthology.orchestra.run.smithi064.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T17:37:46.123 INFO:teuthology.orchestra.run.smithi064.stdout:Suggested packages: 2023-11-28T17:37:46.123 INFO:teuthology.orchestra.run.smithi064.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T17:37:46.123 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T17:37:46.123 INFO:teuthology.orchestra.run.smithi064.stdout: libengine-pkcs11-openssl 2023-11-28T17:37:46.125 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ceph-volume (18.0.0-7531-g47c1c547-1jammy) ... 2023-11-28T17:37:46.174 INFO:teuthology.orchestra.run.smithi064.stdout:The following NEW packages will be installed: 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T17:37:46.175 INFO:teuthology.orchestra.run.smithi064.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T17:37:46.176 INFO:teuthology.orchestra.run.smithi064.stdout:The following packages will be upgraded: 2023-11-28T17:37:46.176 INFO:teuthology.orchestra.run.smithi064.stdout: libssl3 2023-11-28T17:37:46.362 INFO:teuthology.orchestra.run.smithi064.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T17:37:46.362 INFO:teuthology.orchestra.run.smithi064.stdout:Need to get 54.6 MB of archives. 2023-11-28T17:37:46.362 INFO:teuthology.orchestra.run.smithi064.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T17:37:46.362 INFO:teuthology.orchestra.run.smithi064.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T17:37:46.511 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T17:37:46.612 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T17:37:46.755 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T17:37:46.859 INFO:teuthology.orchestra.run.smithi064.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T17:37:47.121 INFO:teuthology.orchestra.run.smithi064.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T17:37:47.154 INFO:teuthology.orchestra.run.smithi064.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T17:37:47.156 INFO:teuthology.orchestra.run.smithi064.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T17:37:47.161 INFO:teuthology.orchestra.run.smithi064.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T17:37:47.165 INFO:teuthology.orchestra.run.smithi064.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T17:37:47.165 INFO:teuthology.orchestra.run.smithi064.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T17:37:47.168 INFO:teuthology.orchestra.run.smithi064.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T17:37:47.170 INFO:teuthology.orchestra.run.smithi064.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T17:37:47.171 INFO:teuthology.orchestra.run.smithi064.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T17:37:47.335 INFO:teuthology.orchestra.run.smithi064.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T17:37:47.671 INFO:teuthology.orchestra.run.smithi064.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T17:37:47.957 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T17:37:48.670 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T17:37:48.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T17:37:48.730 INFO:teuthology.orchestra.run.smithi064.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T17:37:48.732 INFO:teuthology.orchestra.run.smithi064.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T17:37:48.732 INFO:teuthology.orchestra.run.smithi064.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T17:37:48.735 INFO:teuthology.orchestra.run.smithi064.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T17:37:48.735 INFO:teuthology.orchestra.run.smithi064.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T17:37:48.740 INFO:teuthology.orchestra.run.smithi064.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T17:37:48.752 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2023-11-28T17:37:48.756 INFO:teuthology.orchestra.run.smithi064.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T17:37:48.764 INFO:teuthology.orchestra.run.smithi064.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T17:37:48.764 INFO:teuthology.orchestra.run.smithi064.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T17:37:48.922 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2023-11-28T17:37:48.923 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2023-11-28T17:37:49.006 INFO:teuthology.orchestra.run.smithi064.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T17:37:49.080 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T17:37:49.081 INFO:teuthology.orchestra.run.smithi016.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T17:37:49.081 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T17:37:49.081 INFO:teuthology.orchestra.run.smithi016.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T17:37:49.082 INFO:teuthology.orchestra.run.smithi016.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T17:37:49.083 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2023-11-28T17:37:49.083 INFO:teuthology.orchestra.run.smithi016.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T17:37:49.083 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T17:37:49.083 INFO:teuthology.orchestra.run.smithi016.stdout: libengine-pkcs11-openssl 2023-11-28T17:37:49.088 INFO:teuthology.orchestra.run.smithi064.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T17:37:49.133 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2023-11-28T17:37:49.134 INFO:teuthology.orchestra.run.smithi016.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T17:37:49.134 INFO:teuthology.orchestra.run.smithi016.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T17:37:49.134 INFO:teuthology.orchestra.run.smithi016.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T17:37:49.134 INFO:teuthology.orchestra.run.smithi016.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T17:37:49.134 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T17:37:49.135 INFO:teuthology.orchestra.run.smithi016.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T17:37:49.135 INFO:teuthology.orchestra.run.smithi016.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T17:37:49.135 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2023-11-28T17:37:49.136 INFO:teuthology.orchestra.run.smithi016.stdout: libssl3 2023-11-28T17:37:49.215 INFO:teuthology.orchestra.run.smithi016.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T17:37:49.215 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 54.6 MB of archives. 2023-11-28T17:37:49.215 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T17:37:49.215 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T17:37:49.334 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T17:37:49.398 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T17:37:49.406 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T17:37:49.407 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T17:37:49.409 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T17:37:49.410 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T17:37:49.411 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T17:37:49.412 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T17:37:49.412 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T17:37:49.413 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T17:37:49.419 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T17:37:49.434 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T17:37:49.569 INFO:teuthology.orchestra.run.smithi064.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T17:37:49.699 INFO:teuthology.orchestra.run.smithi064.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T17:37:49.710 INFO:teuthology.orchestra.run.smithi064.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T17:37:49.711 INFO:teuthology.orchestra.run.smithi064.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T17:37:49.712 INFO:teuthology.orchestra.run.smithi064.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T17:37:49.713 INFO:teuthology.orchestra.run.smithi064.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T17:37:49.747 INFO:teuthology.orchestra.run.smithi064.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T17:37:49.753 INFO:teuthology.orchestra.run.smithi064.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T17:37:49.849 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T17:37:49.851 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T17:37:49.851 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T17:37:49.854 INFO:teuthology.orchestra.run.smithi016.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T17:37:49.855 INFO:teuthology.orchestra.run.smithi016.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T17:37:49.859 INFO:teuthology.orchestra.run.smithi016.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T17:37:49.860 INFO:teuthology.orchestra.run.smithi016.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T17:37:49.867 INFO:teuthology.orchestra.run.smithi016.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T17:37:49.868 INFO:teuthology.orchestra.run.smithi016.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T17:37:49.890 INFO:teuthology.orchestra.run.smithi016.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T17:37:49.890 INFO:teuthology.orchestra.run.smithi016.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T17:37:49.900 INFO:teuthology.orchestra.run.smithi016.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T17:37:49.923 INFO:teuthology.orchestra.run.smithi016.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T17:37:49.926 INFO:teuthology.orchestra.run.smithi016.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T17:37:49.927 INFO:teuthology.orchestra.run.smithi016.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T17:37:49.927 INFO:teuthology.orchestra.run.smithi016.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T17:37:49.928 INFO:teuthology.orchestra.run.smithi016.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T17:37:49.940 INFO:teuthology.orchestra.run.smithi016.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T17:37:49.942 INFO:teuthology.orchestra.run.smithi016.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T17:37:50.111 INFO:teuthology.orchestra.run.smithi016.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T17:37:50.112 INFO:teuthology.orchestra.run.smithi016.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T17:37:50.112 INFO:teuthology.orchestra.run.smithi016.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T17:37:50.112 INFO:teuthology.orchestra.run.smithi016.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T17:37:50.112 INFO:teuthology.orchestra.run.smithi016.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T17:37:50.112 INFO:teuthology.orchestra.run.smithi016.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T17:37:50.125 INFO:teuthology.orchestra.run.smithi016.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T17:37:50.126 INFO:teuthology.orchestra.run.smithi016.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T17:37:50.200 INFO:teuthology.orchestra.run.smithi064.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T17:37:50.364 INFO:teuthology.orchestra.run.smithi064.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T17:37:50.448 INFO:teuthology.orchestra.run.smithi064.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T17:37:50.448 INFO:teuthology.orchestra.run.smithi064.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T17:37:50.522 INFO:teuthology.orchestra.run.smithi016.stdout:Preconfiguring packages ... 2023-11-28T17:37:50.528 INFO:teuthology.orchestra.run.smithi064.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T17:37:50.536 INFO:teuthology.orchestra.run.smithi064.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T17:37:50.673 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 54.6 MB in 1s (55.6 MB/s) 2023-11-28T17:37:50.821 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package flex. 2023-11-28T17:37:50.897 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-11-28T17:37:50.900 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T17:37:50.945 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T17:37:51.005 INFO:teuthology.orchestra.run.smithi064.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T17:37:51.006 INFO:teuthology.orchestra.run.smithi064.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T17:37:51.416 INFO:teuthology.orchestra.run.smithi064.stdout:Preconfiguring packages ... 2023-11-28T17:37:51.465 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T17:37:51.559 INFO:teuthology.orchestra.run.smithi064.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-11-28T17:37:51.609 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T17:37:51.733 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package flex. 2023-11-28T17:37:51.809 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140566 files and directories currently installed.) 2023-11-28T17:37:51.812 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T17:37:51.857 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T17:37:51.993 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T17:37:52.393 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T17:37:52.559 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package bison. 2023-11-28T17:37:52.562 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T17:37:52.634 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-11-28T17:37:52.637 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T17:37:52.687 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T17:37:52.963 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T17:37:53.088 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T17:37:53.102 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T17:37:53.146 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T17:37:53.482 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package dump. 2023-11-28T17:37:53.497 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T17:37:53.504 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package bison. 2023-11-28T17:37:53.540 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T17:37:53.582 INFO:teuthology.orchestra.run.smithi064.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140639 files and directories currently installed.) 2023-11-28T17:37:53.585 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T17:37:53.632 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T17:37:53.819 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package indent. 2023-11-28T17:37:53.835 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:37:53.869 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T17:37:54.057 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T17:37:54.072 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T17:37:54.115 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T17:37:54.130 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T17:37:54.146 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T17:37:54.188 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T17:37:54.402 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package dump. 2023-11-28T17:37:54.417 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T17:37:54.451 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T17:37:54.516 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T17:37:54.533 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T17:37:54.575 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T17:37:54.730 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package indent. 2023-11-28T17:37:54.745 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:37:54.805 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T17:37:54.836 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T17:37:54.853 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T17:37:54.894 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T17:37:55.057 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T17:37:55.073 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T17:37:55.116 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T17:37:55.156 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T17:37:55.172 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T17:37:55.239 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T17:37:55.444 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T17:37:55.462 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T17:37:55.475 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T17:37:55.491 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T17:37:55.494 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T17:37:55.533 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T17:37:55.705 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T17:37:55.721 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T17:37:55.755 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T17:37:55.802 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T17:37:55.819 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T17:37:55.861 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T17:37:56.117 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T17:37:56.132 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T17:37:56.172 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T17:37:56.174 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T17:37:56.188 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T17:37:56.230 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T17:37:56.427 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T17:37:56.443 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T17:37:56.485 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T17:37:56.706 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T17:37:56.722 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T17:37:56.783 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T17:37:57.084 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T17:37:57.100 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T17:37:57.135 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T17:37:57.575 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T17:37:57.591 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T17:37:57.633 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:37:57.894 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T17:37:57.910 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T17:37:57.952 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:37:58.272 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T17:37:58.288 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T17:37:58.330 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:37:58.462 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T17:37:58.478 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T17:37:58.520 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:37:58.657 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T17:37:58.674 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T17:37:58.716 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T17:37:58.781 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T17:37:58.797 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T17:37:58.839 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:37:59.018 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T17:37:59.035 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T17:37:59.093 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T17:37:59.183 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T17:37:59.199 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T17:37:59.241 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:37:59.413 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T17:37:59.429 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:37:59.471 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:37:59.536 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T17:37:59.552 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T17:37:59.586 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T17:37:59.816 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T17:37:59.832 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:37:59.874 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:37:59.897 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T17:37:59.913 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T17:37:59.955 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T17:38:00.168 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T17:38:00.184 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:00.218 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:00.301 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T17:38:00.315 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:00.357 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:00.479 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T17:38:00.495 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T17:38:00.537 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T17:38:00.718 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T17:38:00.735 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:00.777 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:01.032 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T17:38:01.046 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T17:38:01.047 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T17:38:01.062 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:01.090 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T17:38:01.104 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:01.382 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T17:38:01.398 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T17:38:01.410 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package modemmanager. 2023-11-28T17:38:01.426 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T17:38:01.431 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T17:38:01.468 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:38:01.918 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T17:38:01.933 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T17:38:01.976 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T17:38:02.099 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager. 2023-11-28T17:38:02.116 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T17:38:02.166 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T17:38:02.346 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package modemmanager. 2023-11-28T17:38:02.362 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T17:38:02.404 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:38:02.740 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ppp. 2023-11-28T17:38:02.756 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T17:38:03.035 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package network-manager. 2023-11-28T17:38:03.053 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T17:38:03.103 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T17:38:03.118 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T17:38:03.453 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T17:38:03.468 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T17:38:03.511 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T17:38:03.739 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T17:38:03.741 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package ppp. 2023-11-28T17:38:03.754 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T17:38:03.758 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T17:38:03.789 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T17:38:04.092 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T17:38:04.107 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T17:38:04.126 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T17:38:04.150 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T17:38:04.437 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T17:38:04.453 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:04.487 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:04.497 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T17:38:04.510 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T17:38:04.554 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T17:38:04.765 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T17:38:04.779 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T17:38:04.823 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T17:38:05.075 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T17:38:05.092 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T17:38:05.126 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T17:38:05.140 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T17:38:05.153 INFO:teuthology.orchestra.run.smithi016.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T17:38:05.174 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-common (238) ... 2023-11-28T17:38:05.184 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T17:38:05.504 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T17:38:05.522 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:05.571 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:05.650 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T17:38:05.666 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:05.711 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:06.034 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T17:38:06.049 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T17:38:06.110 INFO:teuthology.orchestra.run.smithi064.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T17:38:06.141 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-common (238) ... 2023-11-28T17:38:06.624 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T17:38:06.640 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:38:06.685 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:06.779 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql. 2023-11-28T17:38:06.795 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T17:38:06.837 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql (14+238) ... 2023-11-28T17:38:07.057 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T17:38:07.072 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T17:38:07.106 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T17:38:07.350 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T17:38:07.366 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T17:38:07.408 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T17:38:07.728 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T17:38:07.744 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T17:38:07.786 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T17:38:07.902 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql. 2023-11-28T17:38:07.917 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T17:38:07.960 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql (14+238) ... 2023-11-28T17:38:08.097 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package tcl. 2023-11-28T17:38:08.115 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T17:38:08.161 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T17:38:08.196 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T17:38:08.211 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T17:38:08.246 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T17:38:08.467 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T17:38:08.484 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T17:38:08.498 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T17:38:08.513 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T17:38:08.525 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T17:38:08.556 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T17:38:08.875 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T17:38:08.890 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T17:38:08.942 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T17:38:08.987 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T17:38:09.004 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T17:38:09.046 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T17:38:09.236 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package tcl. 2023-11-28T17:38:09.253 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T17:38:09.299 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T17:38:09.432 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T17:38:09.449 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T17:38:09.500 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T17:38:09.605 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T17:38:09.622 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T17:38:09.655 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T17:38:09.786 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T17:38:09.976 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T17:38:09.992 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T17:38:09.997 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T17:38:10.034 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T17:38:10.396 INFO:teuthology.orchestra.run.smithi064.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T17:38:10.412 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T17:38:10.497 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T17:38:10.499 INFO:teuthology.orchestra.run.smithi064.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T17:38:10.648 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:10.774 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T17:38:10.799 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T17:38:10.885 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T17:38:10.985 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T17:38:10.993 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:11.119 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T17:38:11.245 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:11.371 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T17:38:11.522 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T17:38:11.656 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:12.006 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T17:38:12.106 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T17:38:12.485 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T17:38:12.485 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T17:38:12.682 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T17:38:12.778 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T17:38:13.166 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T17:38:13.166 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T17:38:13.217 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T17:38:21.141 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T17:38:21.142 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T17:38:21.144 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:38:21.144 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T17:38:21.144 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T17:38:21.144 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T17:38:21.144 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T17:38:21.145 INFO:teuthology.orchestra.run.smithi064.stdout:which means they are currently configured by ifupdown: 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:- enp3s0f1 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-common (238) ... 2023-11-28T17:38:21.146 INFO:teuthology.orchestra.run.smithi064.stdout:Adding user postgres to group ssl-cert 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T17:38:21.148 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T17:38:21.149 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:which means they are currently configured by ifupdown: 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:- ens1f0 2023-11-28T17:38:21.150 INFO:teuthology.orchestra.run.smithi016.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-common (238) ... 2023-11-28T17:38:21.151 INFO:teuthology.orchestra.run.smithi016.stdout:Adding user postgres to group ssl-cert 2023-11-28T17:38:21.152 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:21.152 INFO:teuthology.orchestra.run.smithi016.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T17:38:21.152 INFO:teuthology.orchestra.run.smithi016.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T17:38:21.152 INFO:teuthology.orchestra.run.smithi016.stdout:Removing obsolete dictionary files: 2023-11-28T17:38:21.247 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:21.247 INFO:teuthology.orchestra.run.smithi064.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T17:38:21.275 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T17:38:21.511 INFO:teuthology.orchestra.run.smithi064.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T17:38:21.511 INFO:teuthology.orchestra.run.smithi064.stdout:Removing obsolete dictionary files: 2023-11-28T17:38:21.752 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:22.102 INFO:teuthology.orchestra.run.smithi016.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T17:38:22.120 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T17:38:22.178 INFO:teuthology.orchestra.run.smithi016.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:This user must also own the server process. 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:The default text search configuration will be set to "english". 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:Data page checksums are disabled. 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:creating subdirectories ... ok 2023-11-28T17:38:22.179 INFO:teuthology.orchestra.run.smithi016.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T17:38:22.203 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default max_connections ... 100 2023-11-28T17:38:22.240 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default shared_buffers ... 128MB 2023-11-28T17:38:22.248 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T17:38:22.254 INFO:teuthology.orchestra.run.smithi016.stdout:selecting default time zone ... Etc/UTC 2023-11-28T17:38:22.255 INFO:teuthology.orchestra.run.smithi016.stdout:creating configuration files ... ok 2023-11-28T17:38:22.434 INFO:teuthology.orchestra.run.smithi016.stdout:running bootstrap script ... ok 2023-11-28T17:38:22.730 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T17:38:23.067 INFO:teuthology.orchestra.run.smithi016.stdout:performing post-bootstrap initialization ... ok 2023-11-28T17:38:23.110 INFO:teuthology.orchestra.run.smithi064.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T17:38:23.134 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout:This user must also own the server process. 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout:The default text search configuration will be set to "english". 2023-11-28T17:38:23.181 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:23.182 INFO:teuthology.orchestra.run.smithi064.stdout:Data page checksums are disabled. 2023-11-28T17:38:23.182 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:23.182 INFO:teuthology.orchestra.run.smithi064.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T17:38:23.182 INFO:teuthology.orchestra.run.smithi064.stdout:creating subdirectories ... ok 2023-11-28T17:38:23.182 INFO:teuthology.orchestra.run.smithi064.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T17:38:23.207 INFO:teuthology.orchestra.run.smithi064.stdout:selecting default max_connections ... 100 2023-11-28T17:38:23.244 INFO:teuthology.orchestra.run.smithi064.stdout:selecting default shared_buffers ... 128MB 2023-11-28T17:38:23.258 INFO:teuthology.orchestra.run.smithi064.stdout:selecting default time zone ... Etc/UTC 2023-11-28T17:38:23.259 INFO:teuthology.orchestra.run.smithi064.stdout:creating configuration files ... ok 2023-11-28T17:38:23.437 INFO:teuthology.orchestra.run.smithi064.stdout:running bootstrap script ... ok 2023-11-28T17:38:23.581 INFO:teuthology.orchestra.run.smithi016.stdout:syncing data to disk ... ok 2023-11-28T17:38:24.075 INFO:teuthology.orchestra.run.smithi064.stdout:performing post-bootstrap initialization ... ok 2023-11-28T17:38:24.100 INFO:teuthology.orchestra.run.smithi016.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T17:38:24.621 INFO:teuthology.orchestra.run.smithi064.stdout:syncing data to disk ... ok 2023-11-28T17:38:25.140 INFO:teuthology.orchestra.run.smithi064.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T17:38:27.052 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:27.178 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T17:38:27.320 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up postgresql (14+238) ... 2023-11-28T17:38:27.447 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:27.581 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:38:27.850 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T17:38:27.850 INFO:teuthology.orchestra.run.smithi016.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T17:38:28.412 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:28.513 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T17:38:28.616 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T17:38:28.622 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up postgresql (14+238) ... 2023-11-28T17:38:28.748 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T17:38:28.874 INFO:teuthology.orchestra.run.smithi064.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T17:38:28.952 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T17:38:29.104 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T17:38:29.169 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T17:38:29.169 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T17:38:29.943 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T17:38:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T17:38:30.413 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T17:38:30.498 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T17:38:30.598 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T17:38:31.144 INFO:teuthology.orchestra.run.smithi016.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T17:38:31.149 DEBUG:teuthology.parallel:result is None 2023-11-28T17:38:31.849 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T17:38:31.958 INFO:teuthology.orchestra.run.smithi064.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T17:38:32.511 INFO:teuthology.orchestra.run.smithi064.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T17:38:32.516 DEBUG:teuthology.parallel:result is None 2023-11-28T17:38:32.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T17:38:32.654 DEBUG:teuthology.orchestra.run.smithi016:> dpkg-query -W -f '${Version}' ceph 2023-11-28T17:38:32.679 INFO:teuthology.orchestra.run.smithi016.stdout:18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:38:32.679 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:38:32.679 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-11-28T17:38:32.680 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=47c1c547372ed5bff7984647dc200bac0e019caf 2023-11-28T17:38:32.891 DEBUG:teuthology.orchestra.run.smithi064:> dpkg-query -W -f '${Version}' ceph 2023-11-28T17:38:32.914 INFO:teuthology.orchestra.run.smithi064.stdout:18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:38:32.915 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7531-g47c1c547-1jammy 2023-11-28T17:38:32.915 INFO:teuthology.task.install:The correct ceph version 18.0.0-7531-g47c1c547-1jammy is installed. 2023-11-28T17:38:32.915 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T17:38:32.915 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:32.915 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T17:38:32.939 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:32.939 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T17:38:32.976 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T17:38:32.977 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:32.977 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T17:38:33.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T17:38:33.070 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:33.070 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T17:38:33.091 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T17:38:33.160 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T17:38:33.160 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:33.160 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T17:38:33.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T17:38:33.255 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:33.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T17:38:33.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T17:38:33.339 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T17:38:33.340 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:33.340 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T17:38:33.362 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T17:38:33.426 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:33.426 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T17:38:33.446 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T17:38:33.508 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T17:38:33.588 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T17:38:33.588 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 777 /var/log/ceph 2023-11-28T17:38:33.592 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /var/log/ceph 2023-11-28T17:38:33.612 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T17:38:33.612 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T17:38:33.654 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T17:38:33.675 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T17:38:33.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T17:38:33.718 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T17:38:33.746 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T17:38:33.746 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T17:38:33.747 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T17:38:33.747 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:33.747 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T17:38:33.788 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T17:38:33.885 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:33.885 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T17:38:33.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T17:38:33.993 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T17:38:33.993 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T17:38:33.994 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397', 'branch': 'wip-vshankar-testing-20231127.102654', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469397', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102654'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102654', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1098, 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'sleep_before_teardown': 0, 'subset': '854/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102654', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi016.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEONz5/0REs4kaPFzuqc3CUzT2Iui4Fc5bEN24go+O6oR4tcmVqOOp6Ezg1reI0HtVSWrgDd9K4GuUbgNapwaI=', 'smithi064.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlPwKfI8SIgiQx/P75SqVsuwDtjp9touOtALSJxcXOwZ/cTe0oNGrXEX6TjeM9LEvSwmX9eGi0fJbwXaDoB48c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '47c1c547372ed5bff7984647dc200bac0e019caf', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:23:42', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T17:38:33.995 DEBUG:teuthology.orchestra.run.smithi016:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T17:38:33.999 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T17:38:34.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T17:38:34.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T17:38:34.109 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:34.109 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T17:38:34.121 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T17:38:34.121 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_1 2023-11-28T17:38:34.173 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T17:38:34.173 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:34.173 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-11-28T17:38:34.173 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:34.174 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-11-28 17:32:06.618255145 +0000 2023-11-28T17:38:34.174 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-11-28 17:32:06.222258681 +0000 2023-11-28T17:38:34.174 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-11-28 17:32:06.222258681 +0000 2023-11-28T17:38:34.174 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-11-28 17:32:06.222258681 +0000 2023-11-28T17:38:34.174 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T17:38:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-11-28T17:38:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-11-28T17:38:34.236 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000290275 s, 1.8 MB/s 2023-11-28T17:38:34.237 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T17:38:34.295 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_2 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-11-28 17:32:07.266249357 +0000 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-11-28 17:32:06.882252786 +0000 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-11-28 17:32:06.882252786 +0000 2023-11-28T17:38:34.349 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-11-28 17:32:06.882252786 +0000 2023-11-28T17:38:34.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T17:38:34.411 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-11-28T17:38:34.411 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-11-28T17:38:34.412 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000270047 s, 1.9 MB/s 2023-11-28T17:38:34.413 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T17:38:34.466 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_3 2023-11-28T17:38:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T17:38:34.517 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:34.518 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-11-28T17:38:34.518 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:34.518 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-11-28 17:32:07.534246964 +0000 2023-11-28T17:38:34.518 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-11-28 17:32:07.530246998 +0000 2023-11-28T17:38:34.518 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-11-28 17:32:07.530246998 +0000 2023-11-28T17:38:34.519 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-11-28 17:32:07.530246998 +0000 2023-11-28T17:38:34.519 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T17:38:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-11-28T17:38:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-11-28T17:38:34.580 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000296813 s, 1.7 MB/s 2023-11-28T17:38:34.581 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T17:38:34.635 DEBUG:teuthology.orchestra.run.smithi016:> stat /dev/vg_nvme/lv_4 2023-11-28T17:38:34.689 INFO:teuthology.orchestra.run.smithi016.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T17:38:34.689 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:34.689 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 5h/5d Inode: 955 Links: 1 2023-11-28T17:38:34.689 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:34.689 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-11-28 17:32:08.582237601 +0000 2023-11-28T17:38:34.690 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-11-28 17:32:08.166241317 +0000 2023-11-28T17:38:34.690 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-11-28 17:32:08.166241317 +0000 2023-11-28T17:38:34.690 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-11-28 17:32:08.166241317 +0000 2023-11-28T17:38:34.690 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T17:38:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records in 2023-11-28T17:38:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:1+0 records out 2023-11-28T17:38:34.752 INFO:teuthology.orchestra.run.smithi016.stderr:512 bytes copied, 0.000256133 s, 2.0 MB/s 2023-11-28T17:38:34.754 DEBUG:teuthology.orchestra.run.smithi016:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T17:38:34.807 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:34.807 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:34.807 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T17:38:34.816 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T17:38:34.817 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-11-28 17:32:04.139587989 +0000 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-11-28 17:32:04.135588025 +0000 2023-11-28T17:38:34.869 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-11-28 17:32:04.135588025 +0000 2023-11-28T17:38:34.870 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-11-28 17:32:04.135588025 +0000 2023-11-28T17:38:34.870 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T17:38:34.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-11-28T17:38:34.932 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-11-28T17:38:34.932 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000391738 s, 1.3 MB/s 2023-11-28T17:38:34.934 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T17:38:34.986 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 917 Links: 1 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-11-28 17:32:05.235578200 +0000 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-11-28 17:32:04.831581807 +0000 2023-11-28T17:38:35.037 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-11-28 17:32:04.831581807 +0000 2023-11-28T17:38:35.038 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-11-28 17:32:04.831581807 +0000 2023-11-28T17:38:35.038 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T17:38:35.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-11-28T17:38:35.104 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-11-28T17:38:35.104 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000375881 s, 1.4 MB/s 2023-11-28T17:38:35.106 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T17:38:35.163 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 932 Links: 1 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-11-28 17:32:05.967571661 +0000 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-11-28 17:32:05.539575484 +0000 2023-11-28T17:38:35.213 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-11-28 17:32:05.539575484 +0000 2023-11-28T17:38:35.214 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-11-28 17:32:05.539575484 +0000 2023-11-28T17:38:35.214 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T17:38:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-11-28T17:38:35.276 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-11-28T17:38:35.277 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000376355 s, 1.4 MB/s 2023-11-28T17:38:35.278 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T17:38:35.335 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2023-11-28T17:38:35.389 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T17:38:35.389 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T17:38:35.389 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-11-28T17:38:35.389 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T17:38:35.390 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-11-28 17:32:06.703565087 +0000 2023-11-28T17:38:35.390 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-11-28 17:32:06.271568946 +0000 2023-11-28T17:38:35.390 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-11-28 17:32:06.271568946 +0000 2023-11-28T17:38:35.390 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-11-28 17:32:06.271568946 +0000 2023-11-28T17:38:35.390 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T17:38:35.452 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-11-28T17:38:35.453 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-11-28T17:38:35.453 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000367966 s, 1.4 MB/s 2023-11-28T17:38:35.454 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T17:38:35.507 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:35.507 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T17:38:35.507 INFO:tasks.ceph:Generating config... 2023-11-28T17:38:35.508 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T17:38:35.508 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T17:38:35.509 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T17:38:35.509 INFO:tasks.ceph:[client] pid file = 2023-11-28T17:38:35.509 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T17:38:35.509 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T17:38:35.509 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T17:38:35.509 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T17:38:35.509 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T17:38:35.509 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T17:38:35.509 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T17:38:35.509 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T17:38:35.510 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T17:38:35.511 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T17:38:35.512 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T17:38:35.512 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T17:38:35.512 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T17:38:35.512 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T17:38:35.512 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T17:38:35.512 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T17:38:35.513 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T17:38:35.513 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T17:38:35.562 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T17:38:35.587 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T17:38:35.638 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T17:38:35.704 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.16'), ('mon.b', '172.21.15.64'), ('mon.c', '[v2:172.21.15.64:3301,v1:172.21.15.64:6790]')] 2023-11-28T17:38:35.705 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.16,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T17:38:35.705 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:35.706 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T17:38:35.756 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.16 --add b 172.21.15.64 --addv c '[v2:172.21.15.64:3301,v1:172.21.15.64:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:35.852 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:35.852 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: generated fsid 412d3c1b-e5e1-47ba-972b-0544ebc8f3e9 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:setting min_mon_release = pacific 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:epoch 0 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:fsid 412d3c1b-e5e1-47ba-972b-0544ebc8f3e9 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:last_changed 2023-11-28T17:38:35.854042+0000 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:created 2023-11-28T17:38:35.854042+0000 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:min_mon_release 16 (pacific) 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:election_strategy: 1 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:0: [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] mon.a 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:1: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.b 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:2: [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] mon.c 2023-11-28T17:38:35.853 INFO:teuthology.orchestra.run.smithi016.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T17:38:35.855 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T17:38:35.863 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 412d3c1b-e5e1-47ba-972b-0544ebc8f3e9... 2023-11-28T17:38:35.864 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T17:38:35.915 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout:[global] 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: chdir = "" 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: auth supported = cephx 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: filestore xattr use omap = true 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: mon clock drift allowed = 1.000 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.958 INFO:teuthology.orchestra.run.smithi016.stdout: osd crush chooseleaf type = 0 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: auth debug = true 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on old message = true 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on bug = true 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: mon pg warn max object skew = 0 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T17:38:35.959 INFO:teuthology.orchestra.run.smithi016.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default size = 2 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow primary affinity = true 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd allow pg remap = true 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on legacy crush tunables = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on crush straw calc version zero = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on no sortbitwise = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on osd down out interval zero = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon warn on too few osds = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T17:38:35.960 INFO:teuthology.orchestra.run.smithi016.stdout: mon_allow_pool_size_one = true 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: osd default data pool replay window = 5 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon allow pool delete = true 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon cluster log file level = debug 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: debug asserts on shutdown = true 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon health detail to clog = false 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: mon host = "172.21.15.16,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]" 2023-11-28T17:38:35.961 INFO:teuthology.orchestra.run.smithi016.stdout: ms die on skipped message = False 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: fsid = 412d3c1b-e5e1-47ba-972b-0544ebc8f3e9 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout:[osd] 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd journal size = 100 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub load threshold = 5.0 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd scrub max interval = 600 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd mclock profile = high_recovery_ops 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd recover clone overlap = true 2023-11-28T17:38:35.962 INFO:teuthology.orchestra.run.smithi016.stdout: osd recovery max chunk = 1048576 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug shutdown = true 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug op order = true 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug verify stray on activate = true 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug trim objects = true 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd open classes on start = true 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug pg log writeout = true 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd deep scrub update digest min age = 30 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: osd map max advance = 10 2023-11-28T17:38:35.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: journal zero on create = true 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: filestore ondisk finisher threads = 3 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: filestore apply finisher threads = 3 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: bdev debug aio = true 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: osd debug misdirected ops = true 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: bdev async discard = True 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: bdev enable discard = True 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore allocator = bitmap 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore block size = 96636764160 2023-11-28T17:38:35.964 INFO:teuthology.orchestra.run.smithi016.stdout: bluestore fsck on mount = True 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluefs = 1/20 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug bluestore = 1/20 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug osd = 20 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: debug rocksdb = 4/10 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd full ratio = 0.9 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd nearfull ratio = 0.8 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: osd failsafe full ratio = 0.95 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: osd objectstore = bluestore 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2023-11-28T17:38:35.965 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr] 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug mgr = 20 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: mgr/telemetry/nag = false 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout:[mon] 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-11-28T17:38:35.966 INFO:teuthology.orchestra.run.smithi016.stdout: debug mon = 20 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug paxos = 20 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: debug auth = 20 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon data avail warn = 5 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon mgr mkfs grace = 240 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min pgs per osd = 4 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd reporter subtree level = osd 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon osd prime pg temp = true 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: mon reweight min bytes per osd = 10 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T17:38:35.967 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: # 1m isn't quite enough 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon_down_mkfs_grace = 2m 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon_warn_on_filestore_osds = false 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: mon op complaint time = 120 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout:[client] 2023-11-28T17:38:35.968 INFO:teuthology.orchestra.run.smithi016.stdout: rgw cache enabled = true 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable ops log = true 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: rgw enable usage log = true 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: client mount timeout = 600 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: debug client = 20 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: pid file = "" 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.a] 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.b] 2023-11-28T17:38:35.969 INFO:teuthology.orchestra.run.smithi016.stdout:[mon.c] 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout:[mds] 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds = 20 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: debug mds balancer = 20 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: debug ms = 1 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug frag = True 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: mds debug scatterstat = True 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: mds op complaint time = 180 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: mds verify scatter = True 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: osd op complaint time = 180 2023-11-28T17:38:35.970 INFO:teuthology.orchestra.run.smithi016.stdout: rados mon op timeout = 900 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi016.stdout: rados osd op timeout = 900 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.971 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T17:38:35.972 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T17:38:35.973 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2023-11-28T17:38:35.974 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.16,172.21.15.64,[v2:172.21.15.64:3301,v1:172.21.15.64:6790]" 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on skipped message = False 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = 412d3c1b-e5e1-47ba-972b-0544ebc8f3e9 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2023-11-28T17:38:35.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug trim objects = true 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2023-11-28T17:38:35.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: bdev async discard = True 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: bdev enable discard = True 2023-11-28T17:38:35.977 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore allocator = bitmap 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 1/20 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 1/20 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 4/10 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2023-11-28T17:38:35.978 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2023-11-28T17:38:35.979 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T17:38:35.980 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2023-11-28T17:38:35.981 INFO:teuthology.orchestra.run.smithi064.stdout: mon op complaint time = 120 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: client mount timeout = 600 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: debug client = 20 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2023-11-28T17:38:35.982 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds = 20 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds balancer = 20 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-11-28T17:38:35.983 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug frag = True 2023-11-28T17:38:35.984 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = True 2023-11-28T17:38:35.984 INFO:teuthology.orchestra.run.smithi064.stdout: mds op complaint time = 180 2023-11-28T17:38:35.984 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = True 2023-11-28T17:38:35.984 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2023-11-28T17:38:35.984 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2023-11-28T17:38:35.984 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2023-11-28T17:38:35.985 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T17:38:35.986 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T17:38:36.086 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T17:38:36.087 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:36.087 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T17:38:36.096 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:36.096 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T17:38:36.148 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:38:36.148 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:36.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T17:38:36.148 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T17:38:36.225 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:38:36.225 DEBUG:teuthology.orchestra.run.smithi016:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:36.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:38:36.276 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:36.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T17:38:36.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T17:38:36.313 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:38:36.313 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:36.364 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T17:38:36.364 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T17:38:36.365 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T17:38:36.422 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T17:38:36.427 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T17:38:36.489 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T17:38:36.574 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T17:38:36.574 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T17:38:36.633 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T17:38:36.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T17:38:36.659 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T17:38:36.757 INFO:teuthology.orchestra.run.smithi016.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T17:38:36.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T17:38:36.782 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T17:38:36.845 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T17:38:36.850 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T17:38:36.872 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T17:38:36.977 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-28T17:38:36.982 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-28T17:38:37.003 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T17:38:37.003 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T17:38:37.048 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T17:38:37.066 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-28T17:38:37.151 INFO:teuthology.orchestra.run.smithi016.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-28T17:38:37.168 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-28T17:38:37.214 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-28T17:38:37.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-28T17:38:37.324 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-28T17:38:37.341 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T17:38:37.342 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi016.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T17:38:37.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T17:38:37.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:37.363 INFO:tasks.ceph:role: osd.0 2023-11-28T17:38:37.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:38:37.364 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T17:38:37.431 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:37.432 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:37.461 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-11-28T17:38:37.465 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-11-28T17:38:37.465 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T17:38:37.537 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T17:38:37.596 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:37.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:37.597 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T17:38:37.663 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:37.664 INFO:tasks.ceph:role: osd.1 2023-11-28T17:38:37.664 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:38:37.664 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T17:38:37.731 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:37.731 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:37.731 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:37.732 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:37.761 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-11-28T17:38:37.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-11-28T17:38:37.764 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T17:38:37.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T17:38:37.900 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:37.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:37.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T17:38:37.963 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:37.964 INFO:tasks.ceph:role: osd.2 2023-11-28T17:38:37.964 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:38:37.964 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T17:38:38.027 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:38.027 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:38.028 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:38.056 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-11-28T17:38:38.059 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-11-28T17:38:38.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T17:38:38.133 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T17:38:38.192 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:38.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:38.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T17:38:38.255 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:38.255 INFO:tasks.ceph:role: osd.3 2023-11-28T17:38:38.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:38:38.256 DEBUG:teuthology.orchestra.run.smithi016:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T17:38:38.320 INFO:teuthology.orchestra.run.smithi016.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:38.383 INFO:teuthology.orchestra.run.smithi016.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:38.384 INFO:teuthology.orchestra.run.smithi016.stdout:Discarding blocks...Done. 2023-11-28T17:38:38.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi016.front.sepia.ceph.com -o noatime 2023-11-28T17:38:38.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T17:38:38.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T17:38:38.527 INFO:teuthology.orchestra.run.smithi016.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:38.527 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:38.528 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:38.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:38.661+0000 7f27edaec640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T17:38:38.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:38.661+0000 7f27edaec640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T17:38:38.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:38.661+0000 7f27edaec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T17:38:38.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:38.661+0000 7f27edaec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T17:38:38.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:38.661+0000 7f27edaec640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T17:38:38.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:38.661+0000 7f27edaec640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T17:38:41.648 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T17:38:41.671 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:41.769+0000 7f77c7c8e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T17:38:41.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:41.769+0000 7f77c7c8e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T17:38:41.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:41.769+0000 7f77c7c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T17:38:41.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:41.769+0000 7f77c7c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T17:38:41.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:41.769+0000 7f77c7c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T17:38:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:41.773+0000 7f77c7c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T17:38:44.761 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T17:38:44.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:44.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:44.885+0000 7f62c884a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T17:38:44.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:44.885+0000 7f62c884a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T17:38:44.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:44.885+0000 7f62c884a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T17:38:44.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:44.885+0000 7f62c884a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T17:38:44.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:44.885+0000 7f62c884a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T17:38:44.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:44.885+0000 7f62c884a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T17:38:47.875 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T17:38:47.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:48.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:48.001+0000 7f7ac228e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T17:38:48.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:48.001+0000 7f7ac228e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T17:38:48.003 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:48.001+0000 7f7ac228e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T17:38:48.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:48.001+0000 7f7ac228e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T17:38:48.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:48.001+0000 7f7ac228e640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T17:38:48.004 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:38:48.005+0000 7f7ac228e640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T17:38:50.990 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T17:38:51.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T17:38:51.035 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:51.036 INFO:tasks.ceph:role: osd.4 2023-11-28T17:38:51.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:38:51.036 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T17:38:51.114 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:51.114 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:51.115 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:51.115 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:51.115 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:51.115 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:51.115 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:51.116 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:51.116 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:51.116 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:51.576 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-11-28T17:38:51.579 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-11-28T17:38:51.579 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T17:38:51.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T17:38:51.719 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:51.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:51.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T17:38:51.785 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:51.786 INFO:tasks.ceph:role: osd.5 2023-11-28T17:38:51.786 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:38:51.786 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T17:38:51.857 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:51.857 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:51.857 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:51.858 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:52.353 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-11-28T17:38:52.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-11-28T17:38:52.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T17:38:52.510 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T17:38:52.529 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:52.530 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:52.530 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T17:38:52.598 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:52.598 INFO:tasks.ceph:role: osd.6 2023-11-28T17:38:52.598 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:38:52.599 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T17:38:52.673 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:52.673 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:52.673 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:52.674 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:53.157 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-11-28T17:38:53.160 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-11-28T17:38:53.160 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T17:38:53.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T17:38:53.284 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:53.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:53.285 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T17:38:53.349 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T17:38:53.349 INFO:tasks.ceph:role: osd.7 2023-11-28T17:38:53.349 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:38:53.349 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T17:38:53.420 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T17:38:53.421 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T17:38:53.867 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-11-28T17:38:53.870 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-11-28T17:38:53.870 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T17:38:53.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T17:38:54.000 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T17:38:54.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:38:54.002 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:54.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:54.122+0000 7fe31bf5f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T17:38:54.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:54.126+0000 7fe31bf5f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T17:38:54.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:54.126+0000 7fe31bf5f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T17:38:54.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:54.126+0000 7fe31bf5f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T17:38:54.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:54.126+0000 7fe31bf5f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T17:38:54.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:54.134+0000 7fe31bf5f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T17:38:57.128 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T17:38:57.151 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:38:57.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:57.242+0000 7fcc84a2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T17:38:57.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:57.242+0000 7fcc84a2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T17:38:57.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:57.242+0000 7fcc84a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T17:38:57.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:57.242+0000 7fcc84a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T17:38:57.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:57.242+0000 7fcc84a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T17:38:57.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:38:57.246+0000 7fcc84a2b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T17:39:00.228 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T17:39:00.249 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:39:00.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:00.346+0000 7f2ee0bc0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T17:39:00.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:00.346+0000 7f2ee0bc0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T17:39:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:00.346+0000 7f2ee0bc0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T17:39:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:00.346+0000 7f2ee0bc0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T17:39:00.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:00.346+0000 7f2ee0bc0640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T17:39:00.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:00.346+0000 7f2ee0bc0640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T17:39:03.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T17:39:03.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:39:03.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:03.478+0000 7fee0843d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T17:39:03.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:03.478+0000 7fee0843d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T17:39:03.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:03.478+0000 7fee0843d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T17:39:03.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:03.478+0000 7fee0843d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T17:39:03.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:03.478+0000 7fee0843d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T17:39:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:03.482+0000 7fee0843d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T17:39:03.996 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:39:04.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:39:06.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T17:39:06.488 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T17:39:06.488 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.488 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T17:39:06.511 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T17:39:06.581 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.581 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T17:39:06.649 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T17:39:06.713 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.713 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T17:39:06.777 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T17:39:06.841 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:06.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T17:39:06.905 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:06.905 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T17:39:06.929 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:06.929 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T17:39:06.997 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:06.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-28T17:39:07.061 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:07.062 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T17:39:07.124 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:07.125 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T17:39:07.189 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:07.189 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T17:39:07.253 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:07.253 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T17:39:07.320 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:07.321 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T17:39:07.330 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:07.330 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-28T17:39:07.384 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:07.385 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-28T17:39:07.394 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:07.394 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-28T17:39:07.449 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T17:39:07.449 DEBUG:teuthology.orchestra.run.smithi016:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T17:39:07.453 DEBUG:teuthology.orchestra.run.smithi064:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T17:39:07.495 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.y] 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZlbW5JGRAAXbRZD0jOQd/Hbiobm3VU2g== 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.a] 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZlP73dJRAAAa1aYMhumrD3cP7e3ks4TQ== 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.c] 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZlQj86LRAAzEnq6oQ0tCGjuaj7P8UmzA== 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.0] 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCeJWZluRp6JxAAmngG2pcuvJ8gAf6IQ6TryQ== 2023-11-28T17:39:07.496 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.1] 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQChJWZlxSETLhAArV76ilhRqnGZECWrlfohGQ== 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.2] 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCkJWZlbELPNBAAbQ5oL6nlhP6EDgy4rL0/kQ== 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.3] 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCoJWZl1C1HABAA4h+OOFdUslTuQSsGR4v7WQ== 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:[mgr.x] 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZl2X09HRAA9dgiAzDEMgxeUuTerF1pww== 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.b] 2023-11-28T17:39:07.497 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZlZ2NyMhAAHVvtXZmIxccpUgsXohapGQ== 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:[mds.d] 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZlA4VbOhAAIG4Qk+u9biQLkWHMNfopuw== 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.4] 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCuJWZlHEmsBxAA0U4qJLjWgA+ZtskGzU/oPw== 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.5] 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCxJWZl2XPEDhAAozvw7FCAHthluVmiCoZsYw== 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.6] 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC0JWZlz0nUFBAAM1p74cHGh2XYbJYWbLYYIw== 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:[osd.7] 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQC3JWZlwIzHHBAAQiosgm9XIUg2mvwl1hVGmQ== 2023-11-28T17:39:07.498 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCdJWZlpXX7AhAAyFkBG56tVWNiwFf2q9XkoA== 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout:[client.2] 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCdJWZlpNkZCRAAhOKKhy4fl92pbOweVqDy1A== 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout:[client.1] 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCdJWZlixvcDBAAMhQyCeaFcwJzJYgYdap7ow== 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout:[client.3] 2023-11-28T17:39:07.499 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCdJWZl0vpsExAASf13ZxjGr/k6mj0DjVAjSA== 2023-11-28T17:39:07.512 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.y] 2023-11-28T17:39:07.512 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCcJWZlbW5JGRAAXbRZD0jOQd/Hbiobm3VU2g== 2023-11-28T17:39:07.512 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2023-11-28T17:39:07.512 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCcJWZlP73dJRAAAa1aYMhumrD3cP7e3ks4TQ== 2023-11-28T17:39:07.512 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCcJWZlQj86LRAAzEnq6oQ0tCGjuaj7P8UmzA== 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.0] 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCeJWZluRp6JxAAmngG2pcuvJ8gAf6IQ6TryQ== 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.1] 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQChJWZlxSETLhAArV76ilhRqnGZECWrlfohGQ== 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.2] 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCkJWZlbELPNBAAbQ5oL6nlhP6EDgy4rL0/kQ== 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.3] 2023-11-28T17:39:07.513 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCoJWZl1C1HABAA4h+OOFdUslTuQSsGR4v7WQ== 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.x] 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCcJWZl2X09HRAA9dgiAzDEMgxeUuTerF1pww== 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCcJWZlZ2NyMhAAHVvtXZmIxccpUgsXohapGQ== 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCcJWZlA4VbOhAAIG4Qk+u9biQLkWHMNfopuw== 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.4] 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCuJWZlHEmsBxAA0U4qJLjWgA+ZtskGzU/oPw== 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.5] 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCxJWZl2XPEDhAAozvw7FCAHthluVmiCoZsYw== 2023-11-28T17:39:07.514 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.6] 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQC0JWZlz0nUFBAAM1p74cHGh2XYbJYWbLYYIw== 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.7] 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQC3JWZlwIzHHBAAQiosgm9XIUg2mvwl1hVGmQ== 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCdJWZlpXX7AhAAyFkBG56tVWNiwFf2q9XkoA== 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout:[client.2] 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCdJWZlpNkZCRAAhOKKhy4fl92pbOweVqDy1A== 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout:[client.1] 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCdJWZlixvcDBAAMhQyCeaFcwJzJYgYdap7ow== 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout:[client.3] 2023-11-28T17:39:07.515 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQCdJWZl0vpsExAASf13ZxjGr/k6mj0DjVAjSA== 2023-11-28T17:39:07.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T17:39:07.550 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T17:39:07.619 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:07.624 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:07.685 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:07.689 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:07.749 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.752 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.812 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.867 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.871 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.926 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.930 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:07.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T17:39:07.989 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T17:39:08.043 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:08.047 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:08.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:08.109 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T17:39:08.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.289 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.345 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.350 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T17:39:08.407 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.469 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.473 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.535 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.594 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.598 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T17:39:08.657 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T17:39:08.658 DEBUG:teuthology.orchestra.run.smithi016:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T17:39:08.680 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T17:39:08.800 DEBUG:teuthology.orchestra.run.smithi016:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T17:39:08.821 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T17:39:08.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T17:39:08.961 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T17:39:08.982 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T17:39:09.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T17:39:09.167 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T17:39:09.188 DEBUG:teuthology.orchestra.run.smithi016:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:39:09.192 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T17:39:09.239 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T17:39:09.239 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T17:39:09.239 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T17:39:09.246 INFO:tasks.ceph.mon.a:Started 2023-11-28T17:39:09.246 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T17:39:09.246 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T17:39:09.282 INFO:tasks.ceph.mon.b:Started 2023-11-28T17:39:09.282 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T17:39:09.282 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T17:39:09.285 INFO:tasks.ceph.mon.c:Started 2023-11-28T17:39:09.286 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T17:39:09.286 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T17:39:09.286 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T17:39:09.289 INFO:tasks.ceph.mgr.y:Started 2023-11-28T17:39:09.290 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T17:39:09.290 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T17:39:09.293 INFO:tasks.ceph.mgr.x:Started 2023-11-28T17:39:09.293 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T17:39:09.293 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T17:39:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 Processor -- start 2023-11-28T17:39:09.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 -- start start 2023-11-28T17:39:09.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f72300b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 0x7f72300b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723015d870 con 0x7f72300cfca0 2023-11-28T17:39:09.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72300b6d20 con 0x7f72300b67d0 2023-11-28T17:39:09.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.437+0000 7f72362fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72300b7000 con 0x7f72300b8b80 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f723489b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 0x7f72300b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722ffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f72300cfca0 0x7f72300d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:47578/0 (socket says 172.21.15.16:47578) 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722ffff640 1 -- 172.21.15.16:0/713082584 learned_addr learned my addr 172.21.15.16:0/713082584 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722f7fe640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f72300b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f723489b640 1 -- 172.21.15.16:0/713082584 >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 msgr2=0x7f72300b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f723489b640 1 -- 172.21.15.16:0/713082584 >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 msgr2=0x7f72300b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f723489b640 1 --2- 172.21.15.16:0/713082584 >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 0x7f72300b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722f7fe640 1 -- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 msgr2=0x7f72300b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722f7fe640 1 -- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 msgr2=0x7f72300b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f723489b640 1 --2- 172.21.15.16:0/713082584 >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 0x7f72300b7dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722f7fe640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f72300b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T17:39:09.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.441+0000 7f722f7fe640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f72300b6290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T17:39:09.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.613+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931913087 0 0) 0x7f723015d870 con 0x7f72300cfca0 2023-11-28T17:39:09.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.613+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7218003530 con 0x7f72300cfca0 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1398550236 0 0) 0x7f7218003530 con 0x7f72300cfca0 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 msgr2=0x7f72300b6290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f72300b6290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 msgr2=0x7f72300b7dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 --2- 172.21.15.16:0/713082584 >> v2:172.21.15.16:3300/0 conn(0x7f72300b67d0 0x7f72300b7dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72300b72e0 con 0x7f72300cfca0 2023-11-28T17:39:09.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 <== mon.1 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f7220001680 con 0x7f72300cfca0 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 >> v1:172.21.15.64:6789/0 conn(0x7f72300cfca0 legacy=0x7f72300d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f7218003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72180047d0 0x7f7218004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f7218005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300b6d20 con 0x7f7218003980 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300b7000 con 0x7f72180047d0 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.617+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721800bb20 con 0x7f72300b8b80 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f7218003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722f7fe640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72180047d0 0x7f7218004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 -- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 msgr2=0x7f7218005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:09.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72300b8b80 0x7f7218005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 -- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72180047d0 msgr2=0x7f7218004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:09.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72180047d0 0x7f7218004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 -- 172.21.15.16:0/713082584 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7218003530 con 0x7f7218003980 2023-11-28T17:39:09.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.621+0000 7f722ffff640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f7218003da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7220001060 tx=0x7f722001f290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da01aa25de92a1a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:09.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200a8cb0 con 0x7f7218003980 2023-11-28T17:39:09.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72200a8e10 con 0x7f7218003980 2023-11-28T17:39:09.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f722effd640 1 -- 172.21.15.16:0/713082584 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220005b20 con 0x7f7218003980 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 -- 172.21.15.16:0/713082584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 msgr2=0x7f7218003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 --2- 172.21.15.16:0/713082584 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f7218003da0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7220001060 tx=0x7f722001f290 comp rx=0 tx=0).stop 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f723489b640 1 -- 172.21.15.16:0/713082584 reap_dead start 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 -- 172.21.15.16:0/713082584 shutdown_connections 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 -- 172.21.15.16:0/713082584 >> 172.21.15.16:0/713082584 conn(0x7f72300720d0 msgr2=0x7f72300724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 -- 172.21.15.16:0/713082584 shutdown_connections 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 -- 172.21.15.16:0/713082584 wait complete. 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 Processor -- start 2023-11-28T17:39:09.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 -- start start 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f72301513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.625+0000 7f72362fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 0x7f72300d0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72300d05c0 0x7f72300cc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7230156100 con 0x7f7218003980 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72300d0a40 con 0x7f72300d05c0 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7230155510 con 0x7f7230156520 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722f7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 0x7f72300d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f72301513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722f7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 0x7f72300d0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:56066/0 (socket says 172.21.15.16:56066) 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722f7fe640 1 -- 172.21.15.16:0/1888457452 learned_addr learned my addr 172.21.15.16:0/1888457452 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f723489b640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72300d05c0 0x7f72300cc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 -- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 msgr2=0x7f72300d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 0x7f72300d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 -- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72300d05c0 msgr2=0x7f72300cc5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:09.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72300d05c0 0x7f72300cc5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 -- 172.21.15.16:0/1888457452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230155760 con 0x7f7218003980 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722f7fe640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 0x7f72300d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722ffff640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f72301513f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7218004720 tx=0x7f7218005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220005940 con 0x7f7218003980 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72200b6070 con 0x7f7218003980 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7230155a40 con 0x7f7218003980 2023-11-28T17:39:09.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220005cc0 con 0x7f7218003980 2023-11-28T17:39:09.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72301569a0 con 0x7f7218003980 2023-11-28T17:39:09.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72200070d0 con 0x7f7218003980 2023-11-28T17:39:09.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f72200b8070 con 0x7f7218003980 2023-11-28T17:39:09.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.629+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7230156b90 con 0x7f7218003980 2023-11-28T17:39:09.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.633+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f72200c2020 con 0x7f7218003980 2023-11-28T17:39:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7230156370 con 0x7f7218003980 2023-11-28T17:39:09.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f722cff9640 1 -- 172.21.15.16:0/1888457452 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7220007c70 con 0x7f7218003980 2023-11-28T17:39:09.698 INFO:teuthology.orchestra.run.smithi016.stderr:adjusted tunables profile to default 2023-11-28T17:39:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 msgr2=0x7f72301513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f72301513f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7218004720 tx=0x7f7218005800 comp rx=0 tx=0).stop 2023-11-28T17:39:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 shutdown_connections 2023-11-28T17:39:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72300d05c0 0x7f72300cc5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7230156520 0x7f72300d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 --2- 172.21.15.16:0/1888457452 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7218003980 0x7f72301513f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:09.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 >> 172.21.15.16:0/1888457452 conn(0x7f72300720d0 msgr2=0x7f723015d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:09.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 shutdown_connections 2023-11-28T17:39:09.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:09.697+0000 7f72362fe640 1 -- 172.21.15.16:0/1888457452 wait complete. 2023-11-28T17:39:09.719 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T17:39:09.719 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T17:39:09.719 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:09.719 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T17:39:09.741 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:09.741 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T17:39:09.805 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:09.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T17:39:09.820 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:09.818+0000 7f4d1ae26180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T17:39:09.829 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:09.829+0000 7fe9b2c2d180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T17:39:09.851 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:09.851 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T17:39:09.913 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:09.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T17:39:09.935 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:09.935 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T17:39:09.996 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:09.996 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T17:39:10.059 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:10.060 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T17:39:10.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 8f568087-e081-4769-848d-db1d71d2e010 0 2023-11-28T17:39:10.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.302+0000 7fdbac832640 1 Processor -- start 2023-11-28T17:39:10.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdbac832640 1 -- start start 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdbac832640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdba815d540 0x7fdba80b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdbac832640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdba80d3690 0x7fdba80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdbac832640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba80b32c0 con 0x7fdba80d1f50 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdbac832640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba815d920 con 0x7fdba815d540 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdbac832640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba80b35a0 con 0x7fdba80d3690 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdba80d3690 0x7fdba80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdba80d3690 0x7fdba80cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58766/0 (socket says 172.21.15.64:58766) 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 -- 172.21.15.64:0/1606350183 learned_addr learned my addr 172.21.15.64:0/1606350183 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:10.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba5d9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdba80d1f50 0x7fdba80d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34504/0 (socket says 172.21.15.64:34504) 2023-11-28T17:39:10.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba659c640 1 --2- 172.21.15.64:0/1606350183 >> v2:172.21.15.16:3300/0 conn(0x7fdba815d540 0x7fdba80b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 -- 172.21.15.64:0/1606350183 >> v2:172.21.15.16:3300/0 conn(0x7fdba815d540 msgr2=0x7fdba80b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:10.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 --2- 172.21.15.64:0/1606350183 >> v2:172.21.15.16:3300/0 conn(0x7fdba815d540 0x7fdba80b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 -- 172.21.15.64:0/1606350183 >> v1:172.21.15.64:6789/0 conn(0x7fdba80d1f50 legacy=0x7fdba80d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.306+0000 7fdba6d9d640 1 -- 172.21.15.64:0/1606350183 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80b3880 con 0x7fdba80d3690 2023-11-28T17:39:10.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdba6d9d640 1 --2- 172.21.15.64:0/1606350183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba80d3690 0x7fdba80cdde0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdba8160ee0 tx=0x7fdba001c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fe57dbb67af1622 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:10.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdba559a640 1 -- 172.21.15.64:0/1606350183 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00a57d0 con 0x7fdba80d3690 2023-11-28T17:39:10.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdba559a640 1 -- 172.21.15.64:0/1606350183 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba00a5930 con 0x7fdba80d3690 2023-11-28T17:39:10.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdba559a640 1 -- 172.21.15.64:0/1606350183 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba00a5cc0 con 0x7fdba80d3690 2023-11-28T17:39:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 -- 172.21.15.64:0/1606350183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba80d3690 msgr2=0x7fdba80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 --2- 172.21.15.64:0/1606350183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba80d3690 0x7fdba80cdde0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdba8160ee0 tx=0x7fdba001c910 comp rx=0 tx=0).stop 2023-11-28T17:39:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 -- 172.21.15.64:0/1606350183 shutdown_connections 2023-11-28T17:39:10.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 --2- 172.21.15.64:0/1606350183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba80d3690 0x7fdba80cdde0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 --2- 172.21.15.64:0/1606350183 >> v2:172.21.15.16:3300/0 conn(0x7fdba815d540 0x7fdba80b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 -- 172.21.15.64:0/1606350183 >> 172.21.15.64:0/1606350183 conn(0x7fdba808ccf0 msgr2=0x7fdba809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:10.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 -- 172.21.15.64:0/1606350183 shutdown_connections 2023-11-28T17:39:10.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.310+0000 7fdbac832640 1 -- 172.21.15.64:0/1606350183 wait complete. 2023-11-28T17:39:10.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 Processor -- start 2023-11-28T17:39:10.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- start start 2023-11-28T17:39:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdba80d1f50 0x7fdba80ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdba80d3690 0x7fdba8155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba815d540 0x7fdba80cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba815be30 con 0x7fdba80d1f50 2023-11-28T17:39:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba80cab10 con 0x7fdba815d540 2023-11-28T17:39:10.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba815b490 con 0x7fdba80d3690 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba815d540 0x7fdba80cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba815d540 0x7fdba80cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58776/0 (socket says 172.21.15.64:58776) 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba6d9d640 1 -- 172.21.15.64:0/536196078 learned_addr learned my addr 172.21.15.64:0/536196078 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdba80d1f50 0x7fdba80ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba5d9b640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdba80d3690 0x7fdba8155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 -- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdba80d3690 msgr2=0x7fdba8155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdba80d3690 0x7fdba8155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 -- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba815d540 msgr2=0x7fdba80cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba815d540 0x7fdba80cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 -- 172.21.15.64:0/536196078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0009b30 con 0x7fdba80d1f50 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba5d9b640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdba80d3690 0x7fdba8155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:10.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdba659c640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdba80d1f50 0x7fdba80ca410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e870 tx=0x7fdb9800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800ee60 con 0x7fdba80d1f50 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800c940 con 0x7fdba80d1f50 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800ccd0 con 0x7fdba80d1f50 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba815b770 con 0x7fdba80d1f50 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba8155960 con 0x7fdba80d1f50 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdb98005ca0 con 0x7fdba80d1f50 2023-11-28T17:39:10.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdb980137b0 con 0x7fdba80d1f50 2023-11-28T17:39:10.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.314+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba8068860 con 0x7fdba80d1f50 2023-11-28T17:39:10.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.322+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdb98021060 con 0x7fdba80d1f50 2023-11-28T17:39:10.370 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:10.366+0000 7f4d1ae26180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T17:39:10.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.390+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f568087-e081-4769-848d-db1d71d2e010", "id": 0} v 0) v1 -- 0x7fdba81566b0 con 0x7fdba80d1f50 2023-11-28T17:39:10.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdb96ffd640 1 -- 172.21.15.64:0/536196078 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f568087-e081-4769-848d-db1d71d2e010", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdb98017070 con 0x7fdba80d1f50 2023-11-28T17:39:10.397 INFO:teuthology.orchestra.run.smithi064.stdout:0 2023-11-28T17:39:10.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdba80d1f50 msgr2=0x7fdba80ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdba80d1f50 0x7fdba80ca410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fdb9800e870 tx=0x7fdb9800ed30 comp rx=0 tx=0).stop 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 shutdown_connections 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdba815d540 0x7fdba80cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdba80d3690 0x7fdba8155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 --2- 172.21.15.64:0/536196078 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdba80d1f50 0x7fdba80ca410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 >> 172.21.15.64:0/536196078 conn(0x7fdba808ccf0 msgr2=0x7fdba80664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 shutdown_connections 2023-11-28T17:39:10.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.394+0000 7fdbac832640 1 -- 172.21.15.64:0/536196078 wait complete. 2023-11-28T17:39:10.408 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:10.408+0000 7fe9b2c2d180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T17:39:10.418 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new af5a292a-f288-45ad-b757-67e537bd8d3f 1 2023-11-28T17:39:10.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.554+0000 7f72a05f5640 1 Processor -- start 2023-11-28T17:39:10.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.554+0000 7f72a05f5640 1 -- start start 2023-11-28T17:39:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f72a05f5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f72a05f5640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72980b32c0 con 0x7f729815d540 2023-11-28T17:39:10.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f72a05f5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72980b35a0 con 0x7f72980d1f50 2023-11-28T17:39:10.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f72a05f5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72980b30d0 con 0x7f72980cedf0 2023-11-28T17:39:10.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729db90640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f72980d1f50 0x7f72980d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34516/0 (socket says 172.21.15.64:34516) 2023-11-28T17:39:10.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729db90640 1 -- 172.21.15.64:0/1851269347 learned_addr learned my addr 172.21.15.64:0/1851269347 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-11-28T17:39:10.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729eb92640 1 --2- 172.21.15.64:0/1851269347 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729eb92640 1 -- 172.21.15.64:0/1851269347 >> v1:172.21.15.64:6789/0 conn(0x7f72980d1f50 legacy=0x7f72980d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729eb92640 1 -- 172.21.15.64:0/1851269347 >> v1:172.21.15.16:6789/0 conn(0x7f729815d540 legacy=0x7f72980b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:10.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729d38f640 1 -- 172.21.15.64:0/1851269347 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521434575 0 0) 0x7f72980b35a0 con 0x7f72980d1f50 2023-11-28T17:39:10.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.558+0000 7f729eb92640 1 -- 172.21.15.64:0/1851269347 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72980b3880 con 0x7f72980cedf0 2023-11-28T17:39:10.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f729eb92640 1 --2- 172.21.15.64:0/1851269347 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298167fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7290009dc0 tx=0x7f729001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4841c7dc8cb973 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:10.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f729d38f640 1 -- 172.21.15.64:0/1851269347 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72900a5920 con 0x7f72980cedf0 2023-11-28T17:39:10.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f729d38f640 1 -- 172.21.15.64:0/1851269347 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72900a5a80 con 0x7f72980cedf0 2023-11-28T17:39:10.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f729d38f640 1 -- 172.21.15.64:0/1851269347 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72900a5e10 con 0x7f72980cedf0 2023-11-28T17:39:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 -- 172.21.15.64:0/1851269347 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 msgr2=0x7f7298167fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 --2- 172.21.15.64:0/1851269347 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298167fe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7290009dc0 tx=0x7f729001c970 comp rx=0 tx=0).stop 2023-11-28T17:39:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 -- 172.21.15.64:0/1851269347 shutdown_connections 2023-11-28T17:39:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 --2- 172.21.15.64:0/1851269347 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298167fe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 -- 172.21.15.64:0/1851269347 >> 172.21.15.64:0/1851269347 conn(0x7f729808ccf0 msgr2=0x7f729809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:10.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 -- 172.21.15.64:0/1851269347 shutdown_connections 2023-11-28T17:39:10.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 -- 172.21.15.64:0/1851269347 wait complete. 2023-11-28T17:39:10.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.562+0000 7f72a05f5640 1 Processor -- start 2023-11-28T17:39:10.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- start start 2023-11-28T17:39:10.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298160590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72980d1f50 0x7f72980b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f729815d540 0x7f72980c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72980b69d0 con 0x7f72980d1f50 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7298158470 con 0x7f729815d540 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7298159290 con 0x7f72980cedf0 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298160590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298160590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:41790/0 (socket says 172.21.15.64:41790) 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 -- 172.21.15.64:0/3457330630 learned_addr learned my addr 172.21.15.64:0/3457330630 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729eb92640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f729815d540 0x7f72980c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729db90640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72980d1f50 0x7f72980b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 -- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f729815d540 msgr2=0x7f72980c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f729815d540 0x7f72980c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 -- 172.21.15.64:0/3457330630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72980d1f50 msgr2=0x7f72980b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72980d1f50 0x7f72980b8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 -- 172.21.15.64:0/3457330630 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7290009a70 con 0x7f72980cedf0 2023-11-28T17:39:10.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729eb92640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f729815d540 0x7f72980c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:10.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729db90640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72980d1f50 0x7f72980b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f729e391640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298160590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f729400c500 tx=0x7f729400c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294005220 con 0x7f72980cedf0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7294005380 con 0x7f72980cedf0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294007270 con 0x7f72980cedf0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72980b8d80 con 0x7f72980cedf0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7298158960 con 0x7f72980cedf0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f72940067e0 con 0x7f72980cedf0 2023-11-28T17:39:10.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f72940129f0 con 0x7f72980cedf0 2023-11-28T17:39:10.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.566+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7298068860 con 0x7f72980cedf0 2023-11-28T17:39:10.578 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:10.574+0000 7f4d1ae26180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T17:39:10.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.582+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7294016020 con 0x7f72980cedf0 2023-11-28T17:39:10.613 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:10.612+0000 7fe9b2c2d180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T17:39:10.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.650+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "af5a292a-f288-45ad-b757-67e537bd8d3f", "id": 1} v 0) v1 -- 0x7f7298066a10 con 0x7f72980cedf0 2023-11-28T17:39:10.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f728effd640 1 -- 172.21.15.64:0/3457330630 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "af5a292a-f288-45ad-b757-67e537bd8d3f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f729402a0b0 con 0x7f72980cedf0 2023-11-28T17:39:10.660 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-11-28T17:39:10.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 msgr2=0x7f7298160590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298160590 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f729400c500 tx=0x7f729400c9c0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 shutdown_connections 2023-11-28T17:39:10.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f729815d540 0x7f72980c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72980d1f50 0x7f72980b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 --2- 172.21.15.64:0/3457330630 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72980cedf0 0x7f7298160590 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 >> 172.21.15.64:0/3457330630 conn(0x7f729808ccf0 msgr2=0x7f72980b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:10.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 shutdown_connections 2023-11-28T17:39:10.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.658+0000 7f72a05f5640 1 -- 172.21.15.64:0/3457330630 wait complete. 2023-11-28T17:39:10.679 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 3215bd2e-926a-43ca-bc5b-05f939f42753 2 2023-11-28T17:39:10.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 Processor -- start 2023-11-28T17:39:10.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 -- start start 2023-11-28T17:39:10.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff46415d540 0x7ff4640b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4640d3690 0x7ff4640cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4640b32c0 con 0x7ff4640d1f50 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff46415d920 con 0x7ff46415d540 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff46a19d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4640b35a0 con 0x7ff4640d3690 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4640d3690 0x7ff4640cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff4637fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff46415d540 0x7ff4640b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4640d3690 0x7ff4640cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58796/0 (socket says 172.21.15.64:58796) 2023-11-28T17:39:10.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 -- 172.21.15.64:0/3455507254 learned_addr learned my addr 172.21.15.64:0/3455507254 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:10.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 -- 172.21.15.64:0/3455507254 >> v2:172.21.15.16:3300/0 conn(0x7ff46415d540 msgr2=0x7ff4640b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:10.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 --2- 172.21.15.64:0/3455507254 >> v2:172.21.15.16:3300/0 conn(0x7ff46415d540 0x7ff4640b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 -- 172.21.15.64:0/3455507254 >> v1:172.21.15.16:6789/0 conn(0x7ff4640d1f50 legacy=0x7ff4640d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.818+0000 7ff463fff640 1 -- 172.21.15.64:0/3455507254 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4640b3880 con 0x7ff4640d3690 2023-11-28T17:39:10.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff463fff640 1 --2- 172.21.15.64:0/3455507254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4640d3690 0x7ff4640cdde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff464160ee0 tx=0x7ff45c01c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91562cb51c030e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:10.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff4627fc640 1 -- 172.21.15.64:0/3455507254 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0a57d0 con 0x7ff4640d3690 2023-11-28T17:39:10.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff4627fc640 1 -- 172.21.15.64:0/3455507254 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c0a5930 con 0x7ff4640d3690 2023-11-28T17:39:10.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff4627fc640 1 -- 172.21.15.64:0/3455507254 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c0a5cc0 con 0x7ff4640d3690 2023-11-28T17:39:10.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 -- 172.21.15.64:0/3455507254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4640d3690 msgr2=0x7ff4640cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 --2- 172.21.15.64:0/3455507254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4640d3690 0x7ff4640cdde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff464160ee0 tx=0x7ff45c01c910 comp rx=0 tx=0).stop 2023-11-28T17:39:10.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 -- 172.21.15.64:0/3455507254 shutdown_connections 2023-11-28T17:39:10.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 --2- 172.21.15.64:0/3455507254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4640d3690 0x7ff4640cdde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 --2- 172.21.15.64:0/3455507254 >> v2:172.21.15.16:3300/0 conn(0x7ff46415d540 0x7ff4640b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 -- 172.21.15.64:0/3455507254 >> 172.21.15.64:0/3455507254 conn(0x7ff46408ccf0 msgr2=0x7ff46409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:10.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 -- 172.21.15.64:0/3455507254 shutdown_connections 2023-11-28T17:39:10.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.822+0000 7ff46a19d640 1 -- 172.21.15.64:0/3455507254 wait complete. 2023-11-28T17:39:10.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 Processor -- start 2023-11-28T17:39:10.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 -- start start 2023-11-28T17:39:10.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff4640d1f50 0x7ff4640ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4640d3690 0x7ff464155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 0x7ff4640cca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:10.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4640cd260 con 0x7ff4640d3690 2023-11-28T17:39:10.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff464155dc0 con 0x7ff46415d540 2023-11-28T17:39:10.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46415dcf0 con 0x7ff4640d1f50 2023-11-28T17:39:10.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff463fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 0x7ff4640cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff4637fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff4640d1f50 0x7ff4640ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff463fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 0x7ff4640cca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58804/0 (socket says 172.21.15.64:58804) 2023-11-28T17:39:10.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff463fff640 1 -- 172.21.15.64:0/1587266483 learned_addr learned my addr 172.21.15.64:0/1587266483 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:10.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4640d3690 0x7ff464155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:10.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 -- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff4640d1f50 msgr2=0x7ff4640ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff4640d1f50 0x7ff4640ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 -- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 msgr2=0x7ff4640cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 0x7ff4640cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 -- 172.21.15.64:0/1587266483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c009b30 con 0x7ff4640d3690 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff463fff640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 0x7ff4640cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff462ffd640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4640d3690 0x7ff464155880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff46408d690 tx=0x7ff45800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580052d0 con 0x7ff4640d3690 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff458005430 con 0x7ff4640d3690 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458003840 con 0x7ff4640d3690 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46415dfd0 con 0x7ff4640d3690 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46415e590 con 0x7ff4640d3690 2023-11-28T17:39:10.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff458003ca0 con 0x7ff4640d3690 2023-11-28T17:39:10.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.826+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7ff4580119b0 con 0x7ff4640d3690 2023-11-28T17:39:10.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.830+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff464068860 con 0x7ff4640d3690 2023-11-28T17:39:10.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.830+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff458017070 con 0x7ff4640d3690 2023-11-28T17:39:10.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.898+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3215bd2e-926a-43ca-bc5b-05f939f42753", "id": 2} v 0) v1 -- 0x7ff4641566b0 con 0x7ff4640d3690 2023-11-28T17:39:10.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff44bfff640 1 -- 172.21.15.64:0/1587266483 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3215bd2e-926a-43ca-bc5b-05f939f42753", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff458011590 con 0x7ff4640d3690 2023-11-28T17:39:10.905 INFO:teuthology.orchestra.run.smithi064.stdout:2 2023-11-28T17:39:10.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4640d3690 msgr2=0x7ff464155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:10.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4640d3690 0x7ff464155880 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7ff46408d690 tx=0x7ff45800c890 comp rx=0 tx=0).stop 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 shutdown_connections 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff46415d540 0x7ff4640cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff4640d3690 0x7ff464155880 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 --2- 172.21.15.64:0/1587266483 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff4640d1f50 0x7ff4640ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 >> 172.21.15.64:0/1587266483 conn(0x7ff46408ccf0 msgr2=0x7ff4640664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 shutdown_connections 2023-11-28T17:39:10.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:10.902+0000 7ff46a19d640 1 -- 172.21.15.64:0/1587266483 wait complete. 2023-11-28T17:39:10.925 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 9b6d4fe2-2277-4a73-b11f-edd776e4160e 3 2023-11-28T17:39:11.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 Processor -- start 2023-11-28T17:39:11.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 -- start start 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5a780d1f50 0x7f5a780d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a780cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a780d3930 con 0x7f5a7815d540 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a780b30d0 con 0x7f5a780d1f50 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.062+0000 7f5a7f32a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7815d920 con 0x7f5a780d34c0 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7c8c5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5a780d1f50 0x7f5a780d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7d0c6640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f5a7815d540 0x7f5a780b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34524/0 (socket says 172.21.15.64:34524) 2023-11-28T17:39:11.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7d0c6640 1 -- 172.21.15.64:0/560933883 learned_addr learned my addr 172.21.15.64:0/560933883 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-11-28T17:39:11.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7d8c7640 1 --2- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a780cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 msgr2=0x7f5a780cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:11.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7c8c5640 1 --2- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a780cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/560933883 >> v1:172.21.15.64:6789/0 conn(0x7f5a7815d540 legacy=0x7f5a780b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a6ffff640 1 -- 172.21.15.64:0/560933883 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622832264 0 0) 0x7f5a780d3930 con 0x7f5a7815d540 2023-11-28T17:39:11.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.066+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/560933883 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a780b32c0 con 0x7f5a780d1f50 2023-11-28T17:39:11.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7c8c5640 1 --2- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a780d1f50 0x7f5a780d2f80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097c0 tx=0x7f5a6801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e253fa6e66d5a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a6ffff640 1 -- 172.21.15.64:0/560933883 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680ab650 con 0x7f5a780d1f50 2023-11-28T17:39:11.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a6ffff640 1 -- 172.21.15.64:0/560933883 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a680ab7b0 con 0x7f5a780d1f50 2023-11-28T17:39:11.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a6ffff640 1 -- 172.21.15.64:0/560933883 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680abb40 con 0x7f5a780d1f50 2023-11-28T17:39:11.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 -- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a780d1f50 msgr2=0x7f5a780d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a780d1f50 0x7f5a780d2f80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097c0 tx=0x7f5a6801c450 comp rx=0 tx=0).stop 2023-11-28T17:39:11.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 -- 172.21.15.64:0/560933883 shutdown_connections 2023-11-28T17:39:11.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a780cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/560933883 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a780d1f50 0x7f5a780d2f80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 -- 172.21.15.64:0/560933883 >> 172.21.15.64:0/560933883 conn(0x7f5a7808ccf0 msgr2=0x7f5a7809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 -- 172.21.15.64:0/560933883 shutdown_connections 2023-11-28T17:39:11.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.070+0000 7f5a7f32a640 1 -- 172.21.15.64:0/560933883 wait complete. 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 Processor -- start 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 -- start start 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a780d1f50 0x7f5a780c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a7815fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 0x7f5a780ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a780cd550 con 0x7f5a780d1f50 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7815eab0 con 0x7f5a7815d540 2023-11-28T17:39:11.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7815ed00 con 0x7f5a780d34c0 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a7815fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7d8c7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 0x7f5a780ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a7815fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:41802/0 (socket says 172.21.15.64:41802) 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7d8c7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 0x7f5a780ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58826/0 (socket says 172.21.15.64:58826) 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/3947660895 learned_addr learned my addr 172.21.15.64:0/3947660895 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7d0c6640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a780d1f50 0x7f5a780c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 msgr2=0x7f5a780ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 0x7f5a780ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/3947660895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a780d1f50 msgr2=0x7f5a780c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a780d1f50 0x7f5a780c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 -- 172.21.15.64:0/3947660895 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68009420 con 0x7f5a780d34c0 2023-11-28T17:39:11.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7d8c7640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 0x7f5a780ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7c8c5640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a7815fda0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a6801a080 tx=0x7f5a6801ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680b5810 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a680b5990 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7815efe0 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a680b5d40 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7815f5a0 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5a680bf710 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.074+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5a680b4820 con 0x7f5a780d34c0 2023-11-28T17:39:11.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.078+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a78068860 con 0x7f5a780d34c0 2023-11-28T17:39:11.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.078+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5a680b4390 con 0x7f5a780d34c0 2023-11-28T17:39:11.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.150+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9b6d4fe2-2277-4a73-b11f-edd776e4160e", "id": 3} v 0) v1 -- 0x7f5a78066a10 con 0x7f5a780d34c0 2023-11-28T17:39:11.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.154+0000 7f5a6dffb640 1 -- 172.21.15.64:0/3947660895 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b6d4fe2-2277-4a73-b11f-edd776e4160e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a680b45f0 con 0x7f5a780d34c0 2023-11-28T17:39:11.159 INFO:teuthology.orchestra.run.smithi064.stdout:3 2023-11-28T17:39:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 msgr2=0x7f5a7815fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a7815fda0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5a6801a080 tx=0x7f5a6801ac90 comp rx=0 tx=0).stop 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 shutdown_connections 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a7815d540 0x7f5a780ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5a780d34c0 0x7f5a7815fda0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 --2- 172.21.15.64:0/3947660895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5a780d1f50 0x7f5a780c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 >> 172.21.15.64:0/3947660895 conn(0x7f5a7808ccf0 msgr2=0x7f5a780cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 shutdown_connections 2023-11-28T17:39:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.158+0000 7f5a7f32a640 1 -- 172.21.15.64:0/3947660895 wait complete. 2023-11-28T17:39:11.178 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new c465cb78-8f4b-4459-82dd-e88cc2133159 4 2023-11-28T17:39:11.258 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.254+0000 7f4d1ae26180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T17:39:11.269 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.268+0000 7fe9b2c2d180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T17:39:11.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.314+0000 7faf4d2c9640 1 Processor -- start 2023-11-28T17:39:11.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.314+0000 7faf4d2c9640 1 -- start start 2023-11-28T17:39:11.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf4d2c9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faf48072090 0x7faf480cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf4d2c9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faf4815b350 0x7faf480cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf4d2c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4815a8b0 con 0x7faf481548e0 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf4d2c9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf480ce860 con 0x7faf4815b350 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf4d2c9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4815a6a0 con 0x7faf48072090 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faf48072090 0x7faf480cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf477fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faf4815b350 0x7faf480cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faf48072090 0x7faf480cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58840/0 (socket says 172.21.15.64:58840) 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 -- 172.21.15.64:0/1816088570 learned_addr learned my addr 172.21.15.64:0/1816088570 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf467fc640 1 -- 172.21.15.64:0/1816088570 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340029798 0 0) 0x7faf4815a8b0 con 0x7faf481548e0 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 -- 172.21.15.64:0/1816088570 >> v2:172.21.15.16:3300/0 conn(0x7faf4815b350 msgr2=0x7faf480cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 --2- 172.21.15.64:0/1816088570 >> v2:172.21.15.16:3300/0 conn(0x7faf4815b350 0x7faf480cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 -- 172.21.15.64:0/1816088570 >> v1:172.21.15.16:6789/0 conn(0x7faf481548e0 legacy=0x7faf480ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.318+0000 7faf3ffff640 1 -- 172.21.15.64:0/1816088570 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480cea50 con 0x7faf48072090 2023-11-28T17:39:11.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf3ffff640 1 --2- 172.21.15.64:0/1816088570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf480cef30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faf480b4490 tx=0x7faf3001c500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38ecfc8039b77c56 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf467fc640 1 -- 172.21.15.64:0/1816088570 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300ab5f0 con 0x7faf48072090 2023-11-28T17:39:11.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf467fc640 1 -- 172.21.15.64:0/1816088570 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf300ab750 con 0x7faf48072090 2023-11-28T17:39:11.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf467fc640 1 -- 172.21.15.64:0/1816088570 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf300abae0 con 0x7faf48072090 2023-11-28T17:39:11.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1816088570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 msgr2=0x7faf480cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1816088570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf480cef30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7faf480b4490 tx=0x7faf3001c500 comp rx=0 tx=0).stop 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1816088570 shutdown_connections 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1816088570 >> v2:172.21.15.16:3300/0 conn(0x7faf4815b350 0x7faf480cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1816088570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf480cef30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1816088570 >> 172.21.15.64:0/1816088570 conn(0x7faf4806a5a0 msgr2=0x7faf4806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1816088570 shutdown_connections 2023-11-28T17:39:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.322+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1816088570 wait complete. 2023-11-28T17:39:11.327 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.322+0000 7f4d1ae26180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T17:39:11.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 Processor -- start 2023-11-28T17:39:11.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 -- start start 2023-11-28T17:39:11.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf48159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf481548e0 0x7faf4813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 0x7faf481f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48159bc0 con 0x7faf481548e0 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4813ef60 con 0x7faf48072090 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf48155300 con 0x7faf4815b350 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf46ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf48159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 0x7faf481f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf46ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf48159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58848/0 (socket says 172.21.15.64:58848) 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 0x7faf481f3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:41808/0 (socket says 172.21.15.64:41808) 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf46ffd640 1 -- 172.21.15.64:0/1054613428 learned_addr learned my addr 172.21.15.64:0/1054613428 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf3ffff640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf481548e0 0x7faf4813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 -- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 msgr2=0x7faf48159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf48159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 -- 172.21.15.64:0/1054613428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf481548e0 msgr2=0x7faf4813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf481548e0 0x7faf4813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 -- 172.21.15.64:0/1054613428 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300094d0 con 0x7faf4815b350 2023-11-28T17:39:11.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf477fe640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 0x7faf481f3ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faf4000eba0 tx=0x7faf4000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4000cd20 con 0x7faf4815b350 2023-11-28T17:39:11.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4000f040 con 0x7faf4815b350 2023-11-28T17:39:11.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf400146c0 con 0x7faf4815b350 2023-11-28T17:39:11.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.326+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf481555e0 con 0x7faf4815b350 2023-11-28T17:39:11.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.330+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf48155ba0 con 0x7faf4815b350 2023-11-28T17:39:11.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.330+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faf40014b20 con 0x7faf4815b350 2023-11-28T17:39:11.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.330+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7faf40014dd0 con 0x7faf4815b350 2023-11-28T17:39:11.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.330+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf48068860 con 0x7faf4815b350 2023-11-28T17:39:11.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.334+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7faf4003bce0 con 0x7faf4815b350 2023-11-28T17:39:11.339 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.336+0000 7fe9b2c2d180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T17:39:11.394 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.390+0000 7f4d1ae26180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T17:39:11.402 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.400+0000 7fe9b2c2d180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T17:39:11.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.402+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c465cb78-8f4b-4459-82dd-e88cc2133159", "id": 4} v 0) v1 -- 0x7faf4815a0e0 con 0x7faf4815b350 2023-11-28T17:39:11.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf3f7fe640 1 -- 172.21.15.64:0/1054613428 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c465cb78-8f4b-4459-82dd-e88cc2133159", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7faf4002a070 con 0x7faf4815b350 2023-11-28T17:39:11.412 INFO:teuthology.orchestra.run.smithi064.stdout:4 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 msgr2=0x7faf481f3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 0x7faf481f3ff0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faf4000eba0 tx=0x7faf4000c490 comp rx=0 tx=0).stop 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 shutdown_connections 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf4815b350 0x7faf481f3ff0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf481548e0 0x7faf4813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 --2- 172.21.15.64:0/1054613428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48072090 0x7faf48159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 >> 172.21.15.64:0/1054613428 conn(0x7faf4806a5a0 msgr2=0x7faf48152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 shutdown_connections 2023-11-28T17:39:11.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.410+0000 7faf4d2c9640 1 -- 172.21.15.64:0/1054613428 wait complete. 2023-11-28T17:39:11.433 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 021b203b-53fe-4900-8ba8-04484048259d 5 2023-11-28T17:39:11.491 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.486+0000 7f4d1ae26180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T17:39:11.496 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.496+0000 7fe9b2c2d180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T17:39:11.555 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.550+0000 7f4d1ae26180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T17:39:11.559 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.556+0000 7fe9b2c2d180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T17:39:11.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.570+0000 7f76d9972640 1 Processor -- start 2023-11-28T17:39:11.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.570+0000 7f76d9972640 1 -- start start 2023-11-28T17:39:11.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.570+0000 7f76d9972640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f76d40b4380 0x7f76d4168150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.570+0000 7f76d9972640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d40b2be0 con 0x7f76d415d5a0 2023-11-28T17:39:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.570+0000 7f76d9972640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d40d1c90 con 0x7f76d40d1fd0 2023-11-28T17:39:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.570+0000 7f76d9972640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d40d0c10 con 0x7f76d40b4380 2023-11-28T17:39:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76cbfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f76d40d1fd0 0x7f76d40d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34532/0 (socket says 172.21.15.64:34532) 2023-11-28T17:39:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76cbfff640 1 -- 172.21.15.64:0/2369003724 learned_addr learned my addr 172.21.15.64:0/2369003724 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-11-28T17:39:11.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d37fe640 1 --2- 172.21.15.64:0/2369003724 >> v2:172.21.15.16:3300/0 conn(0x7f76d40b4380 0x7f76d4168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d37fe640 1 -- 172.21.15.64:0/2369003724 >> v1:172.21.15.64:6789/0 conn(0x7f76d40d1fd0 legacy=0x7f76d40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d37fe640 1 -- 172.21.15.64:0/2369003724 >> v1:172.21.15.16:6789/0 conn(0x7f76d415d5a0 legacy=0x7f76d40d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d27fc640 1 -- 172.21.15.64:0/2369003724 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61950503 0 0) 0x7f76d40d1c90 con 0x7f76d40d1fd0 2023-11-28T17:39:11.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d37fe640 1 -- 172.21.15.64:0/2369003724 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d40cec30 con 0x7f76d40b4380 2023-11-28T17:39:11.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d37fe640 1 --2- 172.21.15.64:0/2369003724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d40b4380 0x7f76d4168150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009d90 tx=0x7f76cc01c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56b517d3bbb3c00 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d27fc640 1 -- 172.21.15.64:0/2369003724 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0a57f0 con 0x7f76d40b4380 2023-11-28T17:39:11.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d27fc640 1 -- 172.21.15.64:0/2369003724 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc0a5950 con 0x7f76d40b4380 2023-11-28T17:39:11.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.574+0000 7f76d27fc640 1 -- 172.21.15.64:0/2369003724 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0a5ce0 con 0x7f76d40b4380 2023-11-28T17:39:11.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- 172.21.15.64:0/2369003724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d40b4380 msgr2=0x7f76d4168150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 --2- 172.21.15.64:0/2369003724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d40b4380 0x7f76d4168150 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f76cc009d90 tx=0x7f76cc01c7b0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- 172.21.15.64:0/2369003724 shutdown_connections 2023-11-28T17:39:11.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 --2- 172.21.15.64:0/2369003724 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d40b4380 0x7f76d4168150 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- 172.21.15.64:0/2369003724 >> 172.21.15.64:0/2369003724 conn(0x7f76d409c570 msgr2=0x7f76d40d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- 172.21.15.64:0/2369003724 shutdown_connections 2023-11-28T17:39:11.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- 172.21.15.64:0/2369003724 wait complete. 2023-11-28T17:39:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 Processor -- start 2023-11-28T17:39:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- start start 2023-11-28T17:39:11.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76d40b4380 0x7f76d414a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 0x7f76d40cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d415d5a0 0x7f76d40ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d415eef0 con 0x7f76d415d5a0 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d41548b0 con 0x7f76d40d1fd0 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d9972640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d40cd280 con 0x7f76d40b4380 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 0x7f76d40cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76d40b4380 0x7f76d414a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 0x7f76d40cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58850/0 (socket says 172.21.15.64:58850) 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76cbfff640 1 -- 172.21.15.64:0/3383959768 learned_addr learned my addr 172.21.15.64:0/3383959768 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.578+0000 7f76d37fe640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d415d5a0 0x7f76d40ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d37fe640 1 -- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76d40b4380 msgr2=0x7f76d414a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d37fe640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76d40b4380 0x7f76d414a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d37fe640 1 -- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 msgr2=0x7f76d40cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d37fe640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 0x7f76d40cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d37fe640 1 -- 172.21.15.64:0/3383959768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc009a70 con 0x7f76d415d5a0 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76cbfff640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 0x7f76d40cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d2ffd640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76d40b4380 0x7f76d414a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d37fe640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d415d5a0 0x7f76d40ccd40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f76d408b880 tx=0x7f76cc019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0ad850 con 0x7f76d415d5a0 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc0ad9b0 con 0x7f76d415d5a0 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0add40 con 0x7f76d415d5a0 2023-11-28T17:39:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d414ae00 con 0x7f76d415d5a0 2023-11-28T17:39:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d415e830 con 0x7f76d415d5a0 2023-11-28T17:39:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f76cc0b4050 con 0x7f76d415d5a0 2023-11-28T17:39:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f76cc0b68f0 con 0x7f76d415d5a0 2023-11-28T17:39:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.582+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d415f030 con 0x7f76d415d5a0 2023-11-28T17:39:11.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.586+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f76d415f030 con 0x7f76d415d5a0 2023-11-28T17:39:11.652 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.650+0000 7f4d1ae26180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T17:39:11.652 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.652+0000 7fe9b2c2d180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T17:39:11.657 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.654+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd new", "uuid": "021b203b-53fe-4900-8ba8-04484048259d", "id": 5} v 0) v1 -- 0x7f76d40d3d00 con 0x7f76d415d5a0 2023-11-28T17:39:11.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d0ff9640 1 -- 172.21.15.64:0/3383959768 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "021b203b-53fe-4900-8ba8-04484048259d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f76cc0c6060 con 0x7f76d415d5a0 2023-11-28T17:39:11.660 INFO:teuthology.orchestra.run.smithi064.stdout:5 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d415d5a0 msgr2=0x7f76d40ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d415d5a0 0x7f76d40ccd40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f76d408b880 tx=0x7f76cc019550 comp rx=0 tx=0).stop 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 shutdown_connections 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f76d415d5a0 0x7f76d40ccd40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f76d40d1fd0 0x7f76d40cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 --2- 172.21.15.64:0/3383959768 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f76d40b4380 0x7f76d414a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 >> 172.21.15.64:0/3383959768 conn(0x7f76d409c570 msgr2=0x7f76d406c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 shutdown_connections 2023-11-28T17:39:11.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.658+0000 7f76d9972640 1 -- 172.21.15.64:0/3383959768 wait complete. 2023-11-28T17:39:11.680 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new bf3d817c-92bc-4766-b6ac-9744af07da37 6 2023-11-28T17:39:11.716 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.716+0000 7fe9b2c2d180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T17:39:11.718 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.714+0000 7f4d1ae26180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T17:39:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.818+0000 7f42ead9d640 1 Processor -- start 2023-11-28T17:39:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.818+0000 7f42ead9d640 1 -- start start 2023-11-28T17:39:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42ead9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42e415d540 0x7f42e40b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42ead9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 0x7f42e40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42ead9d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e40b32c0 con 0x7f42e40d1f50 2023-11-28T17:39:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42ead9d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e415d920 con 0x7f42e415d540 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42ead9d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40b35a0 con 0x7f42e40d3690 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 0x7f42e40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 0x7f42e40cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:41836/0 (socket says 172.21.15.64:41836) 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 -- 172.21.15.64:0/557537741 learned_addr learned my addr 172.21.15.64:0/557537741 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e8b39640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42e415d540 0x7f42e40b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 -- 172.21.15.64:0/557537741 >> v2:172.21.15.16:3300/0 conn(0x7f42e415d540 msgr2=0x7f42e40b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 --2- 172.21.15.64:0/557537741 >> v2:172.21.15.16:3300/0 conn(0x7f42e415d540 0x7f42e40b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 -- 172.21.15.64:0/557537741 >> v1:172.21.15.16:6789/0 conn(0x7f42e40d1f50 legacy=0x7f42e40d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 -- 172.21.15.64:0/557537741 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40b3880 con 0x7f42e40d3690 2023-11-28T17:39:11.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.822+0000 7f42e933a640 1 --2- 172.21.15.64:0/557537741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 0x7f42e40cdde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e50 tx=0x7f42dc01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6611cfb69e721f32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42e37fe640 1 -- 172.21.15.64:0/557537741 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0a58a0 con 0x7f42e40d3690 2023-11-28T17:39:11.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42e37fe640 1 -- 172.21.15.64:0/557537741 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0a5a00 con 0x7f42e40d3690 2023-11-28T17:39:11.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42e37fe640 1 -- 172.21.15.64:0/557537741 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0a5d90 con 0x7f42e40d3690 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 -- 172.21.15.64:0/557537741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 msgr2=0x7f42e40cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 --2- 172.21.15.64:0/557537741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 0x7f42e40cdde0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f42dc009e50 tx=0x7f42dc01c9e0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 -- 172.21.15.64:0/557537741 shutdown_connections 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 --2- 172.21.15.64:0/557537741 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d3690 0x7f42e40cdde0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 --2- 172.21.15.64:0/557537741 >> v2:172.21.15.16:3300/0 conn(0x7f42e415d540 0x7f42e40b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 -- 172.21.15.64:0/557537741 >> 172.21.15.64:0/557537741 conn(0x7f42e408ccf0 msgr2=0x7f42e409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 -- 172.21.15.64:0/557537741 shutdown_connections 2023-11-28T17:39:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 -- 172.21.15.64:0/557537741 wait complete. 2023-11-28T17:39:11.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.826+0000 7f42ead9d640 1 Processor -- start 2023-11-28T17:39:11.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 -- start start 2023-11-28T17:39:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d1f50 0x7f42e40c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42e40d3690 0x7f42e415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 0x7f42e415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40c96a0 con 0x7f42e40d3690 2023-11-28T17:39:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40cc240 con 0x7f42e415d540 2023-11-28T17:39:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40cc520 con 0x7f42e40d1f50 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 0x7f42e415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e8b39640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d1f50 0x7f42e40c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 0x7f42e415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:58854/0 (socket says 172.21.15.64:58854) 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 -- 172.21.15.64:0/1816173045 learned_addr learned my addr 172.21.15.64:0/1816173045 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e3fff640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42e40d3690 0x7f42e415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 -- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d1f50 msgr2=0x7f42e40c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d1f50 0x7f42e40c9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 -- 172.21.15.64:0/1816173045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42e40d3690 msgr2=0x7f42e415ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42e40d3690 0x7f42e415ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 -- 172.21.15.64:0/1816173045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42dc009b30 con 0x7f42e415d540 2023-11-28T17:39:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e933a640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 0x7f42e415bf90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f42dc01a610 tx=0x7f42dc019780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0b8670 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0b87d0 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42dc0b8b60 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e40cc800 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e40ccdc0 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f42dc0c1400 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.830+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f42dc0c1ca0 con 0x7f42e415d540 2023-11-28T17:39:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.834+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e40cc660 con 0x7f42e415d540 2023-11-28T17:39:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.834+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f42e40cc660 con 0x7f42e415d540 2023-11-28T17:39:11.880 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.880+0000 7fe9b2c2d180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T17:39:11.889 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.886+0000 7f4d1ae26180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T17:39:11.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.906+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bf3d817c-92bc-4766-b6ac-9744af07da37", "id": 6} v 0) v1 -- 0x7f42e4068860 con 0x7f42e415d540 2023-11-28T17:39:11.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42e17fa640 1 -- 172.21.15.64:0/1816173045 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bf3d817c-92bc-4766-b6ac-9744af07da37", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42dc0bc020 con 0x7f42e415d540 2023-11-28T17:39:11.913 INFO:teuthology.orchestra.run.smithi064.stdout:6 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 msgr2=0x7f42e415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 0x7f42e415bf90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f42dc01a610 tx=0x7f42dc019780 comp rx=0 tx=0).stop 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 shutdown_connections 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42e415d540 0x7f42e415bf90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42e40d3690 0x7f42e415ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 --2- 172.21.15.64:0/1816173045 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42e40d1f50 0x7f42e40c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 >> 172.21.15.64:0/1816173045 conn(0x7f42e408ccf0 msgr2=0x7f42e406c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 shutdown_connections 2023-11-28T17:39:11.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:11.910+0000 7f42ead9d640 1 -- 172.21.15.64:0/1816173045 wait complete. 2023-11-28T17:39:11.932 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd new 16dfc0d6-76a7-4073-9451-0df56a576ab2 7 2023-11-28T17:39:11.952 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:11.952+0000 7fe9b2c2d180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T17:39:11.963 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:11.958+0000 7f4d1ae26180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T17:39:12.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 Processor -- start 2023-11-28T17:39:12.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 -- start start 2023-11-28T17:39:12.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4f940d34c0 0x7f4f940cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f940b32c0 con 0x7f4f9415d540 2023-11-28T17:39:12.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f940b30d0 con 0x7f4f940d34c0 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f9b017640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415d920 con 0x7f4f940d1f50 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:41856/0 (socket says 172.21.15.64:41856) 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 -- 172.21.15.64:0/1498640273 learned_addr learned my addr 172.21.15.64:0/1498640273 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f995b4640 1 --2- 172.21.15.64:0/1498640273 >> v2:172.21.15.16:3300/0 conn(0x7f4f940d34c0 0x7f4f940cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 -- 172.21.15.64:0/1498640273 >> v2:172.21.15.16:3300/0 conn(0x7f4f940d34c0 msgr2=0x7f4f940cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 --2- 172.21.15.64:0/1498640273 >> v2:172.21.15.16:3300/0 conn(0x7f4f940d34c0 0x7f4f940cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 -- 172.21.15.64:0/1498640273 >> v1:172.21.15.16:6789/0 conn(0x7f4f9415d540 legacy=0x7f4f940b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.102+0000 7f4f93fff640 1 -- 172.21.15.64:0/1498640273 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940b35a0 con 0x7f4f940d1f50 2023-11-28T17:39:12.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f93fff640 1 --2- 172.21.15.64:0/1498640273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940d2f80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009870 tx=0x7f4f8001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4eeb0f1718ac7932 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:12.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f937fe640 1 -- 172.21.15.64:0/1498640273 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800aa670 con 0x7f4f940d1f50 2023-11-28T17:39:12.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f937fe640 1 -- 172.21.15.64:0/1498640273 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f800aa7d0 con 0x7f4f940d1f50 2023-11-28T17:39:12.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f937fe640 1 -- 172.21.15.64:0/1498640273 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800aab60 con 0x7f4f940d1f50 2023-11-28T17:39:12.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 -- 172.21.15.64:0/1498640273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 msgr2=0x7f4f940d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1498640273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940d2f80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009870 tx=0x7f4f8001c510 comp rx=0 tx=0).stop 2023-11-28T17:39:12.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 -- 172.21.15.64:0/1498640273 shutdown_connections 2023-11-28T17:39:12.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1498640273 >> v2:172.21.15.16:3300/0 conn(0x7f4f940d34c0 0x7f4f940cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1498640273 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940d2f80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 -- 172.21.15.64:0/1498640273 >> 172.21.15.64:0/1498640273 conn(0x7f4f9408ccf0 msgr2=0x7f4f9409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:12.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 -- 172.21.15.64:0/1498640273 shutdown_connections 2023-11-28T17:39:12.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.106+0000 7f4f9b017640 1 -- 172.21.15.64:0/1498640273 wait complete. 2023-11-28T17:39:12.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 Processor -- start 2023-11-28T17:39:12.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 -- start start 2023-11-28T17:39:12.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940b6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f940d34c0 0x7f4f94153860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f9415d540 0x7f4f940b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415e150 con 0x7f4f9415d540 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f940b72e0 con 0x7f4f940d34c0 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9415db00 con 0x7f4f940d1f50 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940b6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f93fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f940d34c0 0x7f4f94153860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940b6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.64:41864/0 (socket says 172.21.15.64:41864) 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 -- 172.21.15.64:0/1623804824 learned_addr learned my addr 172.21.15.64:0/1623804824 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f995b4640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f9415d540 0x7f4f940b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 -- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f940d34c0 msgr2=0x7f4f94153860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f940d34c0 0x7f4f94153860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 -- 172.21.15.64:0/1623804824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f9415d540 msgr2=0x7f4f940b06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f9415d540 0x7f4f940b06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 -- 172.21.15.64:0/1623804824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f800094d0 con 0x7f4f940d1f50 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f93fff640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f940d34c0 0x7f4f94153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f98db3640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940b6ab0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800c3c0 tx=0x7f4f8800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f880052d0 con 0x7f4f940d1f50 2023-11-28T17:39:12.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f88005430 con 0x7f4f940d1f50 2023-11-28T17:39:12.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9415dde0 con 0x7f4f940d1f50 2023-11-28T17:39:12.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88003840 con 0x7f4f940d1f50 2023-11-28T17:39:12.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.110+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f94153da0 con 0x7f4f940d1f50 2023-11-28T17:39:12.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.114+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4f88003ca0 con 0x7f4f940d1f50 2023-11-28T17:39:12.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.114+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4f88012a80 con 0x7f4f940d1f50 2023-11-28T17:39:12.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.114+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f94068860 con 0x7f4f940d1f50 2023-11-28T17:39:12.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.114+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4f88017070 con 0x7f4f940d1f50 2023-11-28T17:39:12.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.182+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd new", "uuid": "16dfc0d6-76a7-4073-9451-0df56a576ab2", "id": 7} v 0) v1 -- 0x7f4f94159490 con 0x7f4f940d1f50 2023-11-28T17:39:12.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.186+0000 7f4f917fa640 1 -- 172.21.15.64:0/1623804824 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16dfc0d6-76a7-4073-9451-0df56a576ab2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4f88012420 con 0x7f4f940d1f50 2023-11-28T17:39:12.191 INFO:teuthology.orchestra.run.smithi064.stdout:7 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.186+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 msgr2=0x7f4f940b6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.186+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940b6ab0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800c3c0 tx=0x7f4f8800c880 comp rx=0 tx=0).stop 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 shutdown_connections 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4f9415d540 0x7f4f940b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f940d34c0 0x7f4f94153860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 --2- 172.21.15.64:0/1623804824 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4f940d1f50 0x7f4f940b6ab0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 >> 172.21.15.64:0/1623804824 conn(0x7f4f9408ccf0 msgr2=0x7f4f9406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:12.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 shutdown_connections 2023-11-28T17:39:12.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-11-28T17:39:12.190+0000 7f4f9b017640 1 -- 172.21.15.64:0/1623804824 wait complete. 2023-11-28T17:39:12.210 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T17:39:12.210 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T17:39:12.214 INFO:tasks.ceph.osd.0:Started 2023-11-28T17:39:12.214 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T17:39:12.214 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T17:39:12.219 INFO:tasks.ceph.osd.1:Started 2023-11-28T17:39:12.219 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T17:39:12.220 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T17:39:12.224 INFO:tasks.ceph.osd.2:Started 2023-11-28T17:39:12.225 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T17:39:12.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T17:39:12.229 INFO:tasks.ceph.osd.3:Started 2023-11-28T17:39:12.229 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T17:39:12.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T17:39:12.233 INFO:tasks.ceph.osd.4:Started 2023-11-28T17:39:12.233 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T17:39:12.233 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T17:39:12.236 INFO:tasks.ceph.osd.5:Started 2023-11-28T17:39:12.236 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T17:39:12.237 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T17:39:12.240 INFO:tasks.ceph.osd.6:Started 2023-11-28T17:39:12.240 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T17:39:12.240 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T17:39:12.245 INFO:tasks.ceph.osd.7:Started 2023-11-28T17:39:12.245 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:12.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 Processor -- start 2023-11-28T17:39:12.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 -- start start 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19dc0d1f50 0x7f19dc0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f19dc0d34c0 0x7f19dc0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0b32c0 con 0x7f19dc15d540 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc0b30d0 con 0x7f19dc0d1f50 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e30e3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc15d920 con 0x7f19dc0d34c0 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19dc0d1f50 0x7f19dc0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f19dc0d1f50 0x7f19dc0d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43170/0 (socket says 172.21.15.16:43170) 2023-11-28T17:39:12.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e0e7f640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f19dc15d540 0x7f19dc0b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56684/0 (socket says 172.21.15.16:56684) 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 -- 172.21.15.16:0/909142029 learned_addr learned my addr 172.21.15.16:0/909142029 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19e1680640 1 --2- 172.21.15.16:0/909142029 >> v2:172.21.15.64:3300/0 conn(0x7f19dc0d34c0 0x7f19dc0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 -- 172.21.15.16:0/909142029 >> v2:172.21.15.64:3300/0 conn(0x7f19dc0d34c0 msgr2=0x7f19dc0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 --2- 172.21.15.16:0/909142029 >> v2:172.21.15.64:3300/0 conn(0x7f19dc0d34c0 0x7f19dc0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 -- 172.21.15.16:0/909142029 >> v1:172.21.15.16:6789/0 conn(0x7f19dc15d540 legacy=0x7f19dc0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19dbfff640 1 -- 172.21.15.16:0/909142029 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0b35a0 con 0x7f19dc0d1f50 2023-11-28T17:39:12.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.480+0000 7f19db7fe640 1 -- 172.21.15.16:0/909142029 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832186969 0 0) 0x7f19dc0b32c0 con 0x7f19dc15d540 2023-11-28T17:39:12.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19dbfff640 1 --2- 172.21.15.16:0/909142029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0d2f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19dc160ee0 tx=0x7f19c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4788e825befba2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:12.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19db7fe640 1 -- 172.21.15.16:0/909142029 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c80aa430 con 0x7f19dc0d1f50 2023-11-28T17:39:12.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19db7fe640 1 -- 172.21.15.16:0/909142029 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c80aa590 con 0x7f19dc0d1f50 2023-11-28T17:39:12.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19db7fe640 1 -- 172.21.15.16:0/909142029 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c80aa920 con 0x7f19dc0d1f50 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 -- 172.21.15.16:0/909142029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc0d1f50 msgr2=0x7f19dc0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 --2- 172.21.15.16:0/909142029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0d2f80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f19dc160ee0 tx=0x7f19c801c4d0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 -- 172.21.15.16:0/909142029 shutdown_connections 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 --2- 172.21.15.16:0/909142029 >> v2:172.21.15.64:3300/0 conn(0x7f19dc0d34c0 0x7f19dc0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 --2- 172.21.15.16:0/909142029 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0d2f80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 -- 172.21.15.16:0/909142029 >> 172.21.15.16:0/909142029 conn(0x7f19dc08ccf0 msgr2=0x7f19dc09c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 -- 172.21.15.16:0/909142029 shutdown_connections 2023-11-28T17:39:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.484+0000 7f19e30e3640 1 -- 172.21.15.16:0/909142029 wait complete. 2023-11-28T17:39:12.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 Processor -- start 2023-11-28T17:39:12.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 -- start start 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19dc0d34c0 0x7f19dc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 0x7f19dc156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0ca5b0 con 0x7f19dc15d540 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0ca890 con 0x7f19dc0d1f50 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e30e3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc0cab70 con 0x7f19dc0d34c0 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 0x7f19dc156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e0e7f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 0x7f19dc156890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43186/0 (socket says 172.21.15.16:43186) 2023-11-28T17:39:12.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 -- 172.21.15.16:0/2166855703 learned_addr learned my addr 172.21.15.16:0/2166855703 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e0e7f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:52804/0 (socket says 172.21.15.16:52804) 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19dbfff640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19dc0d34c0 0x7f19dc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 -- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19dc0d34c0 msgr2=0x7f19dc0cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19dc0d34c0 0x7f19dc0cb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 -- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19dc0d1f50 msgr2=0x7f19dc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 -- 172.21.15.16:0/2166855703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c80094d0 con 0x7f19dc15d540 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19e1680640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 0x7f19dc156890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f19d400efc0 tx=0x7f19d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4014480 con 0x7f19dc15d540 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400f040 con 0x7f19dc15d540 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.488+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4014820 con 0x7f19dc15d540 2023-11-28T17:39:12.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.492+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc0cae50 con 0x7f19dc15d540 2023-11-28T17:39:12.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.492+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc156dd0 con 0x7f19dc15d540 2023-11-28T17:39:12.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.492+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f19d4014c80 con 0x7f19dc15d540 2023-11-28T17:39:12.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.492+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f19d4013ab0 con 0x7f19dc15d540 2023-11-28T17:39:12.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.492+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc0cb090 con 0x7f19dc15d540 2023-11-28T17:39:12.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.492+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f19dc0cb090 con 0x7f19dc15d540 2023-11-28T17:39:12.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19dc068860 con 0x7f19dc15d540 2023-11-28T17:39:12.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19d97fa640 1 -- 172.21.15.16:0/2166855703 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f19d4018020 con 0x7f19dc15d540 2023-11-28T17:39:12.553 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:12.554 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":10,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:12.188910+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:12.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 msgr2=0x7f19dc156890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 0x7f19dc156890 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f19d400efc0 tx=0x7f19d400c490 comp rx=0 tx=0).stop 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 shutdown_connections 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19dc15d540 0x7f19dc156890 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f19dc0d34c0 0x7f19dc0cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 --2- 172.21.15.16:0/2166855703 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19dc0d1f50 0x7f19dc0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 >> 172.21.15.16:0/2166855703 conn(0x7f19dc08ccf0 msgr2=0x7f19dc06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 shutdown_connections 2023-11-28T17:39:12.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:12.552+0000 7f19e30e3640 1 -- 172.21.15.16:0/2166855703 wait complete. 2023-11-28T17:39:12.573 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T17:39:12.573 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T17:39:12.605 INFO:tasks.ceph.mgr.x.smithi064.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T17:39:12.605 INFO:tasks.ceph.mgr.x.smithi064.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T17:39:12.605 INFO:tasks.ceph.mgr.x.smithi064.stderr: from numpy import show_config as show_numpy_config 2023-11-28T17:39:12.621 INFO:tasks.ceph.mgr.y.smithi016.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T17:39:12.621 INFO:tasks.ceph.mgr.y.smithi016.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T17:39:12.621 INFO:tasks.ceph.mgr.y.smithi016.stderr: from numpy import show_config as show_numpy_config 2023-11-28T17:39:12.669 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:12.668+0000 7fe9b2c2d180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T17:39:12.683 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:12.678+0000 7f4d1ae26180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T17:39:12.812 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:12.812+0000 7fe9b2c2d180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T17:39:12.825 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:12.822+0000 7f4d1ae26180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T17:39:12.913 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T17:39:12.912+0000 7f2fde759640 -1 Falling back to public interface 2023-11-28T17:39:12.914 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T17:39:12.912+0000 7fa0f19a9640 -1 Falling back to public interface 2023-11-28T17:39:12.914 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T17:39:12.912+0000 7f0233513640 -1 Falling back to public interface 2023-11-28T17:39:12.929 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T17:39:12.926+0000 7fc8c9b88640 -1 Falling back to public interface 2023-11-28T17:39:12.941 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T17:39:12.940+0000 7f1c688c1640 -1 Falling back to public interface 2023-11-28T17:39:12.945 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T17:39:12.942+0000 7f0a3910b640 -1 Falling back to public interface 2023-11-28T17:39:12.949 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T17:39:12.946+0000 7fe8a243d640 -1 Falling back to public interface 2023-11-28T17:39:12.981 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T17:39:12.978+0000 7f11fe22b640 -1 Falling back to public interface 2023-11-28T17:39:13.003 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:13.000+0000 7fe9b2c2d180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T17:39:13.009 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:13.006+0000 7f4d1ae26180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T17:39:13.079 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:13.076+0000 7fe9b2c2d180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T17:39:13.085 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:13.082+0000 7f4d1ae26180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T17:39:13.224 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:13.224+0000 7fe9b2c2d180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T17:39:13.230 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:13.226+0000 7f4d1ae26180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T17:39:13.378 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:13.512 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f02a525a640 1 Processor -- start 2023-11-28T17:39:13.513 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f02a525a640 1 -- start start 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f02a525a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f02a00cbd50 0x7f02a015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f02a525a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a015f160 con 0x7f02a0072090 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f02a525a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00cc130 con 0x7f02a00cee50 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f02a525a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a015be70 con 0x7f02a00cbd50 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029ed9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f02a00cbd50 0x7f02a015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029e59c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f02a0072090 0x7f02a015b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:56686/0 (socket says 172.21.15.16:56686) 2023-11-28T17:39:13.514 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029e59c640 1 -- 172.21.15.16:0/3918150402 learned_addr learned my addr 172.21.15.16:0/3918150402 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:13.515 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029ed9d640 1 -- 172.21.15.16:0/3918150402 >> v1:172.21.15.64:6789/0 conn(0x7f02a00cee50 legacy=0x7f02a00707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:13.515 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029ed9d640 1 -- 172.21.15.16:0/3918150402 >> v1:172.21.15.16:6789/0 conn(0x7f02a0072090 legacy=0x7f02a015b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:13.515 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029ed9d640 1 -- 172.21.15.16:0/3918150402 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a015c0d0 con 0x7f02a00cbd50 2023-11-28T17:39:13.515 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.512+0000 7f029dd9b640 1 -- 172.21.15.16:0/3918150402 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 286758995 0 0) 0x7f02a015f160 con 0x7f02a0072090 2023-11-28T17:39:13.517 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f029ed9d640 1 --2- 172.21.15.16:0/3918150402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a00cbd50 0x7f02a015f5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f02900097c0 tx=0x7f029001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1bb1b13ff3191 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:13.517 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f029dd9b640 1 -- 172.21.15.16:0/3918150402 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900ad660 con 0x7f02a00cbd50 2023-11-28T17:39:13.517 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f029dd9b640 1 -- 172.21.15.16:0/3918150402 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900ad7c0 con 0x7f02a00cbd50 2023-11-28T17:39:13.518 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f029dd9b640 1 -- 172.21.15.16:0/3918150402 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900adb50 con 0x7f02a00cbd50 2023-11-28T17:39:13.518 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 -- 172.21.15.16:0/3918150402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a00cbd50 msgr2=0x7f02a015f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:13.519 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 --2- 172.21.15.16:0/3918150402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a00cbd50 0x7f02a015f5f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f02900097c0 tx=0x7f029001c450 comp rx=0 tx=0).stop 2023-11-28T17:39:13.519 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 -- 172.21.15.16:0/3918150402 shutdown_connections 2023-11-28T17:39:13.519 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 --2- 172.21.15.16:0/3918150402 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a00cbd50 0x7f02a015f5f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.520 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 -- 172.21.15.16:0/3918150402 >> 172.21.15.16:0/3918150402 conn(0x7f02a006a550 msgr2=0x7f02a006a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:13.520 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 -- 172.21.15.16:0/3918150402 shutdown_connections 2023-11-28T17:39:13.520 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.516+0000 7f02a525a640 1 -- 172.21.15.16:0/3918150402 wait complete. 2023-11-28T17:39:13.520 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 Processor -- start 2023-11-28T17:39:13.520 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 -- start start 2023-11-28T17:39:13.522 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 0x7f02a0137d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:13.522 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02a00cbd50 0x7f02a014a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02a00cee50 0x7f02a015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a00b3c50 con 0x7f02a0072090 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a01382a0 con 0x7f02a00cbd50 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0149c00 con 0x7f02a00cee50 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 0x7f02a0137d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02a00cbd50 0x7f02a014a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 0x7f02a0137d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:43202/0 (socket says 172.21.15.16:43202) 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 -- 172.21.15.16:0/1288813221 learned_addr learned my addr 172.21.15.16:0/1288813221 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:13.523 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029f59e640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02a00cee50 0x7f02a015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:13.524 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 -- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02a00cee50 msgr2=0x7f02a015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:13.524 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02a00cee50 0x7f02a015d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.524 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 -- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02a00cbd50 msgr2=0x7f02a014a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:13.524 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02a00cbd50 0x7f02a014a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.524 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 -- 172.21.15.16:0/1288813221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0290009420 con 0x7f02a0072090 2023-11-28T17:39:13.524 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f029ed9d640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 0x7f02a0137d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0290019060 tx=0x7f02900191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900b6820 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02900b69a0 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900b6d50 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a00cf7f0 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a00b32b0 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f02900b4040 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.520+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f02900ad5e0 con 0x7f02a0072090 2023-11-28T17:39:13.525 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.524+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a00b3d90 con 0x7f02a0072090 2023-11-28T17:39:13.526 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.524+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f02a00b3d90 con 0x7f02a0072090 2023-11-28T17:39:13.586 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f02a00688d0 con 0x7f02a0072090 2023-11-28T17:39:13.586 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02877fe640 1 -- 172.21.15.16:0/1288813221 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f02900c4060 con 0x7f02a0072090 2023-11-28T17:39:13.587 INFO:teuthology.misc.health.smithi016.stdout: 2023-11-28T17:39:13.587 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":10,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:12.188910+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 msgr2=0x7f02a0137d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 0x7f02a0137d60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0290019060 tx=0x7f02900191f0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 shutdown_connections 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f02a00cee50 0x7f02a015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02a00cbd50 0x7f02a014a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 --2- 172.21.15.16:0/1288813221 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f02a0072090 0x7f02a0137d60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:13.588 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 >> 172.21.15.16:0/1288813221 conn(0x7f02a006a550 msgr2=0x7f02a006a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:13.589 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 shutdown_connections 2023-11-28T17:39:13.589 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:13.584+0000 7f02a525a640 1 -- 172.21.15.16:0/1288813221 wait complete. 2023-11-28T17:39:13.606 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T17:39:13.949 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:13.946+0000 7f4d1ae26180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T17:39:13.964 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:13.964+0000 7fe9b2c2d180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T17:39:14.040 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:14.034+0000 7f4d1ae26180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T17:39:14.056 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:14.052+0000 7fe9b2c2d180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T17:39:14.242 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:14.238+0000 7f4d1ae26180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T17:39:14.258 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:14.256+0000 7fe9b2c2d180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T17:39:14.330 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:14.326+0000 7f4d1ae26180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T17:39:14.347 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:14.344+0000 7fe9b2c2d180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T17:39:14.675 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:14.670+0000 7f4d1ae26180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T17:39:14.695 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:14.692+0000 7fe9b2c2d180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T17:39:14.746 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:14.742+0000 7f4d1ae26180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T17:39:14.770 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-28T17:39:14.768+0000 7fe9b2c2d180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T17:39:15.769 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:15.766+0000 7f4cc24a1640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T17:39:15.769 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-28T17:39:15.766+0000 7f4cc24a1640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T17:39:16.737 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T17:39:16.734+0000 7fc8c9b88640 -1 osd.7 0 log_to_monitors true 2023-11-28T17:39:16.758 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T17:39:16.756+0000 7f0233513640 -1 osd.1 0 log_to_monitors true 2023-11-28T17:39:16.855 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T17:39:16.850+0000 7f0a3910b640 -1 osd.4 0 log_to_monitors true 2023-11-28T17:39:16.900 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T17:39:16.900+0000 7fa0f19a9640 -1 osd.0 0 log_to_monitors true 2023-11-28T17:39:16.902 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T17:39:16.898+0000 7f11fe22b640 -1 osd.6 0 log_to_monitors true 2023-11-28T17:39:17.059 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T17:39:17.056+0000 7f2fde759640 -1 osd.2 0 log_to_monitors true 2023-11-28T17:39:17.060 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T17:39:17.058+0000 7fe8a243d640 -1 osd.5 0 log_to_monitors true 2023-11-28T17:39:17.087 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T17:39:17.084+0000 7f1c688c1640 -1 osd.3 0 log_to_monitors true 2023-11-28T17:39:18.934 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T17:39:18.929+0000 7fc8c5310640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T17:39:19.101 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T17:39:19.097+0000 7fc8bd95d640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.414 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:20.643 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.640+0000 7f9d995b8640 1 Processor -- start 2023-11-28T17:39:20.645 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.640+0000 7f9d995b8640 1 -- start start 2023-11-28T17:39:20.646 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d995b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9d9415d580 0x7f9d940d3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.646 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d995b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940d0560 0x7f9d940d1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.646 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d995b8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d940b0ec0 con 0x7f9d940d1da0 2023-11-28T17:39:20.646 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d995b8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d940d2230 con 0x7f9d9415d580 2023-11-28T17:39:20.646 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d995b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940d40f0 con 0x7f9d940d0560 2023-11-28T17:39:20.648 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d937fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9d940d1da0 0x7f9d941611d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34374/0 (socket says 172.21.15.16:34374) 2023-11-28T17:39:20.648 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d937fe640 1 -- 172.21.15.16:0/3545634275 learned_addr learned my addr 172.21.15.16:0/3545634275 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:20.648 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850499545 0 0) 0x7f9d940b0ec0 con 0x7f9d940d1da0 2023-11-28T17:39:20.648 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d7c003530 con 0x7f9d940d1da0 2023-11-28T17:39:20.648 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d92ffd640 1 --2- 172.21.15.16:0/3545634275 >> v2:172.21.15.16:3300/0 conn(0x7f9d9415d580 0x7f9d940d3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 259186116 0 0) 0x7f9d7c003530 con 0x7f9d940d1da0 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940d0560 msgr2=0x7f9d940d1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940d0560 0x7f9d940d1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 >> v2:172.21.15.16:3300/0 conn(0x7f9d9415d580 msgr2=0x7f9d940d3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 --2- 172.21.15.16:0/3545634275 >> v2:172.21.15.16:3300/0 conn(0x7f9d9415d580 0x7f9d940d3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940cdfa0 con 0x7f9d940d1da0 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f9d8c001a00 con 0x7f9d940d1da0 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 >> v1:172.21.15.16:6789/0 conn(0x7f9d940d1da0 legacy=0x7f9d941611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:20.649 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7c0039f0 0x7f9d7c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0047d0 0x7f9d7c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d7c0052b0 0x7f9d7c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940d2230 con 0x7f9d7c0047d0 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940d40f0 con 0x7f9d7c0039f0 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c00c1b0 con 0x7f9d7c0052b0 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.644+0000 7f9d92ffd640 1 --2- 172.21.15.16:0/3545634275 >> v2:172.21.15.16:3300/0 conn(0x7f9d9415d580 0x7f9d940d3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:20.650 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d927fc640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0047d0 0x7f9d7c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d937fe640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d7c0052b0 0x7f9d7c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d92ffd640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7c0039f0 0x7f9d7c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d937fe640 1 -- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7c0039f0 msgr2=0x7f9d7c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d937fe640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7c0039f0 0x7f9d7c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d937fe640 1 -- 172.21.15.16:0/3545634275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0047d0 msgr2=0x7f9d7c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d937fe640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0047d0 0x7f9d7c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.651 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d937fe640 1 -- 172.21.15.16:0/3545634275 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940cdfa0 con 0x7f9d7c0052b0 2023-11-28T17:39:20.652 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.648+0000 7f9d92ffd640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d7c0039f0 0x7f9d7c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:20.653 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d937fe640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d7c0052b0 0x7f9d7c00b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00a8a0 tx=0x7f9d8c01d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c45572f47a89b20e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:20.653 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0ad430 con 0x7f9d7c0052b0 2023-11-28T17:39:20.654 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c0a8070 con 0x7f9d7c0052b0 2023-11-28T17:39:20.654 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d91ffb640 1 -- 172.21.15.16:0/3545634275 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c0ad7f0 con 0x7f9d7c0052b0 2023-11-28T17:39:20.655 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d995b8640 1 -- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d7c0052b0 msgr2=0x7f9d7c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:20.655 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d995b8640 1 --2- 172.21.15.16:0/3545634275 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d7c0052b0 0x7f9d7c00b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00a8a0 tx=0x7f9d8c01d330 comp rx=0 tx=0).stop 2023-11-28T17:39:20.655 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d937fe640 1 -- 172.21.15.16:0/3545634275 reap_dead start 2023-11-28T17:39:20.656 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d995b8640 1 -- 172.21.15.16:0/3545634275 shutdown_connections 2023-11-28T17:39:20.656 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d995b8640 1 -- 172.21.15.16:0/3545634275 >> 172.21.15.16:0/3545634275 conn(0x7f9d9409c550 msgr2=0x7f9d940d3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:20.656 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.652+0000 7f9d995b8640 1 -- 172.21.15.16:0/3545634275 shutdown_connections 2023-11-28T17:39:20.656 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.656+0000 7f9d995b8640 1 -- 172.21.15.16:0/3545634275 wait complete. 2023-11-28T17:39:20.660 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.656+0000 7f9d995b8640 1 Processor -- start 2023-11-28T17:39:20.664 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.660+0000 7f9d995b8640 1 -- start start 2023-11-28T17:39:20.667 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d995b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0052b0 0x7f9d9414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d995b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940b21d0 0x7f9d940b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d995b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d940cbf40 0x7f9d940cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d995b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940b2b70 con 0x7f9d7c0052b0 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d995b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940ccce0 con 0x7f9d940cbf40 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d995b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9415e2b0 con 0x7f9d940b21d0 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d92ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0052b0 0x7f9d9414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.668 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d92ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0052b0 0x7f9d9414d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60588/0 (socket says 172.21.15.16:60588) 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d92ffd640 1 -- 172.21.15.16:0/1795895120 learned_addr learned my addr 172.21.15.16:0/1795895120 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d927fc640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940b21d0 0x7f9d940b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d927fc640 1 -- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d940cbf40 msgr2=0x7f9d940cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d927fc640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d940cbf40 0x7f9d940cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d927fc640 1 -- 172.21.15.16:0/1795895120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0052b0 msgr2=0x7f9d9414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d927fc640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0052b0 0x7f9d9414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.669 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.664+0000 7f9d927fc640 1 -- 172.21.15.16:0/1795895120 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940cf1c0 con 0x7f9d940b21d0 2023-11-28T17:39:20.670 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.668+0000 7f9d927fc640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940b21d0 0x7f9d940b2630 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d9408b750 tx=0x7f9d8401f920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:20.670 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.668+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84024890 con 0x7f9d940b21d0 2023-11-28T17:39:20.670 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.668+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d840249f0 con 0x7f9d940b21d0 2023-11-28T17:39:20.670 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.668+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d84024890 con 0x7f9d940b21d0 2023-11-28T17:39:20.671 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.668+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9415e590 con 0x7f9d940b21d0 2023-11-28T17:39:20.672 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.672+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9415eb50 con 0x7f9d940b21d0 2023-11-28T17:39:20.677 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.672+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 4) v1 ==== 86114+0+0 (secure 0 0 0) 0x7f9d84024b60 con 0x7f9d940b21d0 2023-11-28T17:39:20.677 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.676+0000 7f9d7b7fe640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9d800668a0 0x7f9d80068d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:20.677 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.676+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f9d840940d0 con 0x7f9d940b21d0 2023-11-28T17:39:20.679 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.676+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9415ed70 con 0x7f9d940b21d0 2023-11-28T17:39:20.680 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.676+0000 7f9d92ffd640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9d800668a0 0x7f9d80068d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:20.681 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.680+0000 7f9d92ffd640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9d800668a0 0x7f9d80068d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009a10 tx=0x7f9d88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:20.693 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.692+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9d84028080 con 0x7f9d940b21d0 2023-11-28T17:39:20.722 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T17:39:20.720+0000 7f2fd9edf640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T17:39:20.728 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T17:39:20.728+0000 7f2fd9edf640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T17:39:20.740 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T17:39:20.733+0000 7f0a34891640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T17:39:20.753 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T17:39:20.749+0000 7f11f8f92640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T17:39:20.765 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T17:39:20.764+0000 7f2fd252c640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.766 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T17:39:20.761+0000 7f0a2cede640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.782 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T17:39:20.777+0000 7f11f15df640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.813 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T17:39:20.809+0000 7fe89dbc5640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T17:39:20.829 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T17:39:20.828+0000 7fa0ee965640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T17:39:20.835 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T17:39:20.832+0000 7f022ec99640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T17:39:20.837 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T17:39:20.833+0000 7fe896212640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.860 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T17:39:20.856+0000 7f1c64049640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T17:39:20.865 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T17:39:20.864+0000 7fa0e577c640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.885 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T17:39:20.884+0000 7f02272e6640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.893 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T17:39:20.892+0000 7f1c5c696640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T17:39:20.920 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d9404e900 con 0x7f9d940b21d0 2023-11-28T17:39:20.921 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d7b7fe640 1 -- 172.21.15.16:0/1795895120 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7542 (secure 0 0 0) 0x7f9d84032030 con 0x7f9d940b21d0 2023-11-28T17:39:20.921 INFO:teuthology.misc.health.smithi016.stdout: 2023-11-28T17:39:20.921 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":14,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:19.953487+0000","last_up_change":"2023-11-28T17:39:19.953487+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:20.923 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9d800668a0 msgr2=0x7f9d80068d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:20.923 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9d800668a0 0x7f9d80068d60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009a10 tx=0x7f9d88008040 comp rx=0 tx=0).stop 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940b21d0 msgr2=0x7f9d940b2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940b21d0 0x7f9d940b2630 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9d9408b750 tx=0x7f9d8401f920 comp rx=0 tx=0).stop 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 shutdown_connections 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9d800668a0 0x7f9d80068d60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d940cbf40 0x7f9d940cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d940b21d0 0x7f9d940b2630 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 --2- 172.21.15.16:0/1795895120 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9d7c0052b0 0x7f9d9414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 >> 172.21.15.16:0/1795895120 conn(0x7f9d9409c550 msgr2=0x7f9d94162510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 shutdown_connections 2023-11-28T17:39:20.924 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:20.920+0000 7f9d995b8640 1 -- 172.21.15.16:0/1795895120 wait complete. 2023-11-28T17:39:20.941 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-11-28T17:39:27.747 DEBUG:teuthology.orchestra.run.smithi016:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:27.890 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 Processor -- start 2023-11-28T17:39:27.890 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 -- start start 2023-11-28T17:39:27.892 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3fec0ceea0 0x7f3fec0cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:27.892 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fec0b2ea0 0x7f3fec162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:27.892 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fec0b2a10 con 0x7f3fec1629a0 2023-11-28T17:39:27.892 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec15c1d0 con 0x7f3fec0b2ea0 2023-11-28T17:39:27.893 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.888+0000 7f3ff419d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fec0b2400 con 0x7f3fec0ceea0 2023-11-28T17:39:27.893 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fec0b2ea0 0x7f3fec162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:27.893 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fec0b2ea0 0x7f3fec162ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32814/0 (socket says 172.21.15.16:32814) 2023-11-28T17:39:27.893 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 -- 172.21.15.16:0/314621352 learned_addr learned my addr 172.21.15.16:0/314621352 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:27.893 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff1f39640 1 --2- 172.21.15.16:0/314621352 >> v2:172.21.15.64:3300/0 conn(0x7f3fec0ceea0 0x7f3fec0cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:27.894 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 -- 172.21.15.16:0/314621352 >> v2:172.21.15.64:3300/0 conn(0x7f3fec0ceea0 msgr2=0x7f3fec0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:27.894 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 --2- 172.21.15.16:0/314621352 >> v2:172.21.15.64:3300/0 conn(0x7f3fec0ceea0 0x7f3fec0cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:27.894 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 -- 172.21.15.16:0/314621352 >> v1:172.21.15.64:6789/0 conn(0x7f3fec1629a0 legacy=0x7f3fec070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:27.895 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 -- 172.21.15.16:0/314621352 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fec0cf7c0 con 0x7f3fec0b2ea0 2023-11-28T17:39:27.896 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff273a640 1 --2- 172.21.15.16:0/314621352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0b2ea0 0x7f3fec162ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3fec06e150 tx=0x7f3fe401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58792cf6150a4275 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:27.896 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff0f37640 1 -- 172.21.15.16:0/314621352 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a5890 con 0x7f3fec0b2ea0 2023-11-28T17:39:27.896 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff0f37640 1 -- 172.21.15.16:0/314621352 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe40a59f0 con 0x7f3fec0b2ea0 2023-11-28T17:39:27.896 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.892+0000 7f3ff0f37640 1 -- 172.21.15.16:0/314621352 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe40a5d80 con 0x7f3fec0b2ea0 2023-11-28T17:39:27.897 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- 172.21.15.16:0/314621352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0b2ea0 msgr2=0x7f3fec162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:27.897 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 --2- 172.21.15.16:0/314621352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0b2ea0 0x7f3fec162ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3fec06e150 tx=0x7f3fe401c9d0 comp rx=0 tx=0).stop 2023-11-28T17:39:27.897 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- 172.21.15.16:0/314621352 shutdown_connections 2023-11-28T17:39:27.897 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 --2- 172.21.15.16:0/314621352 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0b2ea0 0x7f3fec162ec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:27.898 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 --2- 172.21.15.16:0/314621352 >> v2:172.21.15.64:3300/0 conn(0x7f3fec0ceea0 0x7f3fec0cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:27.898 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- 172.21.15.16:0/314621352 >> 172.21.15.16:0/314621352 conn(0x7f3fec06a550 msgr2=0x7f3fec06a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:27.898 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- 172.21.15.16:0/314621352 shutdown_connections 2023-11-28T17:39:27.898 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- 172.21.15.16:0/314621352 wait complete. 2023-11-28T17:39:27.898 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 Processor -- start 2023-11-28T17:39:27.899 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- start start 2023-11-28T17:39:27.900 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fec0b2ea0 0x7f3fec15edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:27.900 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 0x7f3fec154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:27.900 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fec1629a0 0x7f3fec155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:27.900 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15e030 con 0x7f3fec0ceea0 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15e310 con 0x7f3fec1629a0 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff419d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fec15e5f0 con 0x7f3fec0b2ea0 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff1738640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 0x7f3fec154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff1738640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 0x7f3fec154ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32826/0 (socket says 172.21.15.16:32826) 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff1738640 1 -- 172.21.15.16:0/2774101427 learned_addr learned my addr 172.21.15.16:0/2774101427 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff1f39640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fec0b2ea0 0x7f3fec15edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:27.901 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.896+0000 7f3ff273a640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fec1629a0 0x7f3fec155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:27.902 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1738640 1 -- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fec0b2ea0 msgr2=0x7f3fec15edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:27.902 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1738640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fec0b2ea0 0x7f3fec15edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:27.902 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1738640 1 -- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fec1629a0 msgr2=0x7f3fec155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:27.902 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1738640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fec1629a0 0x7f3fec155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:27.902 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1738640 1 -- 172.21.15.16:0/2774101427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4009b30 con 0x7f3fec0ceea0 2023-11-28T17:39:27.902 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1738640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 0x7f3fec154ee0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c500 tx=0x7f3fdc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:27.903 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc005220 con 0x7f3fec0ceea0 2023-11-28T17:39:27.904 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc005380 con 0x7f3fec0ceea0 2023-11-28T17:39:27.904 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007270 con 0x7f3fec0ceea0 2023-11-28T17:39:27.904 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fec163990 con 0x7f3fec0ceea0 2023-11-28T17:39:27.904 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fec15c940 con 0x7f3fec0ceea0 2023-11-28T17:39:27.905 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fec067a50 con 0x7f3fec0ceea0 2023-11-28T17:39:27.905 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3fdc0073d0 con 0x7f3fec0ceea0 2023-11-28T17:39:27.905 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3fe27fc640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fd00668d0 0x7f3fd0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:27.905 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3fdc083940 con 0x7f3fec0ceea0 2023-11-28T17:39:27.906 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.900+0000 7f3ff1f39640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fd00668d0 0x7f3fd0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:27.906 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.904+0000 7f3ff1f39640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fd00668d0 0x7f3fd0068d90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009b60 tx=0x7f3fe8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:27.908 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:27.908+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3fdc050ef0 con 0x7f3fec0ceea0 2023-11-28T17:39:28.066 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.064+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fec15e170 con 0x7f3fec0ceea0 2023-11-28T17:39:28.067 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.064+0000 7f3fe27fc640 1 -- 172.21.15.16:0/2774101427 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f3fec15e170 con 0x7f3fec0ceea0 2023-11-28T17:39:28.068 INFO:teuthology.misc.health.smithi016.stdout: 2023-11-28T17:39:28.068 INFO:teuthology.misc.health.smithi016.stdout:{"epoch":18,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:24.844223+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fd00668d0 msgr2=0x7f3fd0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fd00668d0 0x7f3fd0068d90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8009b60 tx=0x7f3fe8009190 comp rx=0 tx=0).stop 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 msgr2=0x7f3fec154ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 0x7f3fec154ee0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc00c500 tx=0x7f3fdc00c9c0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 shutdown_connections 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fd00668d0 0x7f3fd0068d90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fec1629a0 0x7f3fec155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fec0ceea0 0x7f3fec154ee0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 --2- 172.21.15.16:0/2774101427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fec0b2ea0 0x7f3fec15edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.070 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 >> 172.21.15.16:0/2774101427 conn(0x7f3fec06a550 msgr2=0x7f3fec070410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:28.071 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 shutdown_connections 2023-11-28T17:39:28.071 INFO:teuthology.misc.health.smithi016.stderr:2023-11-28T17:39:28.068+0000 7f3ff419d640 1 -- 172.21.15.16:0/2774101427 wait complete. 2023-11-28T17:39:28.088 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T17:39:28.088 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T17:39:28.088 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T17:39:28.089 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T17:39:28.098 INFO:tasks.ceph.mds.a:Started 2023-11-28T17:39:28.098 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T17:39:28.098 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T17:39:28.102 INFO:tasks.ceph.mds.c:Started 2023-11-28T17:39:28.102 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T17:39:28.102 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T17:39:28.106 INFO:tasks.ceph.mds.b:Started 2023-11-28T17:39:28.106 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T17:39:28.106 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T17:39:28.110 INFO:tasks.ceph.mds.d:Started 2023-11-28T17:39:28.110 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T17:39:28.110 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:28.195 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2023-11-28T17:39:28.196 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2023-11-28T17:39:28.214 INFO:tasks.ceph.mds.d.smithi064.stdout:starting mds.d at 2023-11-28T17:39:28.215 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2023-11-28T17:39:28.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b0acc9640 1 Processor -- start 2023-11-28T17:39:28.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b0acc9640 1 -- start start 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b0acc9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2b04072090 0x7f2b040cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b0acc9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0415a8b0 con 0x7f2b0415b350 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b0acc9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b040cea50 con 0x7f2b041548e0 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b0acc9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040ce860 con 0x7f2b04072090 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b03fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2b04072090 0x7f2b040cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b03fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2b04072090 0x7f2b040cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32872/0 (socket says 172.21.15.16:32872) 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b09266640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2b0415b350 0x7f2b040cc970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58012/0 (socket says 172.21.15.16:58012) 2023-11-28T17:39:28.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b03fff640 1 -- 172.21.15.16:0/687281021 learned_addr learned my addr 172.21.15.16:0/687281021 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:28.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b03fff640 1 -- 172.21.15.16:0/687281021 >> v1:172.21.15.64:6789/0 conn(0x7f2b041548e0 legacy=0x7f2b040ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b03fff640 1 -- 172.21.15.16:0/687281021 >> v1:172.21.15.16:6789/0 conn(0x7f2b0415b350 legacy=0x7f2b040cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b03fff640 1 -- 172.21.15.16:0/687281021 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0415ab50 con 0x7f2b04072090 2023-11-28T17:39:28.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.260+0000 7f2b037fe640 1 -- 172.21.15.16:0/687281021 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469920390 0 0) 0x7f2b0415a8b0 con 0x7f2b0415b350 2023-11-28T17:39:28.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b03fff640 1 --2- 172.21.15.16:0/687281021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b04072090 0x7f2b040cef30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2af000bb10 tx=0x7f2af001ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207ae435c64dfc94 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b037fe640 1 -- 172.21.15.16:0/687281021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00a7ae0 con 0x7f2b04072090 2023-11-28T17:39:28.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b037fe640 1 -- 172.21.15.16:0/687281021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af00a7c40 con 0x7f2b04072090 2023-11-28T17:39:28.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b037fe640 1 -- 172.21.15.16:0/687281021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00af440 con 0x7f2b04072090 2023-11-28T17:39:28.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 -- 172.21.15.16:0/687281021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b04072090 msgr2=0x7f2b040cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/687281021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b04072090 0x7f2b040cef30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2af000bb10 tx=0x7f2af001ec10 comp rx=0 tx=0).stop 2023-11-28T17:39:28.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 -- 172.21.15.16:0/687281021 shutdown_connections 2023-11-28T17:39:28.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/687281021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b04072090 0x7f2b040cef30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 -- 172.21.15.16:0/687281021 >> 172.21.15.16:0/687281021 conn(0x7f2b0406a5a0 msgr2=0x7f2b0406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:28.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 -- 172.21.15.16:0/687281021 shutdown_connections 2023-11-28T17:39:28.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.264+0000 7f2b0acc9640 1 -- 172.21.15.16:0/687281021 wait complete. 2023-11-28T17:39:28.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 Processor -- start 2023-11-28T17:39:28.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 -- start start 2023-11-28T17:39:28.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2b04072090 0x7f2b04149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 0x7f2b040a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b0415b350 0x7f2b0414fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b041593b0 con 0x7f2b041548e0 2023-11-28T17:39:28.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0414a120 con 0x7f2b0415b350 2023-11-28T17:39:28.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0414c670 con 0x7f2b04072090 2023-11-28T17:39:28.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 0x7f2b040a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 0x7f2b040a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32882/0 (socket says 172.21.15.16:32882) 2023-11-28T17:39:28.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 -- 172.21.15.16:0/3292542958 learned_addr learned my addr 172.21.15.16:0/3292542958 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:28.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b08a65640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2b04072090 0x7f2b04149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b09266640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b0415b350 0x7f2b0414fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 -- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2b04072090 msgr2=0x7f2b04149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2b04072090 0x7f2b04149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 -- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b0415b350 msgr2=0x7f2b0414fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b0415b350 0x7f2b0414fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 -- 172.21.15.16:0/3292542958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af000b770 con 0x7f2b041548e0 2023-11-28T17:39:28.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b03fff640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 0x7f2b040a84a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2af000b2c0 tx=0x7f2af001b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00a7ae0 con 0x7f2b041548e0 2023-11-28T17:39:28.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0004020 con 0x7f2b041548e0 2023-11-28T17:39:28.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b041590d0 con 0x7f2b041548e0 2023-11-28T17:39:28.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0004390 con 0x7f2b041548e0 2023-11-28T17:39:28.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.268+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b0414c300 con 0x7f2b041548e0 2023-11-28T17:39:28.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.272+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0414be80 con 0x7f2b041548e0 2023-11-28T17:39:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.272+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2af00b6070 con 0x7f2b041548e0 2023-11-28T17:39:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.272+0000 7f2b017fa640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ae8066900 0x7f2ae8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.272+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2af011eba0 con 0x7f2b041548e0 2023-11-28T17:39:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.272+0000 7f2b08a65640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ae8066900 0x7f2ae8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.272+0000 7f2b08a65640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ae8066900 0x7f2ae8068dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2af8007fd0 tx=0x7f2af8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.276+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b0414be80 con 0x7f2b041548e0 2023-11-28T17:39:28.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b0414be80 con 0x7f2b041548e0 2023-11-28T17:39:28.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b017fa640 1 -- 172.21.15.16:0/3292542958 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f2b0414be80 con 0x7f2b041548e0 2023-11-28T17:39:28.442 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:28.442 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:24.844223+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ae8066900 msgr2=0x7f2ae8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ae8066900 0x7f2ae8068dc0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2af8007fd0 tx=0x7f2af8009040 comp rx=0 tx=0).stop 2023-11-28T17:39:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 msgr2=0x7f2b040a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 0x7f2b040a84a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2af000b2c0 tx=0x7f2af001b9b0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 shutdown_connections 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ae8066900 0x7f2ae8068dc0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2b0415b350 0x7f2b0414fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2b041548e0 0x7f2b040a84a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 --2- 172.21.15.16:0/3292542958 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2b04072090 0x7f2b04149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 >> 172.21.15.16:0/3292542958 conn(0x7f2b0406a5a0 msgr2=0x7f2b0406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 shutdown_connections 2023-11-28T17:39:28.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.440+0000 7f2b0acc9640 1 -- 172.21.15.16:0/3292542958 wait complete. 2023-11-28T17:39:28.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:39:28.463 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:39:28.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 Processor -- start 2023-11-28T17:39:28.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 -- start start 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f929c072090 0x7f929c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929c15a8b0 con 0x7f929c1548e0 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929c0ce860 con 0x7f929c072090 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f92a1479640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c15a6a0 con 0x7f929c15b350 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f929affd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f929c1548e0 0x7f929c0ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58024/0 (socket says 172.21.15.16:58024) 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f929affd640 1 -- 172.21.15.16:0/736286508 learned_addr learned my addr 172.21.15.16:0/736286508 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f9293fff640 1 --2- 172.21.15.16:0/736286508 >> v2:172.21.15.16:3300/0 conn(0x7f929c072090 0x7f929c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f929b7fe640 1 --2- 172.21.15.16:0/736286508 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f9293fff640 1 -- 172.21.15.16:0/736286508 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 msgr2=0x7f929c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:28.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f9293fff640 1 --2- 172.21.15.16:0/736286508 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f9293fff640 1 -- 172.21.15.16:0/736286508 >> v1:172.21.15.16:6789/0 conn(0x7f929c1548e0 legacy=0x7f929c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f929a7fc640 1 -- 172.21.15.16:0/736286508 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872797513 0 0) 0x7f929c15a8b0 con 0x7f929c1548e0 2023-11-28T17:39:28.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.608+0000 7f9293fff640 1 -- 172.21.15.16:0/736286508 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929c0cea50 con 0x7f929c072090 2023-11-28T17:39:28.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f9293fff640 1 --2- 172.21.15.16:0/736286508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c072090 0x7f929c0cef30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92840097c0 tx=0x7f928401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a6a6b51f7d22ee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f929a7fc640 1 -- 172.21.15.16:0/736286508 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840ab600 con 0x7f929c072090 2023-11-28T17:39:28.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f929a7fc640 1 -- 172.21.15.16:0/736286508 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840a7050 con 0x7f929c072090 2023-11-28T17:39:28.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f929a7fc640 1 -- 172.21.15.16:0/736286508 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840ab980 con 0x7f929c072090 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 -- 172.21.15.16:0/736286508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c072090 msgr2=0x7f929c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 --2- 172.21.15.16:0/736286508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c072090 0x7f929c0cef30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f92840097c0 tx=0x7f928401c480 comp rx=0 tx=0).stop 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 -- 172.21.15.16:0/736286508 shutdown_connections 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 --2- 172.21.15.16:0/736286508 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 --2- 172.21.15.16:0/736286508 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c072090 0x7f929c0cef30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 -- 172.21.15.16:0/736286508 >> 172.21.15.16:0/736286508 conn(0x7f929c06a5a0 msgr2=0x7f929c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 -- 172.21.15.16:0/736286508 shutdown_connections 2023-11-28T17:39:28.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.612+0000 7f92a1479640 1 -- 172.21.15.16:0/736286508 wait complete. 2023-11-28T17:39:28.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 Processor -- start 2023-11-28T17:39:28.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- start start 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929c072090 0x7f929c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 0x7f929c14a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c142ff0 con 0x7f929c1548e0 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b2450 con 0x7f929c072090 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929c0b2730 con 0x7f929c15b350 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 0x7f929c14a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 0x7f929c14a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32900/0 (socket says 172.21.15.16:32900) 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 -- 172.21.15.16:0/2898223720 learned_addr learned my addr 172.21.15.16:0/2898223720 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 -- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 msgr2=0x7f929c14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f929b7fe640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f929affd640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929c072090 0x7f929c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 -- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929c072090 msgr2=0x7f929c1487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929c072090 0x7f929c1487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 -- 172.21.15.16:0/2898223720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9284009420 con 0x7f929c1548e0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f929b7fe640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f929affd640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929c072090 0x7f929c1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f9293fff640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 0x7f929c14a200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f928401a0b0 tx=0x7f9284019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840b4610 con 0x7f929c1548e0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840abe90 con 0x7f929c1548e0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840b49d0 con 0x7f929c1548e0 2023-11-28T17:39:28.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929c1432b0 con 0x7f929c1548e0 2023-11-28T17:39:28.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929c148cf0 con 0x7f929c1548e0 2023-11-28T17:39:28.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.616+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929c148ee0 con 0x7f929c1548e0 2023-11-28T17:39:28.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.620+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f92840b2040 con 0x7f929c1548e0 2023-11-28T17:39:28.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.620+0000 7f92937fe640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f927c0668d0 0x7f927c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.620+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f928411e1d0 con 0x7f929c1548e0 2023-11-28T17:39:28.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.620+0000 7f929affd640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f927c0668d0 0x7f927c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.620+0000 7f929affd640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f927c0668d0 0x7f927c068d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f928c000f70 tx=0x7f928c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.624+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92840eb7e0 con 0x7f929c1548e0 2023-11-28T17:39:28.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.784+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f929c068860 con 0x7f929c1548e0 2023-11-28T17:39:28.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.784+0000 7f92937fe640 1 -- 172.21.15.16:0/2898223720 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92840b00a0 con 0x7f929c1548e0 2023-11-28T17:39:28.786 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.784+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f927c0668d0 msgr2=0x7f927c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.784+0000 7f92a1479640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f927c0668d0 0x7f927c068d90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f928c000f70 tx=0x7f928c009040 comp rx=0 tx=0).stop 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.784+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 msgr2=0x7f929c14a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.784+0000 7f92a1479640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 0x7f929c14a200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f928401a0b0 tx=0x7f9284019220 comp rx=0 tx=0).stop 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 shutdown_connections 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f929c15b350 0x7f929c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f929c1548e0 0x7f929c14a200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f927c0668d0 0x7f927c068d90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 --2- 172.21.15.16:0/2898223720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f929c072090 0x7f929c1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 >> 172.21.15.16:0/2898223720 conn(0x7f929c06a5a0 msgr2=0x7f929c0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:28.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 shutdown_connections 2023-11-28T17:39:28.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.788+0000 7f92a1479640 1 -- 172.21.15.16:0/2898223720 wait complete. 2023-11-28T17:39:28.808 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:39:28.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 Processor -- start 2023-11-28T17:39:28.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 -- start start 2023-11-28T17:39:28.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb180b67d0 0x7fcb180b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1815d870 con 0x7fcb180cfca0 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180b6d20 con 0x7fcb180b67d0 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1eb80640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180b7000 con 0x7fcb180b8b80 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1d11d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb180b67d0 0x7fcb180b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb17fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1d11d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcb180b67d0 0x7fcb180b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32914/0 (socket says 172.21.15.16:32914) 2023-11-28T17:39:28.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.952+0000 7fcb1d11d640 1 -- 172.21.15.16:0/4007358926 learned_addr learned my addr 172.21.15.16:0/4007358926 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1d11d640 1 -- 172.21.15.16:0/4007358926 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 msgr2=0x7fcb180b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1d11d640 1 --2- 172.21.15.16:0/4007358926 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1d11d640 1 -- 172.21.15.16:0/4007358926 >> v1:172.21.15.64:6789/0 conn(0x7fcb180cfca0 legacy=0x7fcb180d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb177fe640 1 -- 172.21.15.16:0/4007358926 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167914378 0 0) 0x7fcb1815d870 con 0x7fcb180cfca0 2023-11-28T17:39:28.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1d11d640 1 -- 172.21.15.16:0/4007358926 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180b72e0 con 0x7fcb180b67d0 2023-11-28T17:39:28.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1d11d640 1 --2- 172.21.15.16:0/4007358926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180b67d0 0x7fcb180b7dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff81ad65375409a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb177fe640 1 -- 172.21.15.16:0/4007358926 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100af400 con 0x7fcb180b67d0 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb177fe640 1 -- 172.21.15.16:0/4007358926 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb100ab050 con 0x7fcb180b67d0 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb177fe640 1 -- 172.21.15.16:0/4007358926 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100af780 con 0x7fcb180b67d0 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 -- 172.21.15.16:0/4007358926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180b67d0 msgr2=0x7fcb180b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/4007358926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180b67d0 0x7fcb180b7dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1001f1f0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 -- 172.21.15.16:0/4007358926 shutdown_connections 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/4007358926 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180b67d0 0x7fcb180b7dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/4007358926 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180b6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 -- 172.21.15.16:0/4007358926 >> 172.21.15.16:0/4007358926 conn(0x7fcb180720d0 msgr2=0x7fcb180724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 -- 172.21.15.16:0/4007358926 shutdown_connections 2023-11-28T17:39:28.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.956+0000 7fcb1eb80640 1 -- 172.21.15.16:0/4007358926 wait complete. 2023-11-28T17:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 Processor -- start 2023-11-28T17:39:28.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 -- start start 2023-11-28T17:39:28.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb180b67d0 0x7fcb18156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 0x7fcb1815faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180cd780 con 0x7fcb180cfca0 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb181e5870 con 0x7fcb180b67d0 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1eb80640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180cd1f0 con 0x7fcb180b8b80 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 0x7fcb1815faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 0x7fcb1815faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32920/0 (socket says 172.21.15.16:32920) 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 -- 172.21.15.16:0/208934021 learned_addr learned my addr 172.21.15.16:0/208934021 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb17fff640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1c91c640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb180b67d0 0x7fcb18156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 -- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 msgr2=0x7fcb180cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 -- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb180b67d0 msgr2=0x7fcb18156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb180b67d0 0x7fcb18156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 -- 172.21.15.16:0/208934021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb10009b30 con 0x7fcb180cfca0 2023-11-28T17:39:28.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.960+0000 7fcb1d11d640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 0x7fcb1815faa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1001bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100afd70 con 0x7fcb180cfca0 2023-11-28T17:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10009510 con 0x7fcb180cfca0 2023-11-28T17:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb10003ba0 con 0x7fcb180cfca0 2023-11-28T17:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180cd4a0 con 0x7fcb180cfca0 2023-11-28T17:39:28.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb18157640 con 0x7fcb180cfca0 2023-11-28T17:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180b8280 con 0x7fcb180cfca0 2023-11-28T17:39:28.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.964+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcb100b6070 con 0x7fcb180cfca0 2023-11-28T17:39:28.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.968+0000 7fcb157fa640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcafc0668d0 0x7fcafc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:28.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.968+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcb10121280 con 0x7fcb180cfca0 2023-11-28T17:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.968+0000 7fcb1c91c640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcafc0668d0 0x7fcafc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:28.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.968+0000 7fcb1c91c640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcafc0668d0 0x7fcafc068d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb180cc0a0 tx=0x7fcb0c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:28.972 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:28.972+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb100ee820 con 0x7fcb180cfca0 2023-11-28T17:39:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.160+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb18068860 con 0x7fcb180cfca0 2023-11-28T17:39:29.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb157fa640 1 -- 172.21.15.16:0/208934021 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7fcb100b4540 con 0x7fcb180cfca0 2023-11-28T17:39:29.165 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:29.165 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T17:39:29.165 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 2 2023-11-28T17:39:29.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcafc0668d0 msgr2=0x7fcafc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:29.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcafc0668d0 0x7fcafc068d90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcb180cc0a0 tx=0x7fcb0c009040 comp rx=0 tx=0).stop 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 msgr2=0x7fcb1815faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 0x7fcb1815faa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb10009e50 tx=0x7fcb1001bf90 comp rx=0 tx=0).stop 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 shutdown_connections 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcb180cfca0 0x7fcb1815faa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcb180b8b80 0x7fcb180cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcafc0668d0 0x7fcafc068d90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 --2- 172.21.15.16:0/208934021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcb180b67d0 0x7fcb18156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 >> 172.21.15.16:0/208934021 conn(0x7fcb180720d0 msgr2=0x7fcb180d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 shutdown_connections 2023-11-28T17:39:29.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:29.164+0000 7fcb1eb80640 1 -- 172.21.15.16:0/208934021 wait complete. 2023-11-28T17:39:31.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:39:31.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 Processor -- start 2023-11-28T17:39:31.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 -- start start 2023-11-28T17:39:31.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd12415d540 0x7fd1240b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1240b32c0 con 0x7fd1240d34c0 2023-11-28T17:39:31.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd12415d920 con 0x7fd12415d540 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd12b5aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1240b35a0 con 0x7fd1240d1f50 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd12415d540 0x7fd1240b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd12415d540 0x7fd1240b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32930/0 (socket says 172.21.15.16:32930) 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 -- 172.21.15.16:0/1675430370 learned_addr learned my addr 172.21.15.16:0/1675430370 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd128b45640 1 --2- 172.21.15.16:0/1675430370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 -- 172.21.15.16:0/1675430370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 msgr2=0x7fd1240d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 --2- 172.21.15.16:0/1675430370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 -- 172.21.15.16:0/1675430370 >> v1:172.21.15.64:6789/0 conn(0x7fd1240d34c0 legacy=0x7fd1240cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.340+0000 7fd129346640 1 -- 172.21.15.16:0/1675430370 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1240b3880 con 0x7fd12415d540 2023-11-28T17:39:31.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd129346640 1 --2- 172.21.15.16:0/1675430370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd12415d540 0x7fd1240b29c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd120009870 tx=0x7fd12001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af6177d392a6d46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:31.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd11bfff640 1 -- 172.21.15.16:0/1675430370 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200aa670 con 0x7fd12415d540 2023-11-28T17:39:31.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd11bfff640 1 -- 172.21.15.16:0/1675430370 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1200aa7d0 con 0x7fd12415d540 2023-11-28T17:39:31.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd11bfff640 1 -- 172.21.15.16:0/1675430370 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1200aab60 con 0x7fd12415d540 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 -- 172.21.15.16:0/1675430370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd12415d540 msgr2=0x7fd1240b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/1675430370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd12415d540 0x7fd1240b29c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd120009870 tx=0x7fd12001c510 comp rx=0 tx=0).stop 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 -- 172.21.15.16:0/1675430370 shutdown_connections 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/1675430370 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/1675430370 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd12415d540 0x7fd1240b29c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 -- 172.21.15.16:0/1675430370 >> 172.21.15.16:0/1675430370 conn(0x7fd12408ccf0 msgr2=0x7fd12409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 -- 172.21.15.16:0/1675430370 shutdown_connections 2023-11-28T17:39:31.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.344+0000 7fd12b5aa640 1 -- 172.21.15.16:0/1675430370 wait complete. 2023-11-28T17:39:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 Processor -- start 2023-11-28T17:39:31.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 -- start start 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 0x7fd1240b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd12415d540 0x7fd1240b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1241542e0 con 0x7fd1240d34c0 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd124152f60 con 0x7fd12415d540 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd124153240 con 0x7fd1240d1f50 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 0x7fd1240b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 0x7fd1240b7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32934/0 (socket says 172.21.15.16:32934) 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 -- 172.21.15.16:0/3733928248 learned_addr learned my addr 172.21.15.16:0/3733928248 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd129346640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd129b47640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd12415d540 0x7fd1240b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 -- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 msgr2=0x7fd1240cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 -- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd12415d540 msgr2=0x7fd1240b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd12415d540 0x7fd1240b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 -- 172.21.15.16:0/3733928248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1200094d0 con 0x7fd1240d34c0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd128b45640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 0x7fd1240b7910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd11400d800 tx=0x7fd11400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400b6c0 con 0x7fd1240d34c0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11400b840 con 0x7fd1240d34c0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd124153520 con 0x7fd1240d34c0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11400bbf0 con 0x7fd1240d34c0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.348+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd124153ae0 con 0x7fd1240d34c0 2023-11-28T17:39:31.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.352+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd124068860 con 0x7fd1240d34c0 2023-11-28T17:39:31.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.352+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd11400bd50 con 0x7fd1240d34c0 2023-11-28T17:39:31.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.352+0000 7fd119ffb640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1080668d0 0x7fd108068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.352+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd114084630 con 0x7fd1240d34c0 2023-11-28T17:39:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.352+0000 7fd129346640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1080668d0 0x7fd108068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.352+0000 7fd129346640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1080668d0 0x7fd108068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1200ae000 tx=0x7fd1200b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:31.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.356+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd114051bc0 con 0x7fd1240d34c0 2023-11-28T17:39:31.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd12406b420 con 0x7fd1240d34c0 2023-11-28T17:39:31.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd119ffb640 1 -- 172.21.15.16:0/3733928248 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7fd1140551e0 con 0x7fd1240d34c0 2023-11-28T17:39:31.550 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:31.550 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4302,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-28T17:39:31.550 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 3 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1080668d0 msgr2=0x7fd108068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1080668d0 0x7fd108068d90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1200ae000 tx=0x7fd1200b5040 comp rx=0 tx=0).stop 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 msgr2=0x7fd1240b7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 0x7fd1240b7910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd11400d800 tx=0x7fd11400dcc0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 shutdown_connections 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1080668d0 0x7fd108068d90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd12415d540 0x7fd1240b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1240d34c0 0x7fd1240b7910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 --2- 172.21.15.16:0/3733928248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1240d1f50 0x7fd1240cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 >> 172.21.15.16:0/3733928248 conn(0x7fd12408ccf0 msgr2=0x7fd1240affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:31.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 shutdown_connections 2023-11-28T17:39:31.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.548+0000 7fd12b5aa640 1 -- 172.21.15.16:0/3733928248 wait complete. 2023-11-28T17:39:31.571 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 Processor -- start 2023-11-28T17:39:31.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 -- start start 2023-11-28T17:39:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2f58072090 0x7f2f580cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f580cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5815a8b0 con 0x7f2f581548e0 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f580ce860 con 0x7f2f58072090 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f60079640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5815a6a0 con 0x7f2f5815b350 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f5de15640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2f581548e0 0x7f2f580ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58036/0 (socket says 172.21.15.16:58036) 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.712+0000 7f2f5de15640 1 -- 172.21.15.16:0/1571784385 learned_addr learned my addr 172.21.15.16:0/1571784385 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5e616640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f580cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 --2- 172.21.15.16:0/1571784385 >> v2:172.21.15.64:3300/0 conn(0x7f2f58072090 0x7f2f580cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431865528 0 0) 0x7f2f5815a8b0 con 0x7f2f581548e0 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f44003530 con 0x7f2f581548e0 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981025683 0 0) 0x7f2f44003530 con 0x7f2f581548e0 2023-11-28T17:39:31.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 msgr2=0x7f2f580cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f580cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 >> v2:172.21.15.64:3300/0 conn(0x7f2f58072090 msgr2=0x7f2f580cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 --2- 172.21.15.16:0/1571784385 >> v2:172.21.15.64:3300/0 conn(0x7f2f58072090 0x7f2f580cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f580cea50 con 0x7f2f581548e0 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f2f54001680 con 0x7f2f581548e0 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 --2- 172.21.15.16:0/1571784385 >> v2:172.21.15.64:3300/0 conn(0x7f2f58072090 0x7f2f580cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 >> v1:172.21.15.16:6789/0 conn(0x7f2f581548e0 legacy=0x7f2f580ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f44003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f44003f50 0x7f2f440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44004d10 0x7f2f44005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5815a6a0 con 0x7f2f44003f50 2023-11-28T17:39:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4400b990 con 0x7f2f44004d10 2023-11-28T17:39:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f4400bad0 con 0x7f2f5815b350 2023-11-28T17:39:31.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f44003f50 0x7f2f440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5de15640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f44003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5e616640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44004d10 0x7f2f44005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 -- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 msgr2=0x7f2f44003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:31.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f44003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 -- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44004d10 msgr2=0x7f2f44005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44004d10 0x7f2f44005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5d614640 1 -- 172.21.15.16:0/1571784385 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f44003530 con 0x7f2f44003f50 2023-11-28T17:39:31.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.716+0000 7f2f5de15640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f5815b350 0x7f2f44003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:31.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f5d614640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f44003f50 0x7f2f440047d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009c30 tx=0x7f2f48020cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4619191f1f041 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:31.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48004220 con 0x7f2f44003f50 2023-11-28T17:39:31.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48004380 con 0x7f2f44003f50 2023-11-28T17:39:31.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f5ce13640 1 -- 172.21.15.16:0/1571784385 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f480a9a80 con 0x7f2f44003f50 2023-11-28T17:39:31.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 -- 172.21.15.16:0/1571784385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f44003f50 msgr2=0x7f2f440047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 --2- 172.21.15.16:0/1571784385 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f44003f50 0x7f2f440047d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009c30 tx=0x7f2f48020cb0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f5e616640 1 -- 172.21.15.16:0/1571784385 reap_dead start 2023-11-28T17:39:31.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 -- 172.21.15.16:0/1571784385 shutdown_connections 2023-11-28T17:39:31.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 -- 172.21.15.16:0/1571784385 >> 172.21.15.16:0/1571784385 conn(0x7f2f5806a5a0 msgr2=0x7f2f5806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:31.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 -- 172.21.15.16:0/1571784385 shutdown_connections 2023-11-28T17:39:31.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 -- 172.21.15.16:0/1571784385 wait complete. 2023-11-28T17:39:31.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 Processor -- start 2023-11-28T17:39:31.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.720+0000 7f2f60079640 1 -- start start 2023-11-28T17:39:31.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44003f50 0x7f2f58155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f58146b50 0x7f2f58158ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 0x7f2f580b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58157480 con 0x7f2f58157910 2023-11-28T17:39:31.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58156870 con 0x7f2f44003f50 2023-11-28T17:39:31.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f58156b50 con 0x7f2f58146b50 2023-11-28T17:39:31.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 0x7f2f580b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 0x7f2f580b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32954/0 (socket says 172.21.15.16:32954) 2023-11-28T17:39:31.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 -- 172.21.15.16:0/2546664642 learned_addr learned my addr 172.21.15.16:0/2546664642 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:31.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5d614640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f58146b50 0x7f2f58158ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5de15640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44003f50 0x7f2f58155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 -- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f58146b50 msgr2=0x7f2f58158ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f58146b50 0x7f2f58158ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 -- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44003f50 msgr2=0x7f2f58155fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44003f50 0x7f2f58155fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 -- 172.21.15.16:0/2546664642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f58156e30 con 0x7f2f58157910 2023-11-28T17:39:31.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5de15640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44003f50 0x7f2f58155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:31.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f5e616640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 0x7f2f580b0300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f58072910 tx=0x7f2f500115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:31.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f5000e070 con 0x7f2f58157910 2023-11-28T17:39:31.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f50011e10 con 0x7f2f58157910 2023-11-28T17:39:31.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f500039a0 con 0x7f2f58157910 2023-11-28T17:39:31.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f58157110 con 0x7f2f58157910 2023-11-28T17:39:31.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f58159430 con 0x7f2f58157910 2023-11-28T17:39:31.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f58068860 con 0x7f2f58157910 2023-11-28T17:39:31.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.724+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2f50003b00 con 0x7f2f58157910 2023-11-28T17:39:31.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.728+0000 7f2f4e7fc640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2f3c0668d0 0x7f2f3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:31.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.728+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f500846b0 con 0x7f2f58157910 2023-11-28T17:39:31.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.728+0000 7f2f5de15640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2f3c0668d0 0x7f2f3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:31.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.728+0000 7f2f5de15640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2f3c0668d0 0x7f2f3c068d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f54001020 tx=0x7f2f54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:31.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.732+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2f50051ba0 con 0x7f2f58157910 2023-11-28T17:39:31.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.892+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f58071510 con 0x7f2f58157910 2023-11-28T17:39:31.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.892+0000 7f2f4e7fc640 1 -- 172.21.15.16:0/2546664642 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12802 (secure 0 0 0) 0x7f2f500551c0 con 0x7f2f58157910 2023-11-28T17:39:31.894 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:31.895 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":18,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:24.844223+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:31.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2f3c0668d0 msgr2=0x7f2f3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2f3c0668d0 0x7f2f3c068d90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2f54001020 tx=0x7f2f54009040 comp rx=0 tx=0).stop 2023-11-28T17:39:31.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 msgr2=0x7f2f580b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:31.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 0x7f2f580b0300 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2f58072910 tx=0x7f2f500115a0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 shutdown_connections 2023-11-28T17:39:31.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2f58157910 0x7f2f580b0300 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2f58146b50 0x7f2f58158ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2f3c0668d0 0x7f2f3c068d90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 --2- 172.21.15.16:0/2546664642 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f44003f50 0x7f2f58155fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:31.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 >> 172.21.15.16:0/2546664642 conn(0x7f2f5806a5a0 msgr2=0x7f2f58153b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:31.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 shutdown_connections 2023-11-28T17:39:31.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:31.896+0000 7f2f60079640 1 -- 172.21.15.16:0/2546664642 wait complete. 2023-11-28T17:39:31.916 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:39:31.917 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:39:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.060+0000 7f7d90a9a640 1 Processor -- start 2023-11-28T17:39:32.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d90a9a640 1 -- start start 2023-11-28T17:39:32.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d90a9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c15d620 0x7f7d8c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d90a9a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7d8c06e880 0x7f7d8c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d90a9a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0cbcd0 con 0x7f7d8c06d300 2023-11-28T17:39:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d90a9a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c06f250 con 0x7f7d8c06e880 2023-11-28T17:39:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d90a9a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c0cee20 con 0x7f7d8c15d620 2023-11-28T17:39:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d8ad9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7d8c06e880 0x7f7d8c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d83fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7d8c06d300 0x7f7d8c161a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58044/0 (socket says 172.21.15.16:58044) 2023-11-28T17:39:32.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d83fff640 1 -- 172.21.15.16:0/3514775248 learned_addr learned my addr 172.21.15.16:0/3514775248 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:32.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d8a59c640 1 --2- 172.21.15.16:0/3514775248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c15d620 0x7f7d8c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/3514775248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c15d620 msgr2=0x7f7d8c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:32.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d8ad9d640 1 --2- 172.21.15.16:0/3514775248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c15d620 0x7f7d8c0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/3514775248 >> v1:172.21.15.16:6789/0 conn(0x7f7d8c06d300 legacy=0x7f7d8c161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/3514775248 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c0cf100 con 0x7f7d8c06e880 2023-11-28T17:39:32.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.064+0000 7f7d89d9b640 1 -- 172.21.15.16:0/3514775248 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810518428 0 0) 0x7f7d8c0cbcd0 con 0x7f7d8c06d300 2023-11-28T17:39:32.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d8ad9d640 1 --2- 172.21.15.16:0/3514775248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c06e880 0x7f7d8c06ed10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d90 tx=0x7f7d8401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315d734c97042f8c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d89d9b640 1 -- 172.21.15.16:0/3514775248 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840a59e0 con 0x7f7d8c06e880 2023-11-28T17:39:32.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d89d9b640 1 -- 172.21.15.16:0/3514775248 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840a5b40 con 0x7f7d8c06e880 2023-11-28T17:39:32.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d89d9b640 1 -- 172.21.15.16:0/3514775248 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840ad440 con 0x7f7d8c06e880 2023-11-28T17:39:32.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 -- 172.21.15.16:0/3514775248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c06e880 msgr2=0x7f7d8c06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/3514775248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c06e880 0x7f7d8c06ed10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009d90 tx=0x7f7d8401c920 comp rx=0 tx=0).stop 2023-11-28T17:39:32.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 -- 172.21.15.16:0/3514775248 shutdown_connections 2023-11-28T17:39:32.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/3514775248 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c06e880 0x7f7d8c06ed10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/3514775248 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c15d620 0x7f7d8c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 -- 172.21.15.16:0/3514775248 >> 172.21.15.16:0/3514775248 conn(0x7f7d8c06a5a0 msgr2=0x7f7d8c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:32.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 -- 172.21.15.16:0/3514775248 shutdown_connections 2023-11-28T17:39:32.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 -- 172.21.15.16:0/3514775248 wait complete. 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 Processor -- start 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.068+0000 7f7d90a9a640 1 -- start start 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c06d300 0x7f7d8c159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d8c06e880 0x7f7d8c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 0x7f7d8c154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1507b0 con 0x7f7d8c15d620 2023-11-28T17:39:32.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14f710 con 0x7f7d8c06e880 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14f9f0 con 0x7f7d8c06d300 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 0x7f7d8c154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 0x7f7d8c154420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32962/0 (socket says 172.21.15.16:32962) 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/803347839 learned_addr learned my addr 172.21.15.16:0/803347839 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8a59c640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c06d300 0x7f7d8c159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d83fff640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d8c06e880 0x7f7d8c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c06d300 msgr2=0x7f7d8c159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c06d300 0x7f7d8c159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d8c06e880 msgr2=0x7f7d8c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d8c06e880 0x7f7d8c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 -- 172.21.15.16:0/803347839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84009a70 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d8ad9d640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 0x7f7d8c154420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d8401afd0 tx=0x7f7d840196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840ade40 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d84009450 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840b7630 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c14fcd0 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c150290 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c068860 con 0x7f7d8c15d620 2023-11-28T17:39:32.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.072+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7d840b4050 con 0x7f7d8c15d620 2023-11-28T17:39:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.076+0000 7f7d82ffd640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7d6c066900 0x7f7d6c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.076+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d8411f530 con 0x7f7d8c15d620 2023-11-28T17:39:32.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.076+0000 7f7d8a59c640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7d6c066900 0x7f7d6c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.076+0000 7f7d8a59c640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7d6c066900 0x7f7d6c068dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c1f99c0 tx=0x7f7d7c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.080+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7d840ecd20 con 0x7f7d8c15d620 2023-11-28T17:39:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d8c0ce3f0 con 0x7f7d8c15d620 2023-11-28T17:39:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d82ffd640 1 -- 172.21.15.16:0/803347839 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d840b20a0 con 0x7f7d8c15d620 2023-11-28T17:39:32.249 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:39:32.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7d6c066900 msgr2=0x7f7d6c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7d6c066900 0x7f7d6c068dc0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c1f99c0 tx=0x7f7d7c008040 comp rx=0 tx=0).stop 2023-11-28T17:39:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 msgr2=0x7f7d8c154420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 0x7f7d8c154420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d8401afd0 tx=0x7f7d840196c0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 shutdown_connections 2023-11-28T17:39:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7d8c15d620 0x7f7d8c154420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7d6c066900 0x7f7d6c068dc0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7d8c06e880 0x7f7d8c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 --2- 172.21.15.16:0/803347839 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7d8c06d300 0x7f7d8c159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 >> 172.21.15.16:0/803347839 conn(0x7f7d8c06a5a0 msgr2=0x7f7d8c0c78c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 shutdown_connections 2023-11-28T17:39:32.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.248+0000 7f7d90a9a640 1 -- 172.21.15.16:0/803347839 wait complete. 2023-11-28T17:39:32.271 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T17:39:32.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 Processor -- start 2023-11-28T17:39:32.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 -- start start 2023-11-28T17:39:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f63c8070460 0x7f63c80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63c8145100 0x7f63c8145500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c8070e00 con 0x7f63c8161710 2023-11-28T17:39:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c806c6d0 con 0x7f63c8145100 2023-11-28T17:39:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cf5b8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c806c9b0 con 0x7f63c8070460 2023-11-28T17:39:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cd354640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63c8161710 0x7f63c8165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58046/0 (socket says 172.21.15.16:58046) 2023-11-28T17:39:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cd354640 1 -- 172.21.15.16:0/2050214635 learned_addr learned my addr 172.21.15.16:0/2050214635 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:32.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63cdb55640 1 --2- 172.21.15.16:0/2050214635 >> v2:172.21.15.16:3300/0 conn(0x7f63c8145100 0x7f63c8145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63bffff640 1 -- 172.21.15.16:0/2050214635 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341342106 0 0) 0x7f63c8070e00 con 0x7f63c8161710 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63bffff640 1 -- 172.21.15.16:0/2050214635 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b4003530 con 0x7f63c8161710 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.412+0000 7f63ccb53640 1 --2- 172.21.15.16:0/2050214635 >> v2:172.21.15.64:3300/0 conn(0x7f63c8070460 0x7f63c80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cdb55640 1 -- 172.21.15.16:0/2050214635 >> v2:172.21.15.64:3300/0 conn(0x7f63c8070460 msgr2=0x7f63c80708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cdb55640 1 --2- 172.21.15.16:0/2050214635 >> v2:172.21.15.64:3300/0 conn(0x7f63c8070460 0x7f63c80708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cdb55640 1 -- 172.21.15.16:0/2050214635 >> v1:172.21.15.16:6789/0 conn(0x7f63c8161710 legacy=0x7f63c8165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cdb55640 1 -- 172.21.15.16:0/2050214635 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c806cc90 con 0x7f63c8145100 2023-11-28T17:39:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63ccb53640 1 --2- 172.21.15.16:0/2050214635 >> v2:172.21.15.64:3300/0 conn(0x7f63c8070460 0x7f63c80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cdb55640 1 --2- 172.21.15.16:0/2050214635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8145100 0x7f63c8145500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63c80744c0 tx=0x7f63c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837bd809e15ba1a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63bffff640 1 -- 172.21.15.16:0/2050214635 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00a59a0 con 0x7f63c8145100 2023-11-28T17:39:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63bffff640 1 -- 172.21.15.16:0/2050214635 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c00a5b00 con 0x7f63c8145100 2023-11-28T17:39:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63bffff640 1 -- 172.21.15.16:0/2050214635 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c00a5e90 con 0x7f63c8145100 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cf5b8640 1 -- 172.21.15.16:0/2050214635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8145100 msgr2=0x7f63c8145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/2050214635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8145100 0x7f63c8145500 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f63c80744c0 tx=0x7f63c001c8e0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cf5b8640 1 -- 172.21.15.16:0/2050214635 shutdown_connections 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/2050214635 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8145100 0x7f63c8145500 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/2050214635 >> v2:172.21.15.64:3300/0 conn(0x7f63c8070460 0x7f63c80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.416+0000 7f63cf5b8640 1 -- 172.21.15.16:0/2050214635 >> 172.21.15.16:0/2050214635 conn(0x7f63c806a5a0 msgr2=0x7f63c806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 -- 172.21.15.16:0/2050214635 shutdown_connections 2023-11-28T17:39:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 -- 172.21.15.16:0/2050214635 wait complete. 2023-11-28T17:39:32.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 Processor -- start 2023-11-28T17:39:32.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 -- start start 2023-11-28T17:39:32.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 0x7f63c815be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63c8145100 0x7f63c8142cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63c8161710 0x7f63c81431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c813c2b0 con 0x7f63c8070460 2023-11-28T17:39:32.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c80b2450 con 0x7f63c8161710 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cf5b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c813be20 con 0x7f63c8145100 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 0x7f63c815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 0x7f63c815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:32974/0 (socket says 172.21.15.16:32974) 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 -- 172.21.15.16:0/3299584799 learned_addr learned my addr 172.21.15.16:0/3299584799 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cdb55640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63c8161710 0x7f63c81431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63ccb53640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63c8145100 0x7f63c8142cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 -- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63c8145100 msgr2=0x7f63c8142cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63c8145100 0x7f63c8142cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 -- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63c8161710 msgr2=0x7f63c81431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63c8161710 0x7f63c81431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 -- 172.21.15.16:0/3299584799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009a70 con 0x7f63c8070460 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63ccb53640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63c8145100 0x7f63c8142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cdb55640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63c8161710 0x7f63c81431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.420+0000 7f63cd354640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 0x7f63c815be40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c4d0 tx=0x7f63c400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005cf0 con 0x7f63c8070460 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4005e50 con 0x7f63c8070460 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4007270 con 0x7f63c8070460 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c815b050 con 0x7f63c8070460 2023-11-28T17:39:32.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c80b21b0 con 0x7f63c8070460 2023-11-28T17:39:32.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c813bbf0 con 0x7f63c8070460 2023-11-28T17:39:32.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63c40073d0 con 0x7f63c8070460 2023-11-28T17:39:32.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63bdffb640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63ac0668d0 0x7f63ac068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63c4083580 con 0x7f63c8070460 2023-11-28T17:39:32.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.424+0000 7f63ccb53640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63ac0668d0 0x7f63ac068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.428+0000 7f63ccb53640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63ac0668d0 0x7f63ac068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63c8070b00 tx=0x7f63b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.428+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63c813bbf0 con 0x7f63c8070460 2023-11-28T17:39:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f63c813bbf0 con 0x7f63c8070460 2023-11-28T17:39:32.593 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63bdffb640 1 -- 172.21.15.16:0/3299584799 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f63c813bbf0 con 0x7f63c8070460 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:39:32.594 INFO:teuthology.orchestra.run.smithi016.stdout:] 2023-11-28T17:39:32.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63ac0668d0 msgr2=0x7f63ac068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63ac0668d0 0x7f63ac068d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f63c8070b00 tx=0x7f63b8008040 comp rx=0 tx=0).stop 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 msgr2=0x7f63c815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 0x7f63c815be40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f63c400c4d0 tx=0x7f63c400c990 comp rx=0 tx=0).stop 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 shutdown_connections 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63ac0668d0 0x7f63ac068d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63c8161710 0x7f63c81431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63c8145100 0x7f63c8142cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 --2- 172.21.15.16:0/3299584799 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63c8070460 0x7f63c815be40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 >> 172.21.15.16:0/3299584799 conn(0x7f63c806a5a0 msgr2=0x7f63c80b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 shutdown_connections 2023-11-28T17:39:32.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.592+0000 7f63cf5b8640 1 -- 172.21.15.16:0/3299584799 wait complete. 2023-11-28T17:39:32.614 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T17:39:32.617 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T17:39:32.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 Processor -- start 2023-11-28T17:39:32.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 -- start start 2023-11-28T17:39:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ff415d540 0x7f6ff40b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40b52b0 0x7f6ff40b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff40b5c30 con 0x7f6ff40d1940 2023-11-28T17:39:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff40b8720 con 0x7f6ff415d540 2023-11-28T17:39:32.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff970f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff40b7ba0 con 0x7f6ff40b52b0 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff2ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6ff415d540 0x7f6ff40b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff37fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f6ff40d1940 0x7f6ff40d1da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58060/0 (socket says 172.21.15.16:58060) 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff37fe640 1 -- 172.21.15.16:0/4089914433 learned_addr learned my addr 172.21.15.16:0/4089914433 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6febfff640 1 --2- 172.21.15.16:0/4089914433 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40b52b0 0x7f6ff40b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/4089914433 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40b52b0 msgr2=0x7f6ff40b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff2ffd640 1 --2- 172.21.15.16:0/4089914433 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40b52b0 0x7f6ff40b56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/4089914433 >> v1:172.21.15.16:6789/0 conn(0x7f6ff40d1940 legacy=0x7f6ff40d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff27fc640 1 -- 172.21.15.16:0/4089914433 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436231497 0 0) 0x7f6ff40b5c30 con 0x7f6ff40d1940 2023-11-28T17:39:32.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.764+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/4089914433 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff40b7e80 con 0x7f6ff415d540 2023-11-28T17:39:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff2ffd640 1 --2- 172.21.15.16:0/4089914433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff415d540 0x7f6ff40b8e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40097c0 tx=0x7f6fe401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d304d545788b9f88 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff27fc640 1 -- 172.21.15.16:0/4089914433 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40ab600 con 0x7f6ff415d540 2023-11-28T17:39:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff27fc640 1 -- 172.21.15.16:0/4089914433 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe40a7050 con 0x7f6ff415d540 2023-11-28T17:39:32.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff27fc640 1 -- 172.21.15.16:0/4089914433 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40ab980 con 0x7f6ff415d540 2023-11-28T17:39:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 -- 172.21.15.16:0/4089914433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff415d540 msgr2=0x7f6ff40b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 --2- 172.21.15.16:0/4089914433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff415d540 0x7f6ff40b8e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40097c0 tx=0x7f6fe401c450 comp rx=0 tx=0).stop 2023-11-28T17:39:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 -- 172.21.15.16:0/4089914433 shutdown_connections 2023-11-28T17:39:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 --2- 172.21.15.16:0/4089914433 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40b52b0 0x7f6ff40b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 --2- 172.21.15.16:0/4089914433 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff415d540 0x7f6ff40b8e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 -- 172.21.15.16:0/4089914433 >> 172.21.15.16:0/4089914433 conn(0x7f6ff40720d0 msgr2=0x7f6ff40724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:32.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 -- 172.21.15.16:0/4089914433 shutdown_connections 2023-11-28T17:39:32.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 -- 172.21.15.16:0/4089914433 wait complete. 2023-11-28T17:39:32.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 Processor -- start 2023-11-28T17:39:32.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.768+0000 7f6ff970f640 1 -- start start 2023-11-28T17:39:32.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 0x7f6ff4155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40d1940 0x7f6ff40c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff415d540 0x7f6ff40cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff415f0a0 con 0x7f6ff40b52b0 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff415f380 con 0x7f6ff415d540 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff415f660 con 0x7f6ff40d1940 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 0x7f6ff4155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 0x7f6ff4155130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33004/0 (socket says 172.21.15.16:33004) 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/3500968882 learned_addr learned my addr 172.21.15.16:0/3500968882 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40d1940 msgr2=0x7f6ff40c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40d1940 0x7f6ff40c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff415d540 msgr2=0x7f6ff40cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff415d540 0x7f6ff40cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:32.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 -- 172.21.15.16:0/3500968882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe4009420 con 0x7f6ff40b52b0 2023-11-28T17:39:32.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff2ffd640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 0x7f6ff4155130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fe401ab00 tx=0x7f6fe40191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b4400 con 0x7f6ff40b52b0 2023-11-28T17:39:32.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe40b45a0 con 0x7f6ff40b52b0 2023-11-28T17:39:32.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b4950 con 0x7f6ff40b52b0 2023-11-28T17:39:32.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff415f940 con 0x7f6ff40b52b0 2023-11-28T17:39:32.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff40d3000 con 0x7f6ff40b52b0 2023-11-28T17:39:32.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.772+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff4068860 con 0x7f6ff40b52b0 2023-11-28T17:39:32.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.776+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6fe40b2040 con 0x7f6ff40b52b0 2023-11-28T17:39:32.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.776+0000 7f6feb7fe640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6fd4066900 0x7f6fd4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:32.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.776+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6fe411df20 con 0x7f6ff40b52b0 2023-11-28T17:39:32.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.776+0000 7f6febfff640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6fd4066900 0x7f6fd4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:32.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.776+0000 7f6febfff640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6fd4066900 0x7f6fd4068dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc006aa0 tx=0x7f6fdc006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:32.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.780+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6fe40eb4b0 con 0x7f6ff40b52b0 2023-11-28T17:39:32.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:32.936+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6ff415fdf0 con 0x7f6ff40b52b0 2023-11-28T17:39:33.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6feb7fe640 1 -- 172.21.15.16:0/3500968882 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6fe40b00b0 con 0x7f6ff40b52b0 2023-11-28T17:39:33.037 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2023-11-28T17:39:33.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6fd4066900 msgr2=0x7f6fd4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:33.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6fd4066900 0x7f6fd4068dc0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc006aa0 tx=0x7f6fdc006a30 comp rx=0 tx=0).stop 2023-11-28T17:39:33.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 msgr2=0x7f6ff4155130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:33.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 0x7f6ff4155130 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fe401ab00 tx=0x7f6fe40191f0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 shutdown_connections 2023-11-28T17:39:33.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6fd4066900 0x7f6fd4068dc0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ff415d540 0x7f6ff40cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6ff40d1940 0x7f6ff40c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 --2- 172.21.15.16:0/3500968882 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6ff40b52b0 0x7f6ff4155130 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.036+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 >> 172.21.15.16:0/3500968882 conn(0x7f6ff40720d0 msgr2=0x7f6ff4155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:33.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.040+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 shutdown_connections 2023-11-28T17:39:33.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.040+0000 7f6ff970f640 1 -- 172.21.15.16:0/3500968882 wait complete. 2023-11-28T17:39:33.065 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T17:39:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 Processor -- start 2023-11-28T17:39:33.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 -- start start 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1f701548e0 0x7f1f700ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1f700cf640 0x7f1f700cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7015a8b0 con 0x7f1f70072090 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7015a6a0 con 0x7f1f701548e0 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f75d9d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f700ced30 con 0x7f1f700cf640 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f6f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1f701548e0 0x7f1f700ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f6f7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1f701548e0 0x7f1f700ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33014/0 (socket says 172.21.15.16:33014) 2023-11-28T17:39:33.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f6f7fe640 1 -- 172.21.15.16:0/2337584916 learned_addr learned my addr 172.21.15.16:0/2337584916 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f6effd640 1 --1- 172.21.15.16:0/2337584916 >> v1:172.21.15.16:6789/0 conn(0x7f1f70072090 0x7f1f700cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58072/0 (socket says 172.21.15.16:58072) 2023-11-28T17:39:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.212+0000 7f1f6ffff640 1 --2- 172.21.15.16:0/2337584916 >> v2:172.21.15.64:3300/0 conn(0x7f1f700cf640 0x7f1f700cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6f7fe640 1 -- 172.21.15.16:0/2337584916 >> v2:172.21.15.64:3300/0 conn(0x7f1f700cf640 msgr2=0x7f1f700cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6f7fe640 1 --2- 172.21.15.16:0/2337584916 >> v2:172.21.15.64:3300/0 conn(0x7f1f700cf640 0x7f1f700cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6f7fe640 1 -- 172.21.15.16:0/2337584916 >> v1:172.21.15.16:6789/0 conn(0x7f1f70072090 legacy=0x7f1f700cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:33.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6f7fe640 1 -- 172.21.15.16:0/2337584916 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f700cea50 con 0x7f1f701548e0 2023-11-28T17:39:33.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6f7fe640 1 --2- 172.21.15.16:0/2337584916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700ce150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f70072520 tx=0x7f1f6001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27375f36abf1b3f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:33.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6e7fc640 1 -- 172.21.15.16:0/2337584916 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f600aa430 con 0x7f1f701548e0 2023-11-28T17:39:33.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6e7fc640 1 -- 172.21.15.16:0/2337584916 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f600aa590 con 0x7f1f701548e0 2023-11-28T17:39:33.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f6e7fc640 1 -- 172.21.15.16:0/2337584916 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f600aa920 con 0x7f1f701548e0 2023-11-28T17:39:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2337584916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 msgr2=0x7f1f700ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2337584916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700ce150 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1f70072520 tx=0x7f1f6001c4d0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2337584916 shutdown_connections 2023-11-28T17:39:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2337584916 >> v2:172.21.15.64:3300/0 conn(0x7f1f700cf640 0x7f1f700cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2337584916 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700ce150 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2337584916 >> 172.21.15.16:0/2337584916 conn(0x7f1f7006a5a0 msgr2=0x7f1f7006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.216+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2337584916 shutdown_connections 2023-11-28T17:39:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2337584916 wait complete. 2023-11-28T17:39:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 Processor -- start 2023-11-28T17:39:33.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 -- start start 2023-11-28T17:39:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f70072090 0x7f1f70148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f700cf640 0x7f1f70141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:33.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f700affc0 con 0x7f1f701548e0 2023-11-28T17:39:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70147ed0 con 0x7f1f700cf640 2023-11-28T17:39:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f75d9d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f701480e0 con 0x7f1f70072090 2023-11-28T17:39:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:33.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700af690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33030/0 (socket says 172.21.15.16:33030) 2023-11-28T17:39:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 -- 172.21.15.16:0/2268551188 learned_addr learned my addr 172.21.15.16:0/2268551188 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6effd640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f700cf640 0x7f1f70141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:33.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6f7fe640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f70072090 0x7f1f70148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 -- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f70072090 msgr2=0x7f1f70148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f70072090 0x7f1f70148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 -- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f700cf640 msgr2=0x7f1f70141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f700cf640 0x7f1f70141590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 -- 172.21.15.16:0/2268551188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f600094d0 con 0x7f1f701548e0 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f6ffff640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700af690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800efc0 tx=0x7f1f6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.220+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f68014480 con 0x7f1f701548e0 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6800f040 con 0x7f1f701548e0 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f70148420 con 0x7f1f701548e0 2023-11-28T17:39:33.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f68014820 con 0x7f1f701548e0 2023-11-28T17:39:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f70141ad0 con 0x7f1f701548e0 2023-11-28T17:39:33.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70068860 con 0x7f1f701548e0 2023-11-28T17:39:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1f68014980 con 0x7f1f701548e0 2023-11-28T17:39:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f57fff640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f5c0668d0 0x7f1f5c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1f68084ea0 con 0x7f1f701548e0 2023-11-28T17:39:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.224+0000 7f1f6f7fe640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f5c0668d0 0x7f1f5c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:33.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.228+0000 7f1f6f7fe640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f5c0668d0 0x7f1f5c068d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f600ae000 tx=0x7f1f600a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:33.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.228+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1f68052230 con 0x7f1f701548e0 2023-11-28T17:39:33.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:33.388+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1f70148250 con 0x7f1f701548e0 2023-11-28T17:39:34.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f57fff640 1 -- 172.21.15.16:0/2268551188 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1f68055850 con 0x7f1f701548e0 2023-11-28T17:39:34.041 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f5c0668d0 msgr2=0x7f1f5c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f5c0668d0 0x7f1f5c068d90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1f600ae000 tx=0x7f1f600a7000 comp rx=0 tx=0).stop 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 msgr2=0x7f1f700af690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700af690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1f6800efc0 tx=0x7f1f6800c490 comp rx=0 tx=0).stop 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 shutdown_connections 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1f701548e0 0x7f1f700af690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f5c0668d0 0x7f1f5c068d90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1f700cf640 0x7f1f70141590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 --2- 172.21.15.16:0/2268551188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1f70072090 0x7f1f70148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 >> 172.21.15.16:0/2268551188 conn(0x7f1f7006a5a0 msgr2=0x7f1f7006a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:34.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 shutdown_connections 2023-11-28T17:39:34.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.040+0000 7f1f75d9d640 1 -- 172.21.15.16:0/2268551188 wait complete. 2023-11-28T17:39:34.078 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:39:34.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:39:34.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T17:39:34.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 Processor -- start 2023-11-28T17:39:34.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 -- start start 2023-11-28T17:39:34.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f865c1548e0 0x7f865c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:34.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:34.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f865c15a8b0 con 0x7f865c072090 2023-11-28T17:39:34.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865c15a6a0 con 0x7f865c1548e0 2023-11-28T17:39:34.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f86622c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0ced30 con 0x7f865c0cf640 2023-11-28T17:39:34.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f865bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f865c1548e0 0x7f865c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:34.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f865b7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f865c072090 0x7f865c0cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58080/0 (socket says 172.21.15.16:58080) 2023-11-28T17:39:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.312+0000 7f865b7fe640 1 -- 172.21.15.16:0/1007602176 learned_addr learned my addr 172.21.15.16:0/1007602176 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f8660866640 1 --2- 172.21.15.16:0/1007602176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865bfff640 1 -- 172.21.15.16:0/1007602176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 msgr2=0x7f865c0cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:34.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865bfff640 1 --2- 172.21.15.16:0/1007602176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865bfff640 1 -- 172.21.15.16:0/1007602176 >> v1:172.21.15.16:6789/0 conn(0x7f865c072090 legacy=0x7f865c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:34.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865bfff640 1 -- 172.21.15.16:0/1007602176 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0cea50 con 0x7f865c1548e0 2023-11-28T17:39:34.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865bfff640 1 --2- 172.21.15.16:0/1007602176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c1548e0 0x7f865c0ce150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f864c0097c0 tx=0x7f864c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d176b37e4b8903 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:34.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865affd640 1 -- 172.21.15.16:0/1007602176 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0ab650 con 0x7f865c1548e0 2023-11-28T17:39:34.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865affd640 1 -- 172.21.15.16:0/1007602176 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c0ab7b0 con 0x7f865c1548e0 2023-11-28T17:39:34.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.316+0000 7f865affd640 1 -- 172.21.15.16:0/1007602176 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0abb40 con 0x7f865c1548e0 2023-11-28T17:39:34.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- 172.21.15.16:0/1007602176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c1548e0 msgr2=0x7f865c0ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:34.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 --2- 172.21.15.16:0/1007602176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c1548e0 0x7f865c0ce150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f864c0097c0 tx=0x7f864c01c450 comp rx=0 tx=0).stop 2023-11-28T17:39:34.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- 172.21.15.16:0/1007602176 shutdown_connections 2023-11-28T17:39:34.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 --2- 172.21.15.16:0/1007602176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 --2- 172.21.15.16:0/1007602176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c1548e0 0x7f865c0ce150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- 172.21.15.16:0/1007602176 >> 172.21.15.16:0/1007602176 conn(0x7f865c06a5a0 msgr2=0x7f865c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:34.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- 172.21.15.16:0/1007602176 shutdown_connections 2023-11-28T17:39:34.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- 172.21.15.16:0/1007602176 wait complete. 2023-11-28T17:39:34.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 Processor -- start 2023-11-28T17:39:34.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- start start 2023-11-28T17:39:34.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 0x7f865c153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:34.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:34.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1548e0 0x7f865c0b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:34.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c153b80 con 0x7f865c072090 2023-11-28T17:39:34.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0aff80 con 0x7f865c1548e0 2023-11-28T17:39:34.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f86622c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c0b0e80 con 0x7f865c0cf640 2023-11-28T17:39:34.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 0x7f865c153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 0x7f865c153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33046/0 (socket says 172.21.15.16:33046) 2023-11-28T17:39:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 -- 172.21.15.16:0/707995161 learned_addr learned my addr 172.21.15.16:0/707995161 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865b7fe640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:34.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f8660866640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1548e0 0x7f865c0b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 -- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 msgr2=0x7f865c0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 -- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1548e0 msgr2=0x7f865c0b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1548e0 0x7f865c0b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f865bfff640 1 -- 172.21.15.16:0/707995161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c009420 con 0x7f865c072090 2023-11-28T17:39:34.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.320+0000 7f8660866640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1548e0 0x7f865c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:34.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f865bfff640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 0x7f865c153640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f864c01a080 tx=0x7f864c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:34.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0b5810 con 0x7f865c072090 2023-11-28T17:39:34.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c0b5970 con 0x7f865c072090 2023-11-28T17:39:34.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0b5d20 con 0x7f865c072090 2023-11-28T17:39:34.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f865c153d70 con 0x7f865c072090 2023-11-28T17:39:34.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865c0af240 con 0x7f865c072090 2023-11-28T17:39:34.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865c068860 con 0x7f865c072090 2023-11-28T17:39:34.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f864c0bf410 con 0x7f865c072090 2023-11-28T17:39:34.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.324+0000 7f8658ff9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8648066920 0x7f8648068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:34.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.328+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f864c11f2d0 con 0x7f865c072090 2023-11-28T17:39:34.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.328+0000 7f865b7fe640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8648066920 0x7f8648068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:34.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.328+0000 7f865b7fe640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8648066920 0x7f8648068de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f865c14c1f0 tx=0x7f8650009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:34.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.332+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f864c0ec690 con 0x7f865c072090 2023-11-28T17:39:34.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:34.524+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f865c0cf040 con 0x7f865c072090 2023-11-28T17:39:35.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f8658ff9640 1 -- 172.21.15.16:0/707995161 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f864c0ab610 con 0x7f865c072090 2023-11-28T17:39:35.373 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T17:39:35.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8648066920 msgr2=0x7f8648068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8648066920 0x7f8648068de0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f865c14c1f0 tx=0x7f8650009040 comp rx=0 tx=0).stop 2023-11-28T17:39:35.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 msgr2=0x7f865c153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 0x7f865c153640 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f864c01a080 tx=0x7f864c01ac90 comp rx=0 tx=0).stop 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 shutdown_connections 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8648066920 0x7f8648068de0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f865c1548e0 0x7f865c0b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f865c0cf640 0x7f865c0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 --2- 172.21.15.16:0/707995161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f865c072090 0x7f865c153640 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.372+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 >> 172.21.15.16:0/707995161 conn(0x7f865c06a5a0 msgr2=0x7f865c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.376+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 shutdown_connections 2023-11-28T17:39:35.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.376+0000 7f86622c9640 1 -- 172.21.15.16:0/707995161 wait complete. 2023-11-28T17:39:35.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:35.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.548+0000 7f0a55dd1640 1 Processor -- start 2023-11-28T17:39:35.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.548+0000 7f0a55dd1640 1 -- start start 2023-11-28T17:39:35.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a55dd1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0a50144c80 0x7f0a500cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a55dd1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500ce4f0 con 0x7f0a500cf640 2023-11-28T17:39:35.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a55dd1640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a500ce7d0 con 0x7f0a500cdf00 2023-11-28T17:39:35.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a55dd1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a500709b0 con 0x7f0a50144c80 2023-11-28T17:39:35.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0a500cf640 0x7f0a50070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58090/0 (socket says 172.21.15.16:58090) 2023-11-28T17:39:35.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4ffff640 1 -- 172.21.15.16:0/3261001108 learned_addr learned my addr 172.21.15.16:0/3261001108 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:35.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4f7fe640 1 --2- 172.21.15.16:0/3261001108 >> v2:172.21.15.64:3300/0 conn(0x7f0a50144c80 0x7f0a500cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967798620 0 0) 0x7f0a500ce4f0 con 0x7f0a500cf640 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a38003530 con 0x7f0a500cf640 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82772347 0 0) 0x7f0a38003530 con 0x7f0a500cf640 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 >> v2:172.21.15.64:3300/0 conn(0x7f0a50144c80 msgr2=0x7f0a500cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 --2- 172.21.15.16:0/3261001108 >> v2:172.21.15.64:3300/0 conn(0x7f0a50144c80 0x7f0a500cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 >> v1:172.21.15.64:6789/0 conn(0x7f0a500cdf00 legacy=0x7f0a500cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500ceab0 con 0x7f0a500cf640 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f0a48001a00 con 0x7f0a500cf640 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 >> v1:172.21.15.16:6789/0 conn(0x7f0a500cf640 legacy=0x7f0a50070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a38003980 0x7f0a38003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a38004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a38005050 0x7f0a3800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500709b0 con 0x7f0a38004380 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3800bfb0 con 0x7f0a38005050 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3800c170 con 0x7f0a38003980 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4effd640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a38004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4ffff640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a38005050 0x7f0a3800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4f7fe640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a38003980 0x7f0a38003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4effd640 1 -- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a38003980 msgr2=0x7f0a38003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4effd640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a38003980 0x7f0a38003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4effd640 1 -- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a38005050 msgr2=0x7f0a3800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4effd640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a38005050 0x7f0a3800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4effd640 1 -- 172.21.15.16:0/3261001108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a38003530 con 0x7f0a38004380 2023-11-28T17:39:35.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.552+0000 7f0a4ffff640 1 -- 172.21.15.16:0/3261001108 reap_dead start 2023-11-28T17:39:35.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a4effd640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a38004850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a44001860 tx=0x7f0a4401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454a034e67172c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:35.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440ab600 con 0x7f0a38004380 2023-11-28T17:39:35.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a440a7050 con 0x7f0a38004380 2023-11-28T17:39:35.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a4e7fc640 1 -- 172.21.15.16:0/3261001108 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440ab9e0 con 0x7f0a38004380 2023-11-28T17:39:35.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 -- 172.21.15.16:0/3261001108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 msgr2=0x7f0a38004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a38004850 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0a44001860 tx=0x7f0a4401c4c0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 -- 172.21.15.16:0/3261001108 shutdown_connections 2023-11-28T17:39:35.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/3261001108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a38004850 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 -- 172.21.15.16:0/3261001108 >> 172.21.15.16:0/3261001108 conn(0x7f0a5006a5a0 msgr2=0x7f0a5006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:35.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 -- 172.21.15.16:0/3261001108 shutdown_connections 2023-11-28T17:39:35.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.556+0000 7f0a55dd1640 1 -- 172.21.15.16:0/3261001108 wait complete. 2023-11-28T17:39:35.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 Processor -- start 2023-11-28T17:39:35.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 -- start start 2023-11-28T17:39:35.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a50158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a500b1bb0 0x7f0a500ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500a9dc0 0x7f0a500aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500aa7b0 con 0x7f0a38004380 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a500aff10 con 0x7f0a500b1bb0 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a50159140 con 0x7f0a500a9dc0 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a50158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a50158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33056/0 (socket says 172.21.15.16:33056) 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 -- 172.21.15.16:0/1107402182 learned_addr learned my addr 172.21.15.16:0/1107402182 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4effd640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a500b1bb0 0x7f0a500ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4ffff640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500a9dc0 0x7f0a500aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 -- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500a9dc0 msgr2=0x7f0a500aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500a9dc0 0x7f0a500aa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 -- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a500b1bb0 msgr2=0x7f0a500ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a500b1bb0 0x7f0a500ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 -- 172.21.15.16:0/1107402182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500af300 con 0x7f0a38004380 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a4f7fe640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a50158c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a40011930 tx=0x7f0a40011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a400095b0 con 0x7f0a38004380 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a40004240 con 0x7f0a38004380 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4000f8e0 con 0x7f0a38004380 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a500af5e0 con 0x7f0a38004380 2023-11-28T17:39:35.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.560+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a500afba0 con 0x7f0a38004380 2023-11-28T17:39:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.564+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a50068860 con 0x7f0a38004380 2023-11-28T17:39:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.564+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a4000fa40 con 0x7f0a38004380 2023-11-28T17:39:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.564+0000 7f0a37fff640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0a3c066900 0x7f0a3c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.564+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a40084b50 con 0x7f0a38004380 2023-11-28T17:39:35.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.564+0000 7f0a4effd640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0a3c066900 0x7f0a3c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.564+0000 7f0a4effd640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0a3c066900 0x7f0a3c068dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a440ad000 tx=0x7f0a440a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:35.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.568+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0a40051cf0 con 0x7f0a38004380 2023-11-28T17:39:35.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.724+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a50067850 con 0x7f0a38004380 2023-11-28T17:39:35.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a37fff640 1 -- 172.21.15.16:0/1107402182 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f0a40023090 con 0x7f0a38004380 2023-11-28T17:39:35.729 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:35.730 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":21,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:34.526665+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:35.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0a3c066900 msgr2=0x7f0a3c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0a3c066900 0x7f0a3c068dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0a440ad000 tx=0x7f0a440a6000 comp rx=0 tx=0).stop 2023-11-28T17:39:35.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 msgr2=0x7f0a50158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a50158c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a40011930 tx=0x7f0a40011df0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 shutdown_connections 2023-11-28T17:39:35.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a500a9dc0 0x7f0a500aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0a3c066900 0x7f0a3c068dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a500b1bb0 0x7f0a500ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 --2- 172.21.15.16:0/1107402182 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a38004380 0x7f0a50158c00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 >> 172.21.15.16:0/1107402182 conn(0x7f0a5006a5a0 msgr2=0x7f0a50070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:35.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 shutdown_connections 2023-11-28T17:39:35.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.728+0000 7f0a55dd1640 1 -- 172.21.15.16:0/1107402182 wait complete. 2023-11-28T17:39:35.750 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:35.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123cd01640 1 Processor -- start 2023-11-28T17:39:35.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123cd01640 1 -- start start 2023-11-28T17:39:35.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123cd01640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f1238167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123cd01640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380b32c0 con 0x7f12380d1f50 2023-11-28T17:39:35.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123cd01640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12380b35a0 con 0x7f123815d540 2023-11-28T17:39:35.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123cd01640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380b30d0 con 0x7f12380cedf0 2023-11-28T17:39:35.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1235d9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f12380d1f50 0x7f12380d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58096/0 (socket says 172.21.15.16:58096) 2023-11-28T17:39:35.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1235d9b640 1 -- 172.21.15.16:0/1262276220 learned_addr learned my addr 172.21.15.16:0/1262276220 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:35.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484852573 0 0) 0x7f12380b32c0 con 0x7f12380d1f50 2023-11-28T17:39:35.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003530 con 0x7f12380d1f50 2023-11-28T17:39:35.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f1238167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2399120220 0 0) 0x7f1220003530 con 0x7f12380d1f50 2023-11-28T17:39:35.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 msgr2=0x7f1238167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:35.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f1238167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 >> v1:172.21.15.64:6789/0 conn(0x7f123815d540 legacy=0x7f12380b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380b3880 con 0x7f12380d1f50 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f122c001680 con 0x7f12380d1f50 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f1238167fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 >> v1:172.21.15.16:6789/0 conn(0x7f12380d1f50 legacy=0x7f12380d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f12200039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220003fa0 0x7f12200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1220004d10 0x7f1220005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bac0 con 0x7f1220004d10 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bc30 con 0x7f1220003fa0 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122000bdf0 con 0x7f12380cedf0 2023-11-28T17:39:35.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1220004d10 0x7f1220005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f123659c640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f12200039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1235d9b640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220003fa0 0x7f12200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 -- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 msgr2=0x7f12200039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380cedf0 0x7f12200039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 -- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220003fa0 msgr2=0x7f12200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220003fa0 0x7f12200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1236d9d640 1 -- 172.21.15.16:0/1262276220 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220003530 con 0x7f1220004d10 2023-11-28T17:39:35.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.892+0000 7f1235d9b640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220003fa0 0x7f12200047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f1236d9d640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1220004d10 0x7f1220005190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12300073e0 tx=0x7f123001cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb340450bb428639 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300a5da0 con 0x7f1220004d10 2023-11-28T17:39:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12300ad440 con 0x7f1220004d10 2023-11-28T17:39:35.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123559a640 1 -- 172.21.15.16:0/1262276220 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300ad7b0 con 0x7f1220004d10 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123cd01640 1 -- 172.21.15.16:0/1262276220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1220004d10 msgr2=0x7f1220005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123cd01640 1 --2- 172.21.15.16:0/1262276220 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1220004d10 0x7f1220005190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f12300073e0 tx=0x7f123001cea0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f1236d9d640 1 -- 172.21.15.16:0/1262276220 reap_dead start 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123cd01640 1 -- 172.21.15.16:0/1262276220 shutdown_connections 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123cd01640 1 -- 172.21.15.16:0/1262276220 >> 172.21.15.16:0/1262276220 conn(0x7f123808ccf0 msgr2=0x7f123809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123cd01640 1 -- 172.21.15.16:0/1262276220 shutdown_connections 2023-11-28T17:39:35.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.896+0000 7f123cd01640 1 -- 172.21.15.16:0/1262276220 wait complete. 2023-11-28T17:39:35.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 Processor -- start 2023-11-28T17:39:35.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 -- start start 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220004d10 0x7f1238159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 0x7f12380cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380c9430 0x7f12380c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1238159ab0 con 0x7f12380cb2d0 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12380c80b0 con 0x7f1220004d10 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12380c8390 con 0x7f12380c9430 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 0x7f12380cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 0x7f12380cb730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33080/0 (socket says 172.21.15.16:33080) 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 -- 172.21.15.16:0/2912364557 learned_addr learned my addr 172.21.15.16:0/2912364557 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123659c640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220004d10 0x7f1238159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1236d9d640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380c9430 0x7f12380c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 -- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380c9430 msgr2=0x7f12380c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380c9430 0x7f12380c98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 -- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220004d10 msgr2=0x7f1238159570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220004d10 0x7f1238159570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 -- 172.21.15.16:0/2912364557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12380c8670 con 0x7f12380cb2d0 2023-11-28T17:39:35.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1235d9b640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 0x7f12380cb730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e810 tx=0x7f122c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:35.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00c8d0 con 0x7f12380cb2d0 2023-11-28T17:39:35.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00ca30 con 0x7f12380cb2d0 2023-11-28T17:39:35.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12380c8950 con 0x7f12380cb2d0 2023-11-28T17:39:35.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00cda0 con 0x7f12380cb2d0 2023-11-28T17:39:35.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.900+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12380c8f10 con 0x7f12380cb2d0 2023-11-28T17:39:35.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.904+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1238068860 con 0x7f12380cb2d0 2023-11-28T17:39:35.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.904+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f122c01d460 con 0x7f12380cb2d0 2023-11-28T17:39:35.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.904+0000 7f1226ffd640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f12180668d0 0x7f1218068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:35.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.904+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f122c084520 con 0x7f12380cb2d0 2023-11-28T17:39:35.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.904+0000 7f123659c640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f12180668d0 0x7f1218068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:35.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.904+0000 7f123659c640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f12180668d0 0x7f1218068d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1228007fd0 tx=0x7f1228009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:35.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:35.908+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f122c051760 con 0x7f12380cb2d0 2023-11-28T17:39:36.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.068+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f123815c000 con 0x7f12380cb2d0 2023-11-28T17:39:36.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.068+0000 7f1226ffd640 1 -- 172.21.15.16:0/2912364557 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f122c054d80 con 0x7f12380cb2d0 2023-11-28T17:39:36.071 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:36.071 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f12180668d0 msgr2=0x7f1218068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f12180668d0 0x7f1218068d90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1228007fd0 tx=0x7f1228009040 comp rx=0 tx=0).stop 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 msgr2=0x7f12380cb730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 0x7f12380cb730 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f122c00e810 tx=0x7f122c00ecd0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 shutdown_connections 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12380c9430 0x7f12380c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12380cb2d0 0x7f12380cb730 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f12180668d0 0x7f1218068d90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 --2- 172.21.15.16:0/2912364557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1220004d10 0x7f1238159570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 >> 172.21.15.16:0/2912364557 conn(0x7f123808ccf0 msgr2=0x7f12380cdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:36.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 shutdown_connections 2023-11-28T17:39:36.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.072+0000 7f123cd01640 1 -- 172.21.15.16:0/2912364557 wait complete. 2023-11-28T17:39:36.092 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T17:39:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 Processor -- start 2023-11-28T17:39:36.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 -- start start 2023-11-28T17:39:36.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f414015d540 0x7f41400b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41400b32c0 con 0x7f41400d1f50 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414015d920 con 0x7f414015d540 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f41451b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41400b35a0 con 0x7f41400d3690 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f414015d540 0x7f41400b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f414015d540 0x7f41400b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33096/0 (socket says 172.21.15.16:33096) 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 -- 172.21.15.16:0/4032392743 learned_addr learned my addr 172.21.15.16:0/4032392743 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413f59e640 1 --2- 172.21.15.16:0/4032392743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:36.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 -- 172.21.15.16:0/4032392743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 msgr2=0x7f41400cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 --2- 172.21.15.16:0/4032392743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 -- 172.21.15.16:0/4032392743 >> v1:172.21.15.64:6789/0 conn(0x7f41400d1f50 legacy=0x7f41400d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:36.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.236+0000 7f413ed9d640 1 -- 172.21.15.16:0/4032392743 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41400b3880 con 0x7f414015d540 2023-11-28T17:39:36.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f413ed9d640 1 --2- 172.21.15.16:0/4032392743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f41400b29c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4130009870 tx=0x7f413001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2288b98df3331a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f413e59c640 1 -- 172.21.15.16:0/4032392743 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300aa670 con 0x7f414015d540 2023-11-28T17:39:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f413e59c640 1 -- 172.21.15.16:0/4032392743 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41300aa7d0 con 0x7f414015d540 2023-11-28T17:39:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f413e59c640 1 -- 172.21.15.16:0/4032392743 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41300aab60 con 0x7f414015d540 2023-11-28T17:39:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 -- 172.21.15.16:0/4032392743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 msgr2=0x7f41400b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:36.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 --2- 172.21.15.16:0/4032392743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f41400b29c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4130009870 tx=0x7f413001c510 comp rx=0 tx=0).stop 2023-11-28T17:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 -- 172.21.15.16:0/4032392743 shutdown_connections 2023-11-28T17:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 --2- 172.21.15.16:0/4032392743 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 --2- 172.21.15.16:0/4032392743 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f41400b29c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 -- 172.21.15.16:0/4032392743 >> 172.21.15.16:0/4032392743 conn(0x7f414008ccf0 msgr2=0x7f414009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 -- 172.21.15.16:0/4032392743 shutdown_connections 2023-11-28T17:39:36.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.240+0000 7f41451b8640 1 -- 172.21.15.16:0/4032392743 wait complete. 2023-11-28T17:39:36.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 Processor -- start 2023-11-28T17:39:36.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 -- start start 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41400d1f50 0x7f41400ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f414015eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400cbfe0 con 0x7f414015d540 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400ca950 con 0x7f41400d1f50 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4140157510 con 0x7f41400d3690 2023-11-28T17:39:36.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f414015eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f414015eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:33104/0 (socket says 172.21.15.16:33104) 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 -- 172.21.15.16:0/3654466689 learned_addr learned my addr 172.21.15.16:0/3654466689 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413ed9d640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41400d1f50 0x7f41400ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f4137fff640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 -- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 msgr2=0x7f41400b0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400b0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 -- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41400d1f50 msgr2=0x7f41400ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41400d1f50 0x7f41400ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 -- 172.21.15.16:0/3654466689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300094d0 con 0x7f414015d540 2023-11-28T17:39:36.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f413f59e640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f414015eab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4138007e40 tx=0x7f413800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138014620 con 0x7f414015d540 2023-11-28T17:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800ee90 con 0x7f414015d540 2023-11-28T17:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41400b8420 con 0x7f414015d540 2023-11-28T17:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41380149e0 con 0x7f414015d540 2023-11-28T17:39:36.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.244+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41400b89e0 con 0x7f414015d540 2023-11-28T17:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.248+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4140068860 con 0x7f414015d540 2023-11-28T17:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.248+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4138014b40 con 0x7f414015d540 2023-11-28T17:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.248+0000 7f41377fe640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41200668d0 0x7f4120068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.248+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4138084d20 con 0x7f414015d540 2023-11-28T17:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.248+0000 7f413ed9d640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41200668d0 0x7f4120068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:36.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.248+0000 7f413ed9d640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41200668d0 0x7f4120068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41300ae000 tx=0x7f41300b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:36.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.252+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4138051f70 con 0x7f414015d540 2023-11-28T17:39:36.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:36.444+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f41400c95e0 con 0x7f414015d540 2023-11-28T17:39:37.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.384+0000 7f41377fe640 1 -- 172.21.15.16:0/3654466689 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4138055590 con 0x7f414015d540 2023-11-28T17:39:37.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.384+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41200668d0 msgr2=0x7f4120068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.384+0000 7f41451b8640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41200668d0 0x7f4120068d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f41300ae000 tx=0x7f41300b5040 comp rx=0 tx=0).stop 2023-11-28T17:39:37.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.384+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 msgr2=0x7f414015eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.384+0000 7f41451b8640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f414015eab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4138007e40 tx=0x7f413800e4b0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 shutdown_connections 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f414015d540 0x7f414015eab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41400d3690 0x7f41400b0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41200668d0 0x7f4120068d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 --2- 172.21.15.16:0/3654466689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41400d1f50 0x7f41400ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 >> 172.21.15.16:0/3654466689 conn(0x7f414008ccf0 msgr2=0x7f414006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 shutdown_connections 2023-11-28T17:39:37.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.388+0000 7f41451b8640 1 -- 172.21.15.16:0/3654466689 wait complete. 2023-11-28T17:39:37.412 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T17:39:37.412 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T17:39:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.560+0000 7faf613c4640 1 Processor -- start 2023-11-28T17:39:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.560+0000 7faf613c4640 1 -- start start 2023-11-28T17:39:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf613c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf5c0d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf613c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0b2be0 con 0x7faf5c0d1fd0 2023-11-28T17:39:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf613c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf5c0cec30 con 0x7faf5c0b3370 2023-11-28T17:39:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf613c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0d0c10 con 0x7faf5c15d5a0 2023-11-28T17:39:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faf5c0d1fd0 0x7faf5c0d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50310/0 (socket says 172.21.15.16:50310) 2023-11-28T17:39:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 -- 172.21.15.16:0/2458277683 learned_addr learned my addr 172.21.15.16:0/2458277683 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:37.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5affd640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf5c0d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3864399662 0 0) 0x7faf5c0b2be0 con 0x7faf5c0d1fd0 2023-11-28T17:39:37.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf48003530 con 0x7faf5c0d1fd0 2023-11-28T17:39:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783818445 0 0) 0x7faf5c0cec30 con 0x7faf5c0b3370 2023-11-28T17:39:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5c0b2be0 con 0x7faf5c0b3370 2023-11-28T17:39:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138928135 0 0) 0x7faf48003530 con 0x7faf5c0d1fd0 2023-11-28T17:39:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 msgr2=0x7faf5c0d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf5c0d0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 >> v1:172.21.15.64:6789/0 conn(0x7faf5c0b3370 legacy=0x7faf5c0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c0cef10 con 0x7faf5c0d1fd0 2023-11-28T17:39:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7faf44001a00 con 0x7faf5c0d1fd0 2023-11-28T17:39:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 >> v1:172.21.15.16:6789/0 conn(0x7faf5c0d1fd0 legacy=0x7faf5c0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48003bb0 0x7faf48003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf480047d0 0x7faf48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0d0c10 con 0x7faf480047d0 2023-11-28T17:39:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4800ba70 con 0x7faf48003bb0 2023-11-28T17:39:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4800bc30 con 0x7faf5c15d5a0 2023-11-28T17:39:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf480047d0 0x7faf48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5affd640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48003bb0 0x7faf48003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5b7fe640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 -- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 msgr2=0x7faf48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 -- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48003bb0 msgr2=0x7faf48003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf48003bb0 0x7faf48003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf527fc640 1 -- 172.21.15.16:0/2458277683 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf48003530 con 0x7faf480047d0 2023-11-28T17:39:37.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.564+0000 7faf5b7fe640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c15d5a0 0x7faf48005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf527fc640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf480047d0 0x7faf48004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf44002240 tx=0x7faf4401d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7016db7e1aa673 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440ad630 con 0x7faf480047d0 2023-11-28T17:39:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf440a8070 con 0x7faf480047d0 2023-11-28T17:39:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf5a7fc640 1 -- 172.21.15.16:0/2458277683 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440ad9f0 con 0x7faf480047d0 2023-11-28T17:39:37.579 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 -- 172.21.15.16:0/2458277683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf480047d0 msgr2=0x7faf48004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 --2- 172.21.15.16:0/2458277683 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf480047d0 0x7faf48004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf44002240 tx=0x7faf4401d260 comp rx=0 tx=0).stop 2023-11-28T17:39:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf5b7fe640 1 -- 172.21.15.16:0/2458277683 reap_dead start 2023-11-28T17:39:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 -- 172.21.15.16:0/2458277683 shutdown_connections 2023-11-28T17:39:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 -- 172.21.15.16:0/2458277683 >> 172.21.15.16:0/2458277683 conn(0x7faf5c09c570 msgr2=0x7faf5c0d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:37.580 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 -- 172.21.15.16:0/2458277683 shutdown_connections 2023-11-28T17:39:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 -- 172.21.15.16:0/2458277683 wait complete. 2023-11-28T17:39:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.568+0000 7faf613c4640 1 Processor -- start 2023-11-28T17:39:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- start start 2023-11-28T17:39:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf480047d0 0x7faf5c1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 0x7faf5c153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c0c9730 0x7faf5c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c0ca0f0 con 0x7faf5c1539e0 2023-11-28T17:39:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c15f8d0 con 0x7faf480047d0 2023-11-28T17:39:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5c15fbb0 con 0x7faf5c0c9730 2023-11-28T17:39:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 0x7faf5c153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.582 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 0x7faf5c153e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48362/0 (socket says 172.21.15.16:48362) 2023-11-28T17:39:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 -- 172.21.15.16:0/785112633 learned_addr learned my addr 172.21.15.16:0/785112633 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf5affd640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf480047d0 0x7faf5c1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf5b7fe640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c0c9730 0x7faf5c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 -- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c0c9730 msgr2=0x7faf5c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.583 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c0c9730 0x7faf5c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 -- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf480047d0 msgr2=0x7faf5c1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf480047d0 0x7faf5c1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 -- 172.21.15.16:0/785112633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c15fe90 con 0x7faf5c1539e0 2023-11-28T17:39:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf5affd640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf480047d0 0x7faf5c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf527fc640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 0x7faf5c153e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf44002240 tx=0x7faf48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:37.584 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440019c0 con 0x7faf5c1539e0 2023-11-28T17:39:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf44004b70 con 0x7faf5c1539e0 2023-11-28T17:39:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf440ad430 con 0x7faf5c1539e0 2023-11-28T17:39:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf5c160170 con 0x7faf5c1539e0 2023-11-28T17:39:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf5c152bf0 con 0x7faf5c1539e0 2023-11-28T17:39:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.572+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf5c0d3d00 con 0x7faf5c1539e0 2023-11-28T17:39:37.585 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.576+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faf440aa030 con 0x7faf5c1539e0 2023-11-28T17:39:37.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.576+0000 7faf53fff640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7faf3c066900 0x7faf3c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:37.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.576+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf440a5e40 con 0x7faf5c1539e0 2023-11-28T17:39:37.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.576+0000 7faf5affd640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7faf3c066900 0x7faf3c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:37.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.576+0000 7faf5affd640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7faf3c066900 0x7faf3c068dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf5c1f6a70 tx=0x7faf4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:37.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.580+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf440eb1e0 con 0x7faf5c1539e0 2023-11-28T17:39:37.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:37.772+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faf5c04e890 con 0x7faf5c1539e0 2023-11-28T17:39:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.383+0000 7faf53fff640 1 -- 172.21.15.16:0/785112633 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7faf440bb020 con 0x7faf5c1539e0 2023-11-28T17:39:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7faf3c066900 msgr2=0x7faf3c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7faf3c066900 0x7faf3c068dc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7faf5c1f6a70 tx=0x7faf4c008040 comp rx=0 tx=0).stop 2023-11-28T17:39:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 msgr2=0x7faf5c153e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 0x7faf5c153e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7faf44002240 tx=0x7faf48005800 comp rx=0 tx=0).stop 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 shutdown_connections 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faf5c0c9730 0x7faf5c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faf5c1539e0 0x7faf5c153e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7faf3c066900 0x7faf3c068dc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 --2- 172.21.15.16:0/785112633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf480047d0 0x7faf5c1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 >> 172.21.15.16:0/785112633 conn(0x7faf5c09c570 msgr2=0x7faf5c0b3f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 shutdown_connections 2023-11-28T17:39:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.387+0000 7faf613c4640 1 -- 172.21.15.16:0/785112633 wait complete. 2023-11-28T17:39:38.411 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T17:39:38.411 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:39:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.551+0000 7f8fd9fc3640 1 Processor -- start 2023-11-28T17:39:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.551+0000 7f8fd9fc3640 1 -- start start 2023-11-28T17:39:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd9fc3640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fd41548e0 0x7f8fd40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd9fc3640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd415a8b0 con 0x7f8fd4072090 2023-11-28T17:39:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd9fc3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd40cea50 con 0x7f8fd40cf640 2023-11-28T17:39:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd9fc3640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd415a6a0 con 0x7f8fd41548e0 2023-11-28T17:39:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fd41548e0 0x7f8fd40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8fd41548e0 0x7f8fd40ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48378/0 (socket says 172.21.15.16:48378) 2023-11-28T17:39:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd2ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f8fd4072090 0x7f8fd40cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50316/0 (socket says 172.21.15.16:50316) 2023-11-28T17:39:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd37fe640 1 -- 172.21.15.16:0/2726991485 learned_addr learned my addr 172.21.15.16:0/2726991485 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd37fe640 1 -- 172.21.15.16:0/2726991485 >> v1:172.21.15.64:6789/0 conn(0x7f8fd40cf640 legacy=0x7f8fd40cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd37fe640 1 -- 172.21.15.16:0/2726991485 >> v1:172.21.15.16:6789/0 conn(0x7f8fd4072090 legacy=0x7f8fd40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd37fe640 1 -- 172.21.15.16:0/2726991485 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd415ab50 con 0x7f8fd41548e0 2023-11-28T17:39:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.555+0000 7f8fd27fc640 1 -- 172.21.15.16:0/2726991485 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904318714 0 0) 0x7f8fd415a8b0 con 0x7f8fd4072090 2023-11-28T17:39:38.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd37fe640 1 --2- 172.21.15.16:0/2726991485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd40ce150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009870 tx=0x7f8fc401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed96910ab9e8066 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:38.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd27fc640 1 -- 172.21.15.16:0/2726991485 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40ab600 con 0x7f8fd41548e0 2023-11-28T17:39:38.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd27fc640 1 -- 172.21.15.16:0/2726991485 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fc40a7050 con 0x7f8fd41548e0 2023-11-28T17:39:38.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd27fc640 1 -- 172.21.15.16:0/2726991485 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40ab980 con 0x7f8fd41548e0 2023-11-28T17:39:38.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/2726991485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 msgr2=0x7f8fd40ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/2726991485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd40ce150 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8fc4009870 tx=0x7f8fc401c500 comp rx=0 tx=0).stop 2023-11-28T17:39:38.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/2726991485 shutdown_connections 2023-11-28T17:39:38.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/2726991485 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd40ce150 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/2726991485 >> 172.21.15.16:0/2726991485 conn(0x7f8fd406a5a0 msgr2=0x7f8fd406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:38.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/2726991485 shutdown_connections 2023-11-28T17:39:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/2726991485 wait complete. 2023-11-28T17:39:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 Processor -- start 2023-11-28T17:39:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.559+0000 7f8fd9fc3640 1 -- start start 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd4072090 0x7f8fd4143930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8fd40cf640 0x7f8fd4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd4159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd414bb00 con 0x7f8fd41548e0 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd414b6a0 con 0x7f8fd4072090 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd414b0e0 con 0x7f8fd40cf640 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd4159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48388/0 (socket says 172.21.15.16:48388) 2023-11-28T17:39:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 -- 172.21.15.16:0/1972357093 learned_addr learned my addr 172.21.15.16:0/1972357093 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd37fe640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd4072090 0x7f8fd4143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd2ffd640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8fd40cf640 0x7f8fd4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 -- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8fd40cf640 msgr2=0x7f8fd4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8fd40cf640 0x7f8fd4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 -- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd4072090 msgr2=0x7f8fd4143930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd4072090 0x7f8fd4143930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 -- 172.21.15.16:0/1972357093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc40094d0 con 0x7f8fd41548e0 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd37fe640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd4072090 0x7f8fd4143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd2ffd640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8fd40cf640 0x7f8fd4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd3fff640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd4159670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c780 tx=0x7f8fcc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc004b70 con 0x7f8fd41548e0 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00ce90 con 0x7f8fd41548e0 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00a850 con 0x7f8fd41548e0 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd414b3c0 con 0x7f8fd41548e0 2023-11-28T17:39:38.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd40af090 con 0x7f8fd41548e0 2023-11-28T17:39:38.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd40af2b0 con 0x7f8fd41548e0 2023-11-28T17:39:38.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.563+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8fcc00a9b0 con 0x7f8fd41548e0 2023-11-28T17:39:38.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.567+0000 7f8fbbfff640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8fc00668d0 0x7f8fc0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.567+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fcc0845e0 con 0x7f8fd41548e0 2023-11-28T17:39:38.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.567+0000 7f8fd37fe640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8fc00668d0 0x7f8fc0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.567+0000 7f8fd37fe640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8fc00668d0 0x7f8fc0068d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40ad000 tx=0x7f8fc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:38.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.571+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8fcc051820 con 0x7f8fd41548e0 2023-11-28T17:39:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fd4068860 con 0x7f8fd41548e0 2023-11-28T17:39:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fbbfff640 1 -- 172.21.15.16:0/1972357093 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f8fcc054e40 con 0x7f8fd41548e0 2023-11-28T17:39:38.762 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:38.762 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:39:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:39:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8fc00668d0 msgr2=0x7f8fc0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8fc00668d0 0x7f8fc0068d90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8fc40ad000 tx=0x7f8fc4008040 comp rx=0 tx=0).stop 2023-11-28T17:39:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 msgr2=0x7f8fd4159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd4159670 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00c780 tx=0x7f8fcc00cc40 comp rx=0 tx=0).stop 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 shutdown_connections 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8fd41548e0 0x7f8fd4159670 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8fd40cf640 0x7f8fd4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8fc00668d0 0x7f8fc0068d90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 --2- 172.21.15.16:0/1972357093 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8fd4072090 0x7f8fd4143930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 >> 172.21.15.16:0/1972357093 conn(0x7f8fd406a5a0 msgr2=0x7f8fd40712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 shutdown_connections 2023-11-28T17:39:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.759+0000 7f8fd9fc3640 1 -- 172.21.15.16:0/1972357093 wait complete. 2023-11-28T17:39:38.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:38.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.923+0000 7ff0f0ad6640 1 Processor -- start 2023-11-28T17:39:38.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.923+0000 7ff0f0ad6640 1 -- start start 2023-11-28T17:39:38.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0f0ad6640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0ec0b8b80 0x7ff0ec0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0f0ad6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff0ec0b67d0 0x7ff0ec0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0f0ad6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ec15d870 con 0x7ff0ec0cfca0 2023-11-28T17:39:38.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0f0ad6640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec0b6d20 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0f0ad6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ec0b7000 con 0x7ff0ec0b67d0 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0ec0b8b80 0x7ff0ec0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0ec0b8b80 0x7ff0ec0b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48390/0 (socket says 172.21.15.16:48390) 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 -- 172.21.15.16:0/1862325647 learned_addr learned my addr 172.21.15.16:0/1862325647 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0ead9d640 1 --2- 172.21.15.16:0/1862325647 >> v2:172.21.15.64:3300/0 conn(0x7ff0ec0b67d0 0x7ff0ec0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 -- 172.21.15.16:0/1862325647 >> v2:172.21.15.64:3300/0 conn(0x7ff0ec0b67d0 msgr2=0x7ff0ec0b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 --2- 172.21.15.16:0/1862325647 >> v2:172.21.15.64:3300/0 conn(0x7ff0ec0b67d0 0x7ff0ec0b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 -- 172.21.15.16:0/1862325647 >> v1:172.21.15.64:6789/0 conn(0x7ff0ec0cfca0 legacy=0x7ff0ec0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 -- 172.21.15.16:0/1862325647 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec0b72e0 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.927+0000 7ff0e3fff640 1 --2- 172.21.15.16:0/1862325647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec0b6290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0b61b0 tx=0x7ff0d401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e696d493d91eb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:38.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0e9d9b640 1 -- 172.21.15.16:0/1862325647 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40a89f0 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0e9d9b640 1 -- 172.21.15.16:0/1862325647 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d40a8b50 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0e9d9b640 1 -- 172.21.15.16:0/1862325647 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40b0440 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/1862325647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 msgr2=0x7ff0ec0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/1862325647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec0b6290 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0b61b0 tx=0x7ff0d401ecf0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/1862325647 shutdown_connections 2023-11-28T17:39:38.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/1862325647 >> v2:172.21.15.64:3300/0 conn(0x7ff0ec0b67d0 0x7ff0ec0b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/1862325647 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec0b6290 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/1862325647 >> 172.21.15.16:0/1862325647 conn(0x7ff0ec0720d0 msgr2=0x7ff0ec0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:38.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/1862325647 shutdown_connections 2023-11-28T17:39:38.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/1862325647 wait complete. 2023-11-28T17:39:38.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 Processor -- start 2023-11-28T17:39:38.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- start start 2023-11-28T17:39:38.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ec0b67d0 0x7ff0ec146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ec0cfca0 0x7ff0ec145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec145790 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec144b10 con 0x7ff0ec0cfca0 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.931+0000 7ff0f0ad6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ec144df0 con 0x7ff0ec0b67d0 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec1442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48404/0 (socket says 172.21.15.16:48404) 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 -- 172.21.15.16:0/4246553349 learned_addr learned my addr 172.21.15.16:0/4246553349 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0ea59c640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ec0b67d0 0x7ff0ec146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0ead9d640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ec0cfca0 0x7ff0ec145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 -- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ec0b67d0 msgr2=0x7ff0ec146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ec0b67d0 0x7ff0ec146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 -- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ec0cfca0 msgr2=0x7ff0ec145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ec0cfca0 0x7ff0ec145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 -- 172.21.15.16:0/4246553349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40094d0 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0ead9d640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ec0cfca0 0x7ff0ec145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e3fff640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec1442e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0d401b900 tx=0x7ff0d401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40ba600 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d40ba760 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40bab10 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec1450d0 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ec144820 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ec1458d0 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.935+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0d40bac70 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.939+0000 7ff0e2ffd640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff0cc066900 0x7ff0cc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:38.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.939+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0d4122940 con 0x7ff0ec0b8b80 2023-11-28T17:39:38.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.939+0000 7ff0ea59c640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff0cc066900 0x7ff0cc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:38.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.939+0000 7ff0ea59c640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff0cc066900 0x7ff0cc068dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc007fd0 tx=0x7ff0dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:38.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:38.939+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0ec1458d0 con 0x7ff0ec0b8b80 2023-11-28T17:39:39.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.099+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0ec1458d0 con 0x7ff0ec0b8b80 2023-11-28T17:39:39.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0e2ffd640 1 -- 172.21.15.16:0/4246553349 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7ff0ec1458d0 con 0x7ff0ec0b8b80 2023-11-28T17:39:39.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:39.106 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:39.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff0cc066900 msgr2=0x7ff0cc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff0cc066900 0x7ff0cc068dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc007fd0 tx=0x7ff0dc009040 comp rx=0 tx=0).stop 2023-11-28T17:39:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 msgr2=0x7ff0ec1442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec1442e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff0d401b900 tx=0x7ff0d401ba90 comp rx=0 tx=0).stop 2023-11-28T17:39:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 shutdown_connections 2023-11-28T17:39:39.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff0cc066900 0x7ff0cc068dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ec0cfca0 0x7ff0ec145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ec0b8b80 0x7ff0ec1442e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 --2- 172.21.15.16:0/4246553349 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ec0b67d0 0x7ff0ec146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 >> 172.21.15.16:0/4246553349 conn(0x7ff0ec0720d0 msgr2=0x7ff0ec0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:39.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 shutdown_connections 2023-11-28T17:39:39.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.103+0000 7ff0f0ad6640 1 -- 172.21.15.16:0/4246553349 wait complete. 2023-11-28T17:39:39.127 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T17:39:39.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:39:39.222 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T17:39:39.221+0000 7efcbb6c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T17:39:39.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff28aebb640 1 Processor -- start 2023-11-28T17:39:39.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff28aebb640 1 -- start start 2023-11-28T17:39:39.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff28aebb640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2841548e0 0x7ff2840ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff28aebb640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28415a8b0 con 0x7ff2840cf640 2023-11-28T17:39:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff28aebb640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2840cea50 con 0x7ff284072090 2023-11-28T17:39:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff28aebb640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28415a6a0 con 0x7ff2841548e0 2023-11-28T17:39:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff288c57640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff2841548e0 0x7ff2840ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff289458640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff2840cf640 0x7ff2840cc970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50320/0 (socket says 172.21.15.16:50320) 2023-11-28T17:39:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.267+0000 7ff289458640 1 -- 172.21.15.16:0/1117836993 learned_addr learned my addr 172.21.15.16:0/1117836993 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff288c57640 1 -- 172.21.15.16:0/1117836993 >> v1:172.21.15.64:6789/0 conn(0x7ff284072090 legacy=0x7ff2840cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff288c57640 1 -- 172.21.15.16:0/1117836993 >> v1:172.21.15.16:6789/0 conn(0x7ff2840cf640 legacy=0x7ff2840cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff288c57640 1 -- 172.21.15.16:0/1117836993 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28415ab50 con 0x7ff2841548e0 2023-11-28T17:39:39.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff288c57640 1 --2- 172.21.15.16:0/1117836993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2841548e0 0x7ff2840ce150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff27800ba60 tx=0x7ff27801eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=accdc3f73ec4c8d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:39.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff2837fe640 1 -- 172.21.15.16:0/1117836993 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780a7a20 con 0x7ff2841548e0 2023-11-28T17:39:39.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff2837fe640 1 -- 172.21.15.16:0/1117836993 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780a7b80 con 0x7ff2841548e0 2023-11-28T17:39:39.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff2837fe640 1 -- 172.21.15.16:0/1117836993 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780af440 con 0x7ff2841548e0 2023-11-28T17:39:39.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 -- 172.21.15.16:0/1117836993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2841548e0 msgr2=0x7ff2840ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 --2- 172.21.15.16:0/1117836993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2841548e0 0x7ff2840ce150 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff27800ba60 tx=0x7ff27801eb50 comp rx=0 tx=0).stop 2023-11-28T17:39:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 -- 172.21.15.16:0/1117836993 shutdown_connections 2023-11-28T17:39:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 --2- 172.21.15.16:0/1117836993 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2841548e0 0x7ff2840ce150 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 -- 172.21.15.16:0/1117836993 >> 172.21.15.16:0/1117836993 conn(0x7ff28406a5a0 msgr2=0x7ff28406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:39.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 -- 172.21.15.16:0/1117836993 shutdown_connections 2023-11-28T17:39:39.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.271+0000 7ff28aebb640 1 -- 172.21.15.16:0/1117836993 wait complete. 2023-11-28T17:39:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 Processor -- start 2023-11-28T17:39:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 -- start start 2023-11-28T17:39:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 0x7ff28414f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2840cf640 0x7ff284143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2841548e0 0x7ff284145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28414f1e0 con 0x7ff284072090 2023-11-28T17:39:39.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28414fb40 con 0x7ff2841548e0 2023-11-28T17:39:39.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff28aebb640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28414e560 con 0x7ff2840cf640 2023-11-28T17:39:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 0x7ff28414f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 0x7ff28414f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48426/0 (socket says 172.21.15.16:48426) 2023-11-28T17:39:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 -- 172.21.15.16:0/2127031311 learned_addr learned my addr 172.21.15.16:0/2127031311 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff289458640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2841548e0 0x7ff284145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff283fff640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2840cf640 0x7ff284143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 -- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2840cf640 msgr2=0x7ff284143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2840cf640 0x7ff284143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 -- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2841548e0 msgr2=0x7ff284145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2841548e0 0x7ff284145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 -- 172.21.15.16:0/2127031311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27800b6c0 con 0x7ff284072090 2023-11-28T17:39:39.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.275+0000 7ff288c57640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 0x7ff28414f600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff27801b760 tx=0x7ff27801b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:39.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780b8660 con 0x7ff284072090 2023-11-28T17:39:39.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780b87e0 con 0x7ff284072090 2023-11-28T17:39:39.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780b8b90 con 0x7ff284072090 2023-11-28T17:39:39.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28414e840 con 0x7ff284072090 2023-11-28T17:39:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28414ee00 con 0x7ff284072090 2023-11-28T17:39:39.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28414f320 con 0x7ff284072090 2023-11-28T17:39:39.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff2780b6070 con 0x7ff284072090 2023-11-28T17:39:39.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff2817fa640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff268066900 0x7ff268068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff27811f630 con 0x7ff284072090 2023-11-28T17:39:39.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.279+0000 7ff283fff640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff268066900 0x7ff268068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.283+0000 7ff283fff640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff268066900 0x7ff268068dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff2840b1d30 tx=0x7ff270009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:39.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.283+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff28414f320 con 0x7ff284072090 2023-11-28T17:39:39.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.447+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff28414f320 con 0x7ff268066900 2023-11-28T17:39:39.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.455+0000 7ff2817fa640 1 -- 172.21.15.16:0/2127031311 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264645 (secure 0 0 0) 0x7ff28414f320 con 0x7ff268066900 2023-11-28T17:39:39.460 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:39.463 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:39:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff268066900 msgr2=0x7ff268068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff268066900 0x7ff268068dc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff2840b1d30 tx=0x7ff270009040 comp rx=0 tx=0).stop 2023-11-28T17:39:39.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 msgr2=0x7ff28414f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 0x7ff28414f600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff27801b760 tx=0x7ff27801b8f0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 shutdown_connections 2023-11-28T17:39:39.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff268066900 0x7ff268068dc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2841548e0 0x7ff284145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2840cf640 0x7ff284143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 --2- 172.21.15.16:0/2127031311 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff284072090 0x7ff28414f600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 >> 172.21.15.16:0/2127031311 conn(0x7ff28406a5a0 msgr2=0x7ff28406a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:39.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 shutdown_connections 2023-11-28T17:39:39.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.459+0000 7ff28aebb640 1 -- 172.21.15.16:0/2127031311 wait complete. 2023-11-28T17:39:39.482 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T17:39:38.765896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231520,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743200,"statfs":{"total":773094113280,"available":772857036800,"internally_reserved":0,"allocated":2940928,"data_stored":1757173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.727254"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450114+0000","last_change":"2023-11-28T17:39:35.076736+0000","last_active":"2023-11-28T17:39:36.450114+0000","last_peered":"2023-11-28T17:39:36.450114+0000","last_clean":"2023-11-28T17:39:36.450114+0000","last_became_active":"2023-11-28T17:39:35.076314+0000","last_became_peered":"2023-11-28T17:39:35.076314+0000","last_unstale":"2023-11-28T17:39:36.450114+0000","last_undegraded":"2023-11-28T17:39:36.450114+0000","last_fullsized":"2023-11-28T17:39:36.450114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050954+0000","last_change":"2023-11-28T17:39:35.074659+0000","last_active":"2023-11-28T17:39:36.050954+0000","last_peered":"2023-11-28T17:39:36.050954+0000","last_clean":"2023-11-28T17:39:36.050954+0000","last_became_active":"2023-11-28T17:39:35.074240+0000","last_became_peered":"2023-11-28T17:39:35.074240+0000","last_unstale":"2023-11-28T17:39:36.050954+0000","last_undegraded":"2023-11-28T17:39:36.050954+0000","last_fullsized":"2023-11-28T17:39:36.050954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050415+0000","last_change":"2023-11-28T17:39:35.072116+0000","last_active":"2023-11-28T17:39:36.050415+0000","last_peered":"2023-11-28T17:39:36.050415+0000","last_clean":"2023-11-28T17:39:36.050415+0000","last_became_active":"2023-11-28T17:39:35.071687+0000","last_became_peered":"2023-11-28T17:39:35.071687+0000","last_unstale":"2023-11-28T17:39:36.050415+0000","last_undegraded":"2023-11-28T17:39:36.050415+0000","last_fullsized":"2023-11-28T17:39:36.050415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.064075+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.063682+0000","last_became_peered":"2023-11-28T17:39:35.063682+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448696+0000","last_change":"2023-11-28T17:39:35.077549+0000","last_active":"2023-11-28T17:39:36.448696+0000","last_peered":"2023-11-28T17:39:36.448696+0000","last_clean":"2023-11-28T17:39:36.448696+0000","last_became_active":"2023-11-28T17:39:35.077185+0000","last_became_peered":"2023-11-28T17:39:35.077185+0000","last_unstale":"2023-11-28T17:39:36.448696+0000","last_undegraded":"2023-11-28T17:39:36.448696+0000","last_fullsized":"2023-11-28T17:39:36.448696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049692+0000","last_change":"2023-11-28T17:39:35.057293+0000","last_active":"2023-11-28T17:39:36.049692+0000","last_peered":"2023-11-28T17:39:36.049692+0000","last_clean":"2023-11-28T17:39:36.049692+0000","last_became_active":"2023-11-28T17:39:35.057018+0000","last_became_peered":"2023-11-28T17:39:35.057018+0000","last_unstale":"2023-11-28T17:39:36.049692+0000","last_undegraded":"2023-11-28T17:39:36.049692+0000","last_fullsized":"2023-11-28T17:39:36.049692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:49.748812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448373+0000","last_change":"2023-11-28T17:39:35.068482+0000","last_active":"2023-11-28T17:39:36.448373+0000","last_peered":"2023-11-28T17:39:36.448373+0000","last_clean":"2023-11-28T17:39:36.448373+0000","last_became_active":"2023-11-28T17:39:35.066863+0000","last_became_peered":"2023-11-28T17:39:35.066863+0000","last_unstale":"2023-11-28T17:39:36.448373+0000","last_undegraded":"2023-11-28T17:39:36.448373+0000","last_fullsized":"2023-11-28T17:39:36.448373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051099+0000","last_change":"2023-11-28T17:39:35.085078+0000","last_active":"2023-11-28T17:39:36.051099+0000","last_peered":"2023-11-28T17:39:36.051099+0000","last_clean":"2023-11-28T17:39:36.051099+0000","last_became_active":"2023-11-28T17:39:35.084745+0000","last_became_peered":"2023-11-28T17:39:35.084745+0000","last_unstale":"2023-11-28T17:39:36.051099+0000","last_undegraded":"2023-11-28T17:39:36.051099+0000","last_fullsized":"2023-11-28T17:39:36.051099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449706+0000","last_change":"2023-11-28T17:39:35.080106+0000","last_active":"2023-11-28T17:39:36.449706+0000","last_peered":"2023-11-28T17:39:36.449706+0000","last_clean":"2023-11-28T17:39:36.449706+0000","last_became_active":"2023-11-28T17:39:35.079816+0000","last_became_peered":"2023-11-28T17:39:35.079816+0000","last_unstale":"2023-11-28T17:39:36.449706+0000","last_undegraded":"2023-11-28T17:39:36.449706+0000","last_fullsized":"2023-11-28T17:39:36.449706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450080+0000","last_change":"2023-11-28T17:39:35.074439+0000","last_active":"2023-11-28T17:39:36.450080+0000","last_peered":"2023-11-28T17:39:36.450080+0000","last_clean":"2023-11-28T17:39:36.450080+0000","last_became_active":"2023-11-28T17:39:35.073858+0000","last_became_peered":"2023-11-28T17:39:35.073858+0000","last_unstale":"2023-11-28T17:39:36.450080+0000","last_undegraded":"2023-11-28T17:39:36.450080+0000","last_fullsized":"2023-11-28T17:39:36.450080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450026+0000","last_change":"2023-11-28T17:39:35.070060+0000","last_active":"2023-11-28T17:39:36.450026+0000","last_peered":"2023-11-28T17:39:36.450026+0000","last_clean":"2023-11-28T17:39:36.450026+0000","last_became_active":"2023-11-28T17:39:35.069384+0000","last_became_peered":"2023-11-28T17:39:35.069384+0000","last_unstale":"2023-11-28T17:39:36.450026+0000","last_undegraded":"2023-11-28T17:39:36.450026+0000","last_fullsized":"2023-11-28T17:39:36.450026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449873+0000","last_change":"2023-11-28T17:39:35.082371+0000","last_active":"2023-11-28T17:39:36.449873+0000","last_peered":"2023-11-28T17:39:36.449873+0000","last_clean":"2023-11-28T17:39:36.449873+0000","last_became_active":"2023-11-28T17:39:35.081668+0000","last_became_peered":"2023-11-28T17:39:35.081668+0000","last_unstale":"2023-11-28T17:39:36.449873+0000","last_undegraded":"2023-11-28T17:39:36.449873+0000","last_fullsized":"2023-11-28T17:39:36.449873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312169+0000","last_change":"2023-11-28T17:39:35.082173+0000","last_active":"2023-11-28T17:39:36.312169+0000","last_peered":"2023-11-28T17:39:36.312169+0000","last_clean":"2023-11-28T17:39:36.312169+0000","last_became_active":"2023-11-28T17:39:35.080696+0000","last_became_peered":"2023-11-28T17:39:35.080696+0000","last_unstale":"2023-11-28T17:39:36.312169+0000","last_undegraded":"2023-11-28T17:39:36.312169+0000","last_fullsized":"2023-11-28T17:39:36.312169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311941+0000","last_change":"2023-11-28T17:39:35.080498+0000","last_active":"2023-11-28T17:39:36.311941+0000","last_peered":"2023-11-28T17:39:36.311941+0000","last_clean":"2023-11-28T17:39:36.311941+0000","last_became_active":"2023-11-28T17:39:35.080163+0000","last_became_peered":"2023-11-28T17:39:35.080163+0000","last_unstale":"2023-11-28T17:39:36.311941+0000","last_undegraded":"2023-11-28T17:39:36.311941+0000","last_fullsized":"2023-11-28T17:39:36.311941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051297+0000","last_change":"2023-11-28T17:39:35.084970+0000","last_active":"2023-11-28T17:39:36.051297+0000","last_peered":"2023-11-28T17:39:36.051297+0000","last_clean":"2023-11-28T17:39:36.051297+0000","last_became_active":"2023-11-28T17:39:35.084639+0000","last_became_peered":"2023-11-28T17:39:35.084639+0000","last_unstale":"2023-11-28T17:39:36.051297+0000","last_undegraded":"2023-11-28T17:39:36.051297+0000","last_fullsized":"2023-11-28T17:39:36.051297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449523+0000","last_change":"2023-11-28T17:39:35.072393+0000","last_active":"2023-11-28T17:39:36.449523+0000","last_peered":"2023-11-28T17:39:36.449523+0000","last_clean":"2023-11-28T17:39:36.449523+0000","last_became_active":"2023-11-28T17:39:35.071917+0000","last_became_peered":"2023-11-28T17:39:35.071917+0000","last_unstale":"2023-11-28T17:39:36.449523+0000","last_undegraded":"2023-11-28T17:39:36.449523+0000","last_fullsized":"2023-11-28T17:39:36.449523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:09.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449618+0000","last_change":"2023-11-28T17:39:35.080914+0000","last_active":"2023-11-28T17:39:36.449618+0000","last_peered":"2023-11-28T17:39:36.449618+0000","last_clean":"2023-11-28T17:39:36.449618+0000","last_became_active":"2023-11-28T17:39:35.080586+0000","last_became_peered":"2023-11-28T17:39:35.080586+0000","last_unstale":"2023-11-28T17:39:36.449618+0000","last_undegraded":"2023-11-28T17:39:36.449618+0000","last_fullsized":"2023-11-28T17:39:36.449618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:14:15.208179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.082833+0000","last_change":"2023-11-28T17:39:35.077623+0000","last_active":"2023-11-28T17:39:35.082833+0000","last_peered":"2023-11-28T17:39:35.082833+0000","last_clean":"2023-11-28T17:39:35.082833+0000","last_became_active":"2023-11-28T17:39:35.077222+0000","last_became_peered":"2023-11-28T17:39:35.077222+0000","last_unstale":"2023-11-28T17:39:35.082833+0000","last_undegraded":"2023-11-28T17:39:35.082833+0000","last_fullsized":"2023-11-28T17:39:35.082833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:10.713100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449521+0000","last_change":"2023-11-28T17:39:35.067332+0000","last_active":"2023-11-28T17:39:36.449521+0000","last_peered":"2023-11-28T17:39:36.449521+0000","last_clean":"2023-11-28T17:39:36.449521+0000","last_became_active":"2023-11-28T17:39:35.066983+0000","last_became_peered":"2023-11-28T17:39:35.066983+0000","last_unstale":"2023-11-28T17:39:36.449521+0000","last_undegraded":"2023-11-28T17:39:36.449521+0000","last_fullsized":"2023-11-28T17:39:36.449521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:25.743991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449930+0000","last_change":"2023-11-28T17:39:35.082580+0000","last_active":"2023-11-28T17:39:36.449930+0000","last_peered":"2023-11-28T17:39:36.449930+0000","last_clean":"2023-11-28T17:39:36.449930+0000","last_became_active":"2023-11-28T17:39:35.082091+0000","last_became_peered":"2023-11-28T17:39:35.082091+0000","last_unstale":"2023-11-28T17:39:36.449930+0000","last_undegraded":"2023-11-28T17:39:36.449930+0000","last_fullsized":"2023-11-28T17:39:36.449930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448106+0000","last_change":"2023-11-28T17:39:35.055626+0000","last_active":"2023-11-28T17:39:36.448106+0000","last_peered":"2023-11-28T17:39:36.448106+0000","last_clean":"2023-11-28T17:39:36.448106+0000","last_became_active":"2023-11-28T17:39:35.055320+0000","last_became_peered":"2023-11-28T17:39:35.055320+0000","last_unstale":"2023-11-28T17:39:36.448106+0000","last_undegraded":"2023-11-28T17:39:36.448106+0000","last_fullsized":"2023-11-28T17:39:36.448106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449446+0000","last_change":"2023-11-28T17:39:35.065869+0000","last_active":"2023-11-28T17:39:36.449446+0000","last_peered":"2023-11-28T17:39:36.449446+0000","last_clean":"2023-11-28T17:39:36.449446+0000","last_became_active":"2023-11-28T17:39:35.065570+0000","last_became_peered":"2023-11-28T17:39:35.065570+0000","last_unstale":"2023-11-28T17:39:36.449446+0000","last_undegraded":"2023-11-28T17:39:36.449446+0000","last_fullsized":"2023-11-28T17:39:36.449446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051520+0000","last_change":"2023-11-28T17:39:35.072179+0000","last_active":"2023-11-28T17:39:36.051520+0000","last_peered":"2023-11-28T17:39:36.051520+0000","last_clean":"2023-11-28T17:39:36.051520+0000","last_became_active":"2023-11-28T17:39:35.071851+0000","last_became_peered":"2023-11-28T17:39:35.071851+0000","last_unstale":"2023-11-28T17:39:36.051520+0000","last_undegraded":"2023-11-28T17:39:36.051520+0000","last_fullsized":"2023-11-28T17:39:36.051520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449666+0000","last_change":"2023-11-28T17:39:35.072638+0000","last_active":"2023-11-28T17:39:36.449666+0000","last_peered":"2023-11-28T17:39:36.449666+0000","last_clean":"2023-11-28T17:39:36.449666+0000","last_became_active":"2023-11-28T17:39:35.072144+0000","last_became_peered":"2023-11-28T17:39:35.072144+0000","last_unstale":"2023-11-28T17:39:36.449666+0000","last_undegraded":"2023-11-28T17:39:36.449666+0000","last_fullsized":"2023-11-28T17:39:36.449666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:58.098189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050465+0000","last_change":"2023-11-28T17:39:35.079771+0000","last_active":"2023-11-28T17:39:36.050465+0000","last_peered":"2023-11-28T17:39:36.050465+0000","last_clean":"2023-11-28T17:39:36.050465+0000","last_became_active":"2023-11-28T17:39:35.079423+0000","last_became_peered":"2023-11-28T17:39:35.079423+0000","last_unstale":"2023-11-28T17:39:36.050465+0000","last_undegraded":"2023-11-28T17:39:36.050465+0000","last_fullsized":"2023-11-28T17:39:36.050465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049922+0000","last_change":"2023-11-28T17:39:35.073441+0000","last_active":"2023-11-28T17:39:36.049922+0000","last_peered":"2023-11-28T17:39:36.049922+0000","last_clean":"2023-11-28T17:39:36.049922+0000","last_became_active":"2023-11-28T17:39:35.072851+0000","last_became_peered":"2023-11-28T17:39:35.072851+0000","last_unstale":"2023-11-28T17:39:36.049922+0000","last_undegraded":"2023-11-28T17:39:36.049922+0000","last_fullsized":"2023-11-28T17:39:36.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312430+0000","last_change":"2023-11-28T17:39:35.079706+0000","last_active":"2023-11-28T17:39:36.312430+0000","last_peered":"2023-11-28T17:39:36.312430+0000","last_clean":"2023-11-28T17:39:36.312430+0000","last_became_active":"2023-11-28T17:39:35.079231+0000","last_became_peered":"2023-11-28T17:39:35.079231+0000","last_unstale":"2023-11-28T17:39:36.312430+0000","last_undegraded":"2023-11-28T17:39:36.312430+0000","last_fullsized":"2023-11-28T17:39:36.312430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312261+0000","last_change":"2023-11-28T17:39:35.078579+0000","last_active":"2023-11-28T17:39:36.312261+0000","last_peered":"2023-11-28T17:39:36.312261+0000","last_clean":"2023-11-28T17:39:36.312261+0000","last_became_active":"2023-11-28T17:39:35.078259+0000","last_became_peered":"2023-11-28T17:39:35.078259+0000","last_unstale":"2023-11-28T17:39:36.312261+0000","last_undegraded":"2023-11-28T17:39:36.312261+0000","last_fullsized":"2023-11-28T17:39:36.312261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050907+0000","last_change":"2023-11-28T17:39:35.082408+0000","last_active":"2023-11-28T17:39:36.050907+0000","last_peered":"2023-11-28T17:39:36.050907+0000","last_clean":"2023-11-28T17:39:36.050907+0000","last_became_active":"2023-11-28T17:39:35.082098+0000","last_became_peered":"2023-11-28T17:39:35.082098+0000","last_unstale":"2023-11-28T17:39:36.050907+0000","last_undegraded":"2023-11-28T17:39:36.050907+0000","last_fullsized":"2023-11-28T17:39:36.050907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449034+0000","last_change":"2023-11-28T17:39:35.079528+0000","last_active":"2023-11-28T17:39:36.449034+0000","last_peered":"2023-11-28T17:39:36.449034+0000","last_clean":"2023-11-28T17:39:36.449034+0000","last_became_active":"2023-11-28T17:39:35.079243+0000","last_became_peered":"2023-11-28T17:39:35.079243+0000","last_unstale":"2023-11-28T17:39:36.449034+0000","last_undegraded":"2023-11-28T17:39:36.449034+0000","last_fullsized":"2023-11-28T17:39:36.449034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.082936+0000","last_change":"2023-11-28T17:39:35.078211+0000","last_active":"2023-11-28T17:39:35.082936+0000","last_peered":"2023-11-28T17:39:35.082936+0000","last_clean":"2023-11-28T17:39:35.082936+0000","last_became_active":"2023-11-28T17:39:35.077631+0000","last_became_peered":"2023-11-28T17:39:35.077631+0000","last_unstale":"2023-11-28T17:39:35.082936+0000","last_undegraded":"2023-11-28T17:39:35.082936+0000","last_fullsized":"2023-11-28T17:39:35.082936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:40.356373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049377+0000","last_change":"2023-11-28T17:39:35.072541+0000","last_active":"2023-11-28T17:39:36.049377+0000","last_peered":"2023-11-28T17:39:36.049377+0000","last_clean":"2023-11-28T17:39:36.049377+0000","last_became_active":"2023-11-28T17:39:35.072263+0000","last_became_peered":"2023-11-28T17:39:35.072263+0000","last_unstale":"2023-11-28T17:39:36.049377+0000","last_undegraded":"2023-11-28T17:39:36.049377+0000","last_fullsized":"2023-11-28T17:39:36.049377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:06.392677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449588+0000","last_change":"2023-11-28T17:39:35.070782+0000","last_active":"2023-11-28T17:39:36.449588+0000","last_peered":"2023-11-28T17:39:36.449588+0000","last_clean":"2023-11-28T17:39:36.449588+0000","last_became_active":"2023-11-28T17:39:35.070466+0000","last_became_peered":"2023-11-28T17:39:35.070466+0000","last_unstale":"2023-11-28T17:39:36.449588+0000","last_undegraded":"2023-11-28T17:39:36.449588+0000","last_fullsized":"2023-11-28T17:39:36.449588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050871+0000","last_change":"2023-11-28T17:39:34.073844+0000","last_active":"2023-11-28T17:39:36.050871+0000","last_peered":"2023-11-28T17:39:36.050871+0000","last_clean":"2023-11-28T17:39:36.050871+0000","last_became_active":"2023-11-28T17:39:34.073439+0000","last_became_peered":"2023-11-28T17:39:34.073439+0000","last_unstale":"2023-11-28T17:39:36.050871+0000","last_undegraded":"2023-11-28T17:39:36.050871+0000","last_fullsized":"2023-11-28T17:39:36.050871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448062+0000","last_change":"2023-11-28T17:39:35.077086+0000","last_active":"2023-11-28T17:39:36.448062+0000","last_peered":"2023-11-28T17:39:36.448062+0000","last_clean":"2023-11-28T17:39:36.448062+0000","last_became_active":"2023-11-28T17:39:35.076725+0000","last_became_peered":"2023-11-28T17:39:35.076725+0000","last_unstale":"2023-11-28T17:39:36.448062+0000","last_undegraded":"2023-11-28T17:39:36.448062+0000","last_fullsized":"2023-11-28T17:39:36.448062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449252+0000","last_change":"2023-11-28T17:39:34.072648+0000","last_active":"2023-11-28T17:39:36.449252+0000","last_peered":"2023-11-28T17:39:36.449252+0000","last_clean":"2023-11-28T17:39:36.449252+0000","last_became_active":"2023-11-28T17:39:34.072323+0000","last_became_peered":"2023-11-28T17:39:34.072323+0000","last_unstale":"2023-11-28T17:39:36.449252+0000","last_undegraded":"2023-11-28T17:39:36.449252+0000","last_fullsized":"2023-11-28T17:39:36.449252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:54.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311863+0000","last_change":"2023-11-28T17:39:34.075937+0000","last_active":"2023-11-28T17:39:36.311863+0000","last_peered":"2023-11-28T17:39:36.311863+0000","last_clean":"2023-11-28T17:39:36.311863+0000","last_became_active":"2023-11-28T17:39:34.075701+0000","last_became_peered":"2023-11-28T17:39:34.075701+0000","last_unstale":"2023-11-28T17:39:36.311863+0000","last_undegraded":"2023-11-28T17:39:36.311863+0000","last_fullsized":"2023-11-28T17:39:36.311863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051241+0000","last_change":"2023-11-28T17:39:35.081382+0000","last_active":"2023-11-28T17:39:36.051241+0000","last_peered":"2023-11-28T17:39:36.051241+0000","last_clean":"2023-11-28T17:39:36.051241+0000","last_became_active":"2023-11-28T17:39:35.080860+0000","last_became_peered":"2023-11-28T17:39:35.080860+0000","last_unstale":"2023-11-28T17:39:36.051241+0000","last_undegraded":"2023-11-28T17:39:36.051241+0000","last_fullsized":"2023-11-28T17:39:36.051241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449747+0000","last_change":"2023-11-28T17:39:34.069183+0000","last_active":"2023-11-28T17:39:36.449747+0000","last_peered":"2023-11-28T17:39:36.449747+0000","last_clean":"2023-11-28T17:39:36.449747+0000","last_became_active":"2023-11-28T17:39:34.068877+0000","last_became_peered":"2023-11-28T17:39:34.068877+0000","last_unstale":"2023-11-28T17:39:36.449747+0000","last_undegraded":"2023-11-28T17:39:36.449747+0000","last_fullsized":"2023-11-28T17:39:36.449747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448060+0000","last_change":"2023-11-28T17:39:35.068002+0000","last_active":"2023-11-28T17:39:36.448060+0000","last_peered":"2023-11-28T17:39:36.448060+0000","last_clean":"2023-11-28T17:39:36.448060+0000","last_became_active":"2023-11-28T17:39:35.067573+0000","last_became_peered":"2023-11-28T17:39:35.067573+0000","last_unstale":"2023-11-28T17:39:36.448060+0000","last_undegraded":"2023-11-28T17:39:36.448060+0000","last_fullsized":"2023-11-28T17:39:36.448060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449790+0000","last_change":"2023-11-28T17:39:34.071729+0000","last_active":"2023-11-28T17:39:36.449790+0000","last_peered":"2023-11-28T17:39:36.449790+0000","last_clean":"2023-11-28T17:39:36.449790+0000","last_became_active":"2023-11-28T17:39:34.070600+0000","last_became_peered":"2023-11-28T17:39:34.070600+0000","last_unstale":"2023-11-28T17:39:36.449790+0000","last_undegraded":"2023-11-28T17:39:36.449790+0000","last_fullsized":"2023-11-28T17:39:36.449790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.073594+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.073073+0000","last_became_peered":"2023-11-28T17:39:35.073073+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450176+0000","last_change":"2023-11-28T17:39:34.074904+0000","last_active":"2023-11-28T17:39:36.450176+0000","last_peered":"2023-11-28T17:39:36.450176+0000","last_clean":"2023-11-28T17:39:36.450176+0000","last_became_active":"2023-11-28T17:39:34.074606+0000","last_became_peered":"2023-11-28T17:39:34.074606+0000","last_unstale":"2023-11-28T17:39:36.450176+0000","last_undegraded":"2023-11-28T17:39:36.450176+0000","last_fullsized":"2023-11-28T17:39:36.450176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:32.724833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051559+0000","last_change":"2023-11-28T17:39:35.070120+0000","last_active":"2023-11-28T17:39:36.051559+0000","last_peered":"2023-11-28T17:39:36.051559+0000","last_clean":"2023-11-28T17:39:36.051559+0000","last_became_active":"2023-11-28T17:39:35.069783+0000","last_became_peered":"2023-11-28T17:39:35.069783+0000","last_unstale":"2023-11-28T17:39:36.051559+0000","last_undegraded":"2023-11-28T17:39:36.051559+0000","last_fullsized":"2023-11-28T17:39:36.051559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.390412+0000","last_change":"2023-11-28T17:39:34.067851+0000","last_active":"2023-11-28T17:39:35.390412+0000","last_peered":"2023-11-28T17:39:35.390412+0000","last_clean":"2023-11-28T17:39:35.390412+0000","last_became_active":"2023-11-28T17:39:34.067453+0000","last_became_peered":"2023-11-28T17:39:34.067453+0000","last_unstale":"2023-11-28T17:39:35.390412+0000","last_undegraded":"2023-11-28T17:39:35.390412+0000","last_fullsized":"2023-11-28T17:39:35.390412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:16.353473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448952+0000","last_change":"2023-11-28T17:39:35.062689+0000","last_active":"2023-11-28T17:39:36.448952+0000","last_peered":"2023-11-28T17:39:36.448952+0000","last_clean":"2023-11-28T17:39:36.448952+0000","last_became_active":"2023-11-28T17:39:35.062421+0000","last_became_peered":"2023-11-28T17:39:35.062421+0000","last_unstale":"2023-11-28T17:39:36.448952+0000","last_undegraded":"2023-11-28T17:39:36.448952+0000","last_fullsized":"2023-11-28T17:39:36.448952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049994+0000","last_change":"2023-11-28T17:39:34.058487+0000","last_active":"2023-11-28T17:39:36.049994+0000","last_peered":"2023-11-28T17:39:36.049994+0000","last_clean":"2023-11-28T17:39:36.049994+0000","last_became_active":"2023-11-28T17:39:34.058159+0000","last_became_peered":"2023-11-28T17:39:34.058159+0000","last_unstale":"2023-11-28T17:39:36.049994+0000","last_undegraded":"2023-11-28T17:39:36.049994+0000","last_fullsized":"2023-11-28T17:39:36.049994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:25.039707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450178+0000","last_change":"2023-11-28T17:39:35.076401+0000","last_active":"2023-11-28T17:39:36.450178+0000","last_peered":"2023-11-28T17:39:36.450178+0000","last_clean":"2023-11-28T17:39:36.450178+0000","last_became_active":"2023-11-28T17:39:35.076015+0000","last_became_peered":"2023-11-28T17:39:35.076015+0000","last_unstale":"2023-11-28T17:39:36.450178+0000","last_undegraded":"2023-11-28T17:39:36.450178+0000","last_fullsized":"2023-11-28T17:39:36.450178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.389142+0000","last_change":"2023-11-28T17:39:34.068303+0000","last_active":"2023-11-28T17:39:35.389142+0000","last_peered":"2023-11-28T17:39:35.389142+0000","last_clean":"2023-11-28T17:39:35.389142+0000","last_became_active":"2023-11-28T17:39:34.066648+0000","last_became_peered":"2023-11-28T17:39:34.066648+0000","last_unstale":"2023-11-28T17:39:35.389142+0000","last_undegraded":"2023-11-28T17:39:35.389142+0000","last_fullsized":"2023-11-28T17:39:35.389142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:39.488626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311919+0000","last_change":"2023-11-28T17:39:35.067106+0000","last_active":"2023-11-28T17:39:36.311919+0000","last_peered":"2023-11-28T17:39:36.311919+0000","last_clean":"2023-11-28T17:39:36.311919+0000","last_became_active":"2023-11-28T17:39:35.066673+0000","last_became_peered":"2023-11-28T17:39:35.066673+0000","last_unstale":"2023-11-28T17:39:36.311919+0000","last_undegraded":"2023-11-28T17:39:36.311919+0000","last_fullsized":"2023-11-28T17:39:36.311919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449337+0000","last_change":"2023-11-28T17:39:34.073519+0000","last_active":"2023-11-28T17:39:36.449337+0000","last_peered":"2023-11-28T17:39:36.449337+0000","last_clean":"2023-11-28T17:39:36.449337+0000","last_became_active":"2023-11-28T17:39:34.073200+0000","last_became_peered":"2023-11-28T17:39:34.073200+0000","last_unstale":"2023-11-28T17:39:36.449337+0000","last_undegraded":"2023-11-28T17:39:36.449337+0000","last_fullsized":"2023-11-28T17:39:36.449337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449088+0000","last_change":"2023-11-28T17:39:35.080909+0000","last_active":"2023-11-28T17:39:36.449088+0000","last_peered":"2023-11-28T17:39:36.449088+0000","last_clean":"2023-11-28T17:39:36.449088+0000","last_became_active":"2023-11-28T17:39:35.080072+0000","last_became_peered":"2023-11-28T17:39:35.080072+0000","last_unstale":"2023-11-28T17:39:36.449088+0000","last_undegraded":"2023-11-28T17:39:36.449088+0000","last_fullsized":"2023-11-28T17:39:36.449088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448347+0000","last_change":"2023-11-28T17:39:34.069169+0000","last_active":"2023-11-28T17:39:36.448347+0000","last_peered":"2023-11-28T17:39:36.448347+0000","last_clean":"2023-11-28T17:39:36.448347+0000","last_became_active":"2023-11-28T17:39:34.067860+0000","last_became_peered":"2023-11-28T17:39:34.067860+0000","last_unstale":"2023-11-28T17:39:36.448347+0000","last_undegraded":"2023-11-28T17:39:36.448347+0000","last_fullsized":"2023-11-28T17:39:36.448347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:18.869334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448881+0000","last_change":"2023-11-28T17:39:35.071533+0000","last_active":"2023-11-28T17:39:36.448881+0000","last_peered":"2023-11-28T17:39:36.448881+0000","last_clean":"2023-11-28T17:39:36.448881+0000","last_became_active":"2023-11-28T17:39:35.071284+0000","last_became_peered":"2023-11-28T17:39:35.071284+0000","last_unstale":"2023-11-28T17:39:36.448881+0000","last_undegraded":"2023-11-28T17:39:36.448881+0000","last_fullsized":"2023-11-28T17:39:36.448881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447799+0000","last_change":"2023-11-28T17:39:34.060653+0000","last_active":"2023-11-28T17:39:36.447799+0000","last_peered":"2023-11-28T17:39:36.447799+0000","last_clean":"2023-11-28T17:39:36.447799+0000","last_became_active":"2023-11-28T17:39:34.060015+0000","last_became_peered":"2023-11-28T17:39:34.060015+0000","last_unstale":"2023-11-28T17:39:36.447799+0000","last_undegraded":"2023-11-28T17:39:36.447799+0000","last_fullsized":"2023-11-28T17:39:36.447799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:05.390132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448738+0000","last_change":"2023-11-28T17:39:35.065169+0000","last_active":"2023-11-28T17:39:36.448738+0000","last_peered":"2023-11-28T17:39:36.448738+0000","last_clean":"2023-11-28T17:39:36.448738+0000","last_became_active":"2023-11-28T17:39:35.064318+0000","last_became_peered":"2023-11-28T17:39:35.064318+0000","last_unstale":"2023-11-28T17:39:36.448738+0000","last_undegraded":"2023-11-28T17:39:36.448738+0000","last_fullsized":"2023-11-28T17:39:36.448738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450204+0000","last_change":"2023-11-28T17:39:34.062100+0000","last_active":"2023-11-28T17:39:36.450204+0000","last_peered":"2023-11-28T17:39:36.450204+0000","last_clean":"2023-11-28T17:39:36.450204+0000","last_became_active":"2023-11-28T17:39:34.061747+0000","last_became_peered":"2023-11-28T17:39:34.061747+0000","last_unstale":"2023-11-28T17:39:36.450204+0000","last_undegraded":"2023-11-28T17:39:36.450204+0000","last_fullsized":"2023-11-28T17:39:36.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050050+0000","last_change":"2023-11-28T17:39:35.065690+0000","last_active":"2023-11-28T17:39:36.050050+0000","last_peered":"2023-11-28T17:39:36.050050+0000","last_clean":"2023-11-28T17:39:36.050050+0000","last_became_active":"2023-11-28T17:39:35.065320+0000","last_became_peered":"2023-11-28T17:39:35.065320+0000","last_unstale":"2023-11-28T17:39:36.050050+0000","last_undegraded":"2023-11-28T17:39:36.050050+0000","last_fullsized":"2023-11-28T17:39:36.050050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448234+0000","last_change":"2023-11-28T17:39:34.061533+0000","last_active":"2023-11-28T17:39:36.448234+0000","last_peered":"2023-11-28T17:39:36.448234+0000","last_clean":"2023-11-28T17:39:36.448234+0000","last_became_active":"2023-11-28T17:39:34.061186+0000","last_became_peered":"2023-11-28T17:39:34.061186+0000","last_unstale":"2023-11-28T17:39:36.448234+0000","last_undegraded":"2023-11-28T17:39:36.448234+0000","last_fullsized":"2023-11-28T17:39:36.448234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450173+0000","last_change":"2023-11-28T17:39:35.087511+0000","last_active":"2023-11-28T17:39:36.450173+0000","last_peered":"2023-11-28T17:39:36.450173+0000","last_clean":"2023-11-28T17:39:36.450173+0000","last_became_active":"2023-11-28T17:39:35.086912+0000","last_became_peered":"2023-11-28T17:39:35.086912+0000","last_unstale":"2023-11-28T17:39:36.450173+0000","last_undegraded":"2023-11-28T17:39:36.450173+0000","last_fullsized":"2023-11-28T17:39:36.450173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050536+0000","last_change":"2023-11-28T17:39:34.071865+0000","last_active":"2023-11-28T17:39:36.050536+0000","last_peered":"2023-11-28T17:39:36.050536+0000","last_clean":"2023-11-28T17:39:36.050536+0000","last_became_active":"2023-11-28T17:39:34.071567+0000","last_became_peered":"2023-11-28T17:39:34.071567+0000","last_unstale":"2023-11-28T17:39:36.050536+0000","last_undegraded":"2023-11-28T17:39:36.050536+0000","last_fullsized":"2023-11-28T17:39:36.050536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450019+0000","last_change":"2023-11-28T17:39:35.082650+0000","last_active":"2023-11-28T17:39:36.450019+0000","last_peered":"2023-11-28T17:39:36.450019+0000","last_clean":"2023-11-28T17:39:36.450019+0000","last_became_active":"2023-11-28T17:39:35.082382+0000","last_became_peered":"2023-11-28T17:39:35.082382+0000","last_unstale":"2023-11-28T17:39:36.450019+0000","last_undegraded":"2023-11-28T17:39:36.450019+0000","last_fullsized":"2023-11-28T17:39:36.450019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312376+0000","last_change":"2023-11-28T17:39:34.078625+0000","last_active":"2023-11-28T17:39:36.312376+0000","last_peered":"2023-11-28T17:39:36.312376+0000","last_clean":"2023-11-28T17:39:36.312376+0000","last_became_active":"2023-11-28T17:39:34.078378+0000","last_became_peered":"2023-11-28T17:39:34.078378+0000","last_unstale":"2023-11-28T17:39:36.312376+0000","last_undegraded":"2023-11-28T17:39:36.312376+0000","last_fullsized":"2023-11-28T17:39:36.312376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449383+0000","last_change":"2023-11-28T17:39:35.084148+0000","last_active":"2023-11-28T17:39:36.449383+0000","last_peered":"2023-11-28T17:39:36.449383+0000","last_clean":"2023-11-28T17:39:36.449383+0000","last_became_active":"2023-11-28T17:39:35.083942+0000","last_became_peered":"2023-11-28T17:39:35.083942+0000","last_unstale":"2023-11-28T17:39:36.449383+0000","last_undegraded":"2023-11-28T17:39:36.449383+0000","last_fullsized":"2023-11-28T17:39:36.449383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:03.153508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.054275+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:39:35.054275+0000","last_peered":"2023-11-28T17:39:35.054275+0000","last_clean":"2023-11-28T17:39:35.054275+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:39:35.054275+0000","last_undegraded":"2023-11-28T17:39:35.054275+0000","last_fullsized":"2023-11-28T17:39:35.054275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449258+0000","last_change":"2023-11-28T17:39:34.067867+0000","last_active":"2023-11-28T17:39:36.449258+0000","last_peered":"2023-11-28T17:39:36.449258+0000","last_clean":"2023-11-28T17:39:36.449258+0000","last_became_active":"2023-11-28T17:39:34.067560+0000","last_became_peered":"2023-11-28T17:39:34.067560+0000","last_unstale":"2023-11-28T17:39:36.449258+0000","last_undegraded":"2023-11-28T17:39:36.449258+0000","last_fullsized":"2023-11-28T17:39:36.449258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448035+0000","last_change":"2023-11-28T17:39:35.064367+0000","last_active":"2023-11-28T17:39:36.448035+0000","last_peered":"2023-11-28T17:39:36.448035+0000","last_clean":"2023-11-28T17:39:36.448035+0000","last_became_active":"2023-11-28T17:39:35.064054+0000","last_became_peered":"2023-11-28T17:39:35.064054+0000","last_unstale":"2023-11-28T17:39:36.448035+0000","last_undegraded":"2023-11-28T17:39:36.448035+0000","last_fullsized":"2023-11-28T17:39:36.448035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449837+0000","last_change":"2023-11-28T17:39:34.068641+0000","last_active":"2023-11-28T17:39:36.449837+0000","last_peered":"2023-11-28T17:39:36.449837+0000","last_clean":"2023-11-28T17:39:36.449837+0000","last_became_active":"2023-11-28T17:39:34.068347+0000","last_became_peered":"2023-11-28T17:39:34.068347+0000","last_unstale":"2023-11-28T17:39:36.449837+0000","last_undegraded":"2023-11-28T17:39:36.449837+0000","last_fullsized":"2023-11-28T17:39:36.449837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:28.994690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311948+0000","last_change":"2023-11-28T17:39:35.070669+0000","last_active":"2023-11-28T17:39:36.311948+0000","last_peered":"2023-11-28T17:39:36.311948+0000","last_clean":"2023-11-28T17:39:36.311948+0000","last_became_active":"2023-11-28T17:39:35.070353+0000","last_became_peered":"2023-11-28T17:39:35.070353+0000","last_unstale":"2023-11-28T17:39:36.311948+0000","last_undegraded":"2023-11-28T17:39:36.311948+0000","last_fullsized":"2023-11-28T17:39:36.311948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:25.524344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.057555+0000","last_change":"2023-11-28T17:39:34.067405+0000","last_active":"2023-11-28T17:39:35.057555+0000","last_peered":"2023-11-28T17:39:35.057555+0000","last_clean":"2023-11-28T17:39:35.057555+0000","last_became_active":"2023-11-28T17:39:34.067099+0000","last_became_peered":"2023-11-28T17:39:34.067099+0000","last_unstale":"2023-11-28T17:39:35.057555+0000","last_undegraded":"2023-11-28T17:39:35.057555+0000","last_fullsized":"2023-11-28T17:39:35.057555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:42.607678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051234+0000","last_change":"2023-11-28T17:39:35.078142+0000","last_active":"2023-11-28T17:39:36.051234+0000","last_peered":"2023-11-28T17:39:36.051234+0000","last_clean":"2023-11-28T17:39:36.051234+0000","last_became_active":"2023-11-28T17:39:35.077867+0000","last_became_peered":"2023-11-28T17:39:35.077867+0000","last_unstale":"2023-11-28T17:39:36.051234+0000","last_undegraded":"2023-11-28T17:39:36.051234+0000","last_fullsized":"2023-11-28T17:39:36.051234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449415+0000","last_change":"2023-11-28T17:39:34.076158+0000","last_active":"2023-11-28T17:39:36.449415+0000","last_peered":"2023-11-28T17:39:36.449415+0000","last_clean":"2023-11-28T17:39:36.449415+0000","last_became_active":"2023-11-28T17:39:34.075800+0000","last_became_peered":"2023-11-28T17:39:34.075800+0000","last_unstale":"2023-11-28T17:39:36.449415+0000","last_undegraded":"2023-11-28T17:39:36.449415+0000","last_fullsized":"2023-11-28T17:39:36.449415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448789+0000","last_change":"2023-11-28T17:39:35.078574+0000","last_active":"2023-11-28T17:39:36.448789+0000","last_peered":"2023-11-28T17:39:36.448789+0000","last_clean":"2023-11-28T17:39:36.448789+0000","last_became_active":"2023-11-28T17:39:35.078265+0000","last_became_peered":"2023-11-28T17:39:35.078265+0000","last_unstale":"2023-11-28T17:39:36.448789+0000","last_undegraded":"2023-11-28T17:39:36.448789+0000","last_fullsized":"2023-11-28T17:39:36.448789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050497+0000","last_change":"2023-11-28T17:39:34.078063+0000","last_active":"2023-11-28T17:39:36.050497+0000","last_peered":"2023-11-28T17:39:36.050497+0000","last_clean":"2023-11-28T17:39:36.050497+0000","last_became_active":"2023-11-28T17:39:34.077766+0000","last_became_peered":"2023-11-28T17:39:34.077766+0000","last_unstale":"2023-11-28T17:39:36.050497+0000","last_undegraded":"2023-11-28T17:39:36.050497+0000","last_fullsized":"2023-11-28T17:39:36.050497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049860+0000","last_change":"2023-11-28T17:39:35.069368+0000","last_active":"2023-11-28T17:39:36.049860+0000","last_peered":"2023-11-28T17:39:36.049860+0000","last_clean":"2023-11-28T17:39:36.049860+0000","last_became_active":"2023-11-28T17:39:35.068994+0000","last_became_peered":"2023-11-28T17:39:35.068994+0000","last_unstale":"2023-11-28T17:39:36.049860+0000","last_undegraded":"2023-11-28T17:39:36.049860+0000","last_fullsized":"2023-11-28T17:39:36.049860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449620+0000","last_change":"2023-11-28T17:39:34.070446+0000","last_active":"2023-11-28T17:39:36.449620+0000","last_peered":"2023-11-28T17:39:36.449620+0000","last_clean":"2023-11-28T17:39:36.449620+0000","last_became_active":"2023-11-28T17:39:34.070015+0000","last_became_peered":"2023-11-28T17:39:34.070015+0000","last_unstale":"2023-11-28T17:39:36.449620+0000","last_undegraded":"2023-11-28T17:39:36.449620+0000","last_fullsized":"2023-11-28T17:39:36.449620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:07.175612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312232+0000","last_change":"2023-11-28T17:39:35.070405+0000","last_active":"2023-11-28T17:39:36.312232+0000","last_peered":"2023-11-28T17:39:36.312232+0000","last_clean":"2023-11-28T17:39:36.312232+0000","last_became_active":"2023-11-28T17:39:35.069566+0000","last_became_peered":"2023-11-28T17:39:35.069566+0000","last_unstale":"2023-11-28T17:39:36.312232+0000","last_undegraded":"2023-11-28T17:39:36.312232+0000","last_fullsized":"2023-11-28T17:39:36.312232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448330+0000","last_change":"2023-11-28T17:39:34.061411+0000","last_active":"2023-11-28T17:39:36.448330+0000","last_peered":"2023-11-28T17:39:36.448330+0000","last_clean":"2023-11-28T17:39:36.448330+0000","last_became_active":"2023-11-28T17:39:34.061056+0000","last_became_peered":"2023-11-28T17:39:34.061056+0000","last_unstale":"2023-11-28T17:39:36.448330+0000","last_undegraded":"2023-11-28T17:39:36.448330+0000","last_fullsized":"2023-11-28T17:39:36.448330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:24.521800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448331+0000","last_change":"2023-11-28T17:39:35.067279+0000","last_active":"2023-11-28T17:39:36.448331+0000","last_peered":"2023-11-28T17:39:36.448331+0000","last_clean":"2023-11-28T17:39:36.448331+0000","last_became_active":"2023-11-28T17:39:35.066864+0000","last_became_peered":"2023-11-28T17:39:35.066864+0000","last_unstale":"2023-11-28T17:39:36.448331+0000","last_undegraded":"2023-11-28T17:39:36.448331+0000","last_fullsized":"2023-11-28T17:39:36.448331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449713+0000","last_change":"2023-11-28T17:39:34.079838+0000","last_active":"2023-11-28T17:39:36.449713+0000","last_peered":"2023-11-28T17:39:36.449713+0000","last_clean":"2023-11-28T17:39:36.449713+0000","last_became_active":"2023-11-28T17:39:34.075803+0000","last_became_peered":"2023-11-28T17:39:34.075803+0000","last_unstale":"2023-11-28T17:39:36.449713+0000","last_undegraded":"2023-11-28T17:39:36.449713+0000","last_fullsized":"2023-11-28T17:39:36.449713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:22.239588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448255+0000","last_change":"2023-11-28T17:39:35.070761+0000","last_active":"2023-11-28T17:39:36.448255+0000","last_peered":"2023-11-28T17:39:36.448255+0000","last_clean":"2023-11-28T17:39:36.448255+0000","last_became_active":"2023-11-28T17:39:35.070419+0000","last_became_peered":"2023-11-28T17:39:35.070419+0000","last_unstale":"2023-11-28T17:39:36.448255+0000","last_undegraded":"2023-11-28T17:39:36.448255+0000","last_fullsized":"2023-11-28T17:39:36.448255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448136+0000","last_change":"2023-11-28T17:39:34.060701+0000","last_active":"2023-11-28T17:39:36.448136+0000","last_peered":"2023-11-28T17:39:36.448136+0000","last_clean":"2023-11-28T17:39:36.448136+0000","last_became_active":"2023-11-28T17:39:34.060371+0000","last_became_peered":"2023-11-28T17:39:34.060371+0000","last_unstale":"2023-11-28T17:39:36.448136+0000","last_undegraded":"2023-11-28T17:39:36.448136+0000","last_fullsized":"2023-11-28T17:39:36.448136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448864+0000","last_change":"2023-11-28T17:39:35.064644+0000","last_active":"2023-11-28T17:39:36.448864+0000","last_peered":"2023-11-28T17:39:36.448864+0000","last_clean":"2023-11-28T17:39:36.448864+0000","last_became_active":"2023-11-28T17:39:35.063958+0000","last_became_peered":"2023-11-28T17:39:35.063958+0000","last_unstale":"2023-11-28T17:39:36.448864+0000","last_undegraded":"2023-11-28T17:39:36.448864+0000","last_fullsized":"2023-11-28T17:39:36.448864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447972+0000","last_change":"2023-11-28T17:39:34.060063+0000","last_active":"2023-11-28T17:39:36.447972+0000","last_peered":"2023-11-28T17:39:36.447972+0000","last_clean":"2023-11-28T17:39:36.447972+0000","last_became_active":"2023-11-28T17:39:34.059667+0000","last_became_peered":"2023-11-28T17:39:34.059667+0000","last_unstale":"2023-11-28T17:39:36.447972+0000","last_undegraded":"2023-11-28T17:39:36.447972+0000","last_fullsized":"2023-11-28T17:39:36.447972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447864+0000","last_change":"2023-11-28T17:39:35.069085+0000","last_active":"2023-11-28T17:39:36.447864+0000","last_peered":"2023-11-28T17:39:36.447864+0000","last_clean":"2023-11-28T17:39:36.447864+0000","last_became_active":"2023-11-28T17:39:35.068282+0000","last_became_peered":"2023-11-28T17:39:35.068282+0000","last_unstale":"2023-11-28T17:39:36.447864+0000","last_undegraded":"2023-11-28T17:39:36.447864+0000","last_fullsized":"2023-11-28T17:39:36.447864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312049+0000","last_change":"2023-11-28T17:39:34.071879+0000","last_active":"2023-11-28T17:39:36.312049+0000","last_peered":"2023-11-28T17:39:36.312049+0000","last_clean":"2023-11-28T17:39:36.312049+0000","last_became_active":"2023-11-28T17:39:34.071374+0000","last_became_peered":"2023-11-28T17:39:34.071374+0000","last_unstale":"2023-11-28T17:39:36.312049+0000","last_undegraded":"2023-11-28T17:39:36.312049+0000","last_fullsized":"2023-11-28T17:39:36.312049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:28.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.082085+0000","last_change":"2023-11-28T17:39:35.076243+0000","last_active":"2023-11-28T17:39:35.082085+0000","last_peered":"2023-11-28T17:39:35.082085+0000","last_clean":"2023-11-28T17:39:35.082085+0000","last_became_active":"2023-11-28T17:39:35.075878+0000","last_became_peered":"2023-11-28T17:39:35.075878+0000","last_unstale":"2023-11-28T17:39:35.082085+0000","last_undegraded":"2023-11-28T17:39:35.082085+0000","last_fullsized":"2023-11-28T17:39:35.082085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:59.930675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449173+0000","last_change":"2023-11-28T17:39:34.080217+0000","last_active":"2023-11-28T17:39:36.449173+0000","last_peered":"2023-11-28T17:39:36.449173+0000","last_clean":"2023-11-28T17:39:36.449173+0000","last_became_active":"2023-11-28T17:39:34.079885+0000","last_became_peered":"2023-11-28T17:39:34.079885+0000","last_unstale":"2023-11-28T17:39:36.449173+0000","last_undegraded":"2023-11-28T17:39:36.449173+0000","last_fullsized":"2023-11-28T17:39:36.449173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449154+0000","last_change":"2023-11-28T17:39:35.081899+0000","last_active":"2023-11-28T17:39:36.449154+0000","last_peered":"2023-11-28T17:39:36.449154+0000","last_clean":"2023-11-28T17:39:36.449154+0000","last_became_active":"2023-11-28T17:39:35.081239+0000","last_became_peered":"2023-11-28T17:39:35.081239+0000","last_unstale":"2023-11-28T17:39:36.449154+0000","last_undegraded":"2023-11-28T17:39:36.449154+0000","last_fullsized":"2023-11-28T17:39:36.449154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:36.478729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449756+0000","last_change":"2023-11-28T17:39:35.072258+0000","last_active":"2023-11-28T17:39:36.449756+0000","last_peered":"2023-11-28T17:39:36.449756+0000","last_clean":"2023-11-28T17:39:36.449756+0000","last_became_active":"2023-11-28T17:39:35.071820+0000","last_became_peered":"2023-11-28T17:39:35.071820+0000","last_unstale":"2023-11-28T17:39:36.449756+0000","last_undegraded":"2023-11-28T17:39:36.449756+0000","last_fullsized":"2023-11-28T17:39:36.449756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:25.703521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450044+0000","last_change":"2023-11-28T17:39:34.071815+0000","last_active":"2023-11-28T17:39:36.450044+0000","last_peered":"2023-11-28T17:39:36.450044+0000","last_clean":"2023-11-28T17:39:36.450044+0000","last_became_active":"2023-11-28T17:39:34.070404+0000","last_became_peered":"2023-11-28T17:39:34.070404+0000","last_unstale":"2023-11-28T17:39:36.450044+0000","last_undegraded":"2023-11-28T17:39:36.450044+0000","last_fullsized":"2023-11-28T17:39:36.450044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449165+0000","last_change":"2023-11-28T17:39:35.078177+0000","last_active":"2023-11-28T17:39:36.449165+0000","last_peered":"2023-11-28T17:39:36.449165+0000","last_clean":"2023-11-28T17:39:36.449165+0000","last_became_active":"2023-11-28T17:39:35.077903+0000","last_became_peered":"2023-11-28T17:39:35.077903+0000","last_unstale":"2023-11-28T17:39:36.449165+0000","last_undegraded":"2023-11-28T17:39:36.449165+0000","last_fullsized":"2023-11-28T17:39:36.449165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450137+0000","last_change":"2023-11-28T17:39:34.074770+0000","last_active":"2023-11-28T17:39:36.450137+0000","last_peered":"2023-11-28T17:39:36.450137+0000","last_clean":"2023-11-28T17:39:36.450137+0000","last_became_active":"2023-11-28T17:39:34.074470+0000","last_became_peered":"2023-11-28T17:39:34.074470+0000","last_unstale":"2023-11-28T17:39:36.450137+0000","last_undegraded":"2023-11-28T17:39:36.450137+0000","last_fullsized":"2023-11-28T17:39:36.450137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050609+0000","last_change":"2023-11-28T17:39:35.079538+0000","last_active":"2023-11-28T17:39:36.050609+0000","last_peered":"2023-11-28T17:39:36.050609+0000","last_clean":"2023-11-28T17:39:36.050609+0000","last_became_active":"2023-11-28T17:39:35.079236+0000","last_became_peered":"2023-11-28T17:39:35.079236+0000","last_unstale":"2023-11-28T17:39:36.050609+0000","last_undegraded":"2023-11-28T17:39:36.050609+0000","last_fullsized":"2023-11-28T17:39:36.050609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051095+0000","last_change":"2023-11-28T17:39:34.066171+0000","last_active":"2023-11-28T17:39:36.051095+0000","last_peered":"2023-11-28T17:39:36.051095+0000","last_clean":"2023-11-28T17:39:36.051095+0000","last_became_active":"2023-11-28T17:39:34.065133+0000","last_became_peered":"2023-11-28T17:39:34.065133+0000","last_unstale":"2023-11-28T17:39:36.051095+0000","last_undegraded":"2023-11-28T17:39:36.051095+0000","last_fullsized":"2023-11-28T17:39:36.051095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051059+0000","last_change":"2023-11-28T17:39:35.069328+0000","last_active":"2023-11-28T17:39:36.051059+0000","last_peered":"2023-11-28T17:39:36.051059+0000","last_clean":"2023-11-28T17:39:36.051059+0000","last_became_active":"2023-11-28T17:39:35.066256+0000","last_became_peered":"2023-11-28T17:39:35.066256+0000","last_unstale":"2023-11-28T17:39:36.051059+0000","last_undegraded":"2023-11-28T17:39:36.051059+0000","last_fullsized":"2023-11-28T17:39:36.051059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448353+0000","last_change":"2023-11-28T17:39:34.067861+0000","last_active":"2023-11-28T17:39:36.448353+0000","last_peered":"2023-11-28T17:39:36.448353+0000","last_clean":"2023-11-28T17:39:36.448353+0000","last_became_active":"2023-11-28T17:39:34.067203+0000","last_became_peered":"2023-11-28T17:39:34.067203+0000","last_unstale":"2023-11-28T17:39:36.448353+0000","last_undegraded":"2023-11-28T17:39:36.448353+0000","last_fullsized":"2023-11-28T17:39:36.448353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":72236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":70534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":70008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:39:39.487 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:39:39.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 Processor -- start 2023-11-28T17:39:39.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 -- start start 2023-11-28T17:39:39.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd90406d300 0x7fd904161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406e880 0x7fd90406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd904161f70 con 0x7fd90415d620 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90406f250 con 0x7fd90406d300 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd90b9c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9040cee20 con 0x7fd90406e880 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd908f5f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd90406d300 0x7fd904161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd909760640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd90415d620 0x7fd9040cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56566/0 (socket says 172.21.15.16:56566) 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd909760640 1 -- 172.21.15.16:0/701819570 learned_addr learned my addr 172.21.15.16:0/701819570 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:39.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.663+0000 7fd909f61640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406e880 0x7fd90406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd908f5f640 1 -- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406e880 msgr2=0x7fd90406ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:39.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd908f5f640 1 --2- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406e880 0x7fd90406ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd908f5f640 1 -- 172.21.15.16:0/701819570 >> v1:172.21.15.64:6789/0 conn(0x7fd90415d620 legacy=0x7fd9040cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd8fbfff640 1 -- 172.21.15.16:0/701819570 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283988092 0 0) 0x7fd904161f70 con 0x7fd90415d620 2023-11-28T17:39:39.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd908f5f640 1 -- 172.21.15.16:0/701819570 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9040cf100 con 0x7fd90406d300 2023-11-28T17:39:39.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd908f5f640 1 --2- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90406d300 0x7fd904161a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40097f0 tx=0x7fd8f401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f862e9ed6a4ff812 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd8fbfff640 1 -- 172.21.15.16:0/701819570 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40ab650 con 0x7fd90406d300 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd8fbfff640 1 -- 172.21.15.16:0/701819570 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f40ab7b0 con 0x7fd90406d300 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd8fbfff640 1 -- 172.21.15.16:0/701819570 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40abb40 con 0x7fd90406d300 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd90b9c4640 1 -- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90406d300 msgr2=0x7fd904161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90406d300 0x7fd904161a30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40097f0 tx=0x7fd8f401c450 comp rx=0 tx=0).stop 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd90b9c4640 1 -- 172.21.15.16:0/701819570 shutdown_connections 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406e880 0x7fd90406ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.667+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/701819570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90406d300 0x7fd904161a30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- 172.21.15.16:0/701819570 >> 172.21.15.16:0/701819570 conn(0x7fd90406a5a0 msgr2=0x7fd90406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:39.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- 172.21.15.16:0/701819570 shutdown_connections 2023-11-28T17:39:39.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- 172.21.15.16:0/701819570 wait complete. 2023-11-28T17:39:39.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 Processor -- start 2023-11-28T17:39:39.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- start start 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406d300 0x7fd90415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 0x7fd9040c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90415d620 0x7fd90414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90414cad0 con 0x7fd90406e880 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90415c4a0 con 0x7fd90415d620 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd90b9c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd904154fd0 con 0x7fd90406d300 2023-11-28T17:39:39.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 0x7fd9040c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 0x7fd9040c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48428/0 (socket says 172.21.15.16:48428) 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 -- 172.21.15.16:0/1624735577 learned_addr learned my addr 172.21.15.16:0/1624735577 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd909760640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406d300 0x7fd90415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd909f61640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90415d620 0x7fd90414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 -- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406d300 msgr2=0x7fd90415be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406d300 0x7fd90415be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 -- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90415d620 msgr2=0x7fd90414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90415d620 0x7fd90414c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd908f5f640 1 -- 172.21.15.16:0/1624735577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f4009420 con 0x7fd90406e880 2023-11-28T17:39:39.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.671+0000 7fd909f61640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90415d620 0x7fd90414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:39.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd908f5f640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 0x7fd9040c6eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40ad040 tx=0x7fd8f401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40bf610 con 0x7fd90406e880 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f40bf770 con 0x7fd90406e880 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f40bfb00 con 0x7fd90406e880 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9041552b0 con 0x7fd90406e880 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90414bb50 con 0x7fd90406e880 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9040c7bb0 con 0x7fd90406e880 2023-11-28T17:39:39.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd8f40b5400 con 0x7fd90406e880 2023-11-28T17:39:39.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd8f9ffb640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd8e80668d0 0x7fd8e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:39.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8f411eee0 con 0x7fd90406e880 2023-11-28T17:39:39.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.675+0000 7fd909760640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd8e80668d0 0x7fd8e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:39.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.679+0000 7fd909760640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd8e80668d0 0x7fd8e8068d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd900000f70 tx=0x7fd900007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:39.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.679+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8f40ec080 con 0x7fd90406e880 2023-11-28T17:39:39.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.835+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd904067530 con 0x7fd8e80668d0 2023-11-28T17:39:39.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.843+0000 7fd8f9ffb640 1 -- 172.21.15.16:0/1624735577 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264645 (secure 0 0 0) 0x7fd904067530 con 0x7fd8e80668d0 2023-11-28T17:39:39.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:39.850 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:39:39.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd8e80668d0 msgr2=0x7fd8e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd8e80668d0 0x7fd8e8068d90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd900000f70 tx=0x7fd900007b60 comp rx=0 tx=0).stop 2023-11-28T17:39:39.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 msgr2=0x7fd9040c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 0x7fd9040c6eb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd8f40ad040 tx=0x7fd8f401ac90 comp rx=0 tx=0).stop 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 shutdown_connections 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd8e80668d0 0x7fd8e8068d90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90415d620 0x7fd90414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd90406e880 0x7fd9040c6eb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 --2- 172.21.15.16:0/1624735577 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd90406d300 0x7fd90415be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 >> 172.21.15.16:0/1624735577 conn(0x7fd90406a5a0 msgr2=0x7fd90406ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 shutdown_connections 2023-11-28T17:39:39.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:39.847+0000 7fd90b9c4640 1 -- 172.21.15.16:0/1624735577 wait complete. 2023-11-28T17:39:39.868 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T17:39:38.765896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231520,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743200,"statfs":{"total":773094113280,"available":772857036800,"internally_reserved":0,"allocated":2940928,"data_stored":1757173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.727254"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450114+0000","last_change":"2023-11-28T17:39:35.076736+0000","last_active":"2023-11-28T17:39:36.450114+0000","last_peered":"2023-11-28T17:39:36.450114+0000","last_clean":"2023-11-28T17:39:36.450114+0000","last_became_active":"2023-11-28T17:39:35.076314+0000","last_became_peered":"2023-11-28T17:39:35.076314+0000","last_unstale":"2023-11-28T17:39:36.450114+0000","last_undegraded":"2023-11-28T17:39:36.450114+0000","last_fullsized":"2023-11-28T17:39:36.450114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050954+0000","last_change":"2023-11-28T17:39:35.074659+0000","last_active":"2023-11-28T17:39:36.050954+0000","last_peered":"2023-11-28T17:39:36.050954+0000","last_clean":"2023-11-28T17:39:36.050954+0000","last_became_active":"2023-11-28T17:39:35.074240+0000","last_became_peered":"2023-11-28T17:39:35.074240+0000","last_unstale":"2023-11-28T17:39:36.050954+0000","last_undegraded":"2023-11-28T17:39:36.050954+0000","last_fullsized":"2023-11-28T17:39:36.050954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050415+0000","last_change":"2023-11-28T17:39:35.072116+0000","last_active":"2023-11-28T17:39:36.050415+0000","last_peered":"2023-11-28T17:39:36.050415+0000","last_clean":"2023-11-28T17:39:36.050415+0000","last_became_active":"2023-11-28T17:39:35.071687+0000","last_became_peered":"2023-11-28T17:39:35.071687+0000","last_unstale":"2023-11-28T17:39:36.050415+0000","last_undegraded":"2023-11-28T17:39:36.050415+0000","last_fullsized":"2023-11-28T17:39:36.050415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.064075+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.063682+0000","last_became_peered":"2023-11-28T17:39:35.063682+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448696+0000","last_change":"2023-11-28T17:39:35.077549+0000","last_active":"2023-11-28T17:39:36.448696+0000","last_peered":"2023-11-28T17:39:36.448696+0000","last_clean":"2023-11-28T17:39:36.448696+0000","last_became_active":"2023-11-28T17:39:35.077185+0000","last_became_peered":"2023-11-28T17:39:35.077185+0000","last_unstale":"2023-11-28T17:39:36.448696+0000","last_undegraded":"2023-11-28T17:39:36.448696+0000","last_fullsized":"2023-11-28T17:39:36.448696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049692+0000","last_change":"2023-11-28T17:39:35.057293+0000","last_active":"2023-11-28T17:39:36.049692+0000","last_peered":"2023-11-28T17:39:36.049692+0000","last_clean":"2023-11-28T17:39:36.049692+0000","last_became_active":"2023-11-28T17:39:35.057018+0000","last_became_peered":"2023-11-28T17:39:35.057018+0000","last_unstale":"2023-11-28T17:39:36.049692+0000","last_undegraded":"2023-11-28T17:39:36.049692+0000","last_fullsized":"2023-11-28T17:39:36.049692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:49.748812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448373+0000","last_change":"2023-11-28T17:39:35.068482+0000","last_active":"2023-11-28T17:39:36.448373+0000","last_peered":"2023-11-28T17:39:36.448373+0000","last_clean":"2023-11-28T17:39:36.448373+0000","last_became_active":"2023-11-28T17:39:35.066863+0000","last_became_peered":"2023-11-28T17:39:35.066863+0000","last_unstale":"2023-11-28T17:39:36.448373+0000","last_undegraded":"2023-11-28T17:39:36.448373+0000","last_fullsized":"2023-11-28T17:39:36.448373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051099+0000","last_change":"2023-11-28T17:39:35.085078+0000","last_active":"2023-11-28T17:39:36.051099+0000","last_peered":"2023-11-28T17:39:36.051099+0000","last_clean":"2023-11-28T17:39:36.051099+0000","last_became_active":"2023-11-28T17:39:35.084745+0000","last_became_peered":"2023-11-28T17:39:35.084745+0000","last_unstale":"2023-11-28T17:39:36.051099+0000","last_undegraded":"2023-11-28T17:39:36.051099+0000","last_fullsized":"2023-11-28T17:39:36.051099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449706+0000","last_change":"2023-11-28T17:39:35.080106+0000","last_active":"2023-11-28T17:39:36.449706+0000","last_peered":"2023-11-28T17:39:36.449706+0000","last_clean":"2023-11-28T17:39:36.449706+0000","last_became_active":"2023-11-28T17:39:35.079816+0000","last_became_peered":"2023-11-28T17:39:35.079816+0000","last_unstale":"2023-11-28T17:39:36.449706+0000","last_undegraded":"2023-11-28T17:39:36.449706+0000","last_fullsized":"2023-11-28T17:39:36.449706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450080+0000","last_change":"2023-11-28T17:39:35.074439+0000","last_active":"2023-11-28T17:39:36.450080+0000","last_peered":"2023-11-28T17:39:36.450080+0000","last_clean":"2023-11-28T17:39:36.450080+0000","last_became_active":"2023-11-28T17:39:35.073858+0000","last_became_peered":"2023-11-28T17:39:35.073858+0000","last_unstale":"2023-11-28T17:39:36.450080+0000","last_undegraded":"2023-11-28T17:39:36.450080+0000","last_fullsized":"2023-11-28T17:39:36.450080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450026+0000","last_change":"2023-11-28T17:39:35.070060+0000","last_active":"2023-11-28T17:39:36.450026+0000","last_peered":"2023-11-28T17:39:36.450026+0000","last_clean":"2023-11-28T17:39:36.450026+0000","last_became_active":"2023-11-28T17:39:35.069384+0000","last_became_peered":"2023-11-28T17:39:35.069384+0000","last_unstale":"2023-11-28T17:39:36.450026+0000","last_undegraded":"2023-11-28T17:39:36.450026+0000","last_fullsized":"2023-11-28T17:39:36.450026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449873+0000","last_change":"2023-11-28T17:39:35.082371+0000","last_active":"2023-11-28T17:39:36.449873+0000","last_peered":"2023-11-28T17:39:36.449873+0000","last_clean":"2023-11-28T17:39:36.449873+0000","last_became_active":"2023-11-28T17:39:35.081668+0000","last_became_peered":"2023-11-28T17:39:35.081668+0000","last_unstale":"2023-11-28T17:39:36.449873+0000","last_undegraded":"2023-11-28T17:39:36.449873+0000","last_fullsized":"2023-11-28T17:39:36.449873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312169+0000","last_change":"2023-11-28T17:39:35.082173+0000","last_active":"2023-11-28T17:39:36.312169+0000","last_peered":"2023-11-28T17:39:36.312169+0000","last_clean":"2023-11-28T17:39:36.312169+0000","last_became_active":"2023-11-28T17:39:35.080696+0000","last_became_peered":"2023-11-28T17:39:35.080696+0000","last_unstale":"2023-11-28T17:39:36.312169+0000","last_undegraded":"2023-11-28T17:39:36.312169+0000","last_fullsized":"2023-11-28T17:39:36.312169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311941+0000","last_change":"2023-11-28T17:39:35.080498+0000","last_active":"2023-11-28T17:39:36.311941+0000","last_peered":"2023-11-28T17:39:36.311941+0000","last_clean":"2023-11-28T17:39:36.311941+0000","last_became_active":"2023-11-28T17:39:35.080163+0000","last_became_peered":"2023-11-28T17:39:35.080163+0000","last_unstale":"2023-11-28T17:39:36.311941+0000","last_undegraded":"2023-11-28T17:39:36.311941+0000","last_fullsized":"2023-11-28T17:39:36.311941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051297+0000","last_change":"2023-11-28T17:39:35.084970+0000","last_active":"2023-11-28T17:39:36.051297+0000","last_peered":"2023-11-28T17:39:36.051297+0000","last_clean":"2023-11-28T17:39:36.051297+0000","last_became_active":"2023-11-28T17:39:35.084639+0000","last_became_peered":"2023-11-28T17:39:35.084639+0000","last_unstale":"2023-11-28T17:39:36.051297+0000","last_undegraded":"2023-11-28T17:39:36.051297+0000","last_fullsized":"2023-11-28T17:39:36.051297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449523+0000","last_change":"2023-11-28T17:39:35.072393+0000","last_active":"2023-11-28T17:39:36.449523+0000","last_peered":"2023-11-28T17:39:36.449523+0000","last_clean":"2023-11-28T17:39:36.449523+0000","last_became_active":"2023-11-28T17:39:35.071917+0000","last_became_peered":"2023-11-28T17:39:35.071917+0000","last_unstale":"2023-11-28T17:39:36.449523+0000","last_undegraded":"2023-11-28T17:39:36.449523+0000","last_fullsized":"2023-11-28T17:39:36.449523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:09.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449618+0000","last_change":"2023-11-28T17:39:35.080914+0000","last_active":"2023-11-28T17:39:36.449618+0000","last_peered":"2023-11-28T17:39:36.449618+0000","last_clean":"2023-11-28T17:39:36.449618+0000","last_became_active":"2023-11-28T17:39:35.080586+0000","last_became_peered":"2023-11-28T17:39:35.080586+0000","last_unstale":"2023-11-28T17:39:36.449618+0000","last_undegraded":"2023-11-28T17:39:36.449618+0000","last_fullsized":"2023-11-28T17:39:36.449618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:14:15.208179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.082833+0000","last_change":"2023-11-28T17:39:35.077623+0000","last_active":"2023-11-28T17:39:35.082833+0000","last_peered":"2023-11-28T17:39:35.082833+0000","last_clean":"2023-11-28T17:39:35.082833+0000","last_became_active":"2023-11-28T17:39:35.077222+0000","last_became_peered":"2023-11-28T17:39:35.077222+0000","last_unstale":"2023-11-28T17:39:35.082833+0000","last_undegraded":"2023-11-28T17:39:35.082833+0000","last_fullsized":"2023-11-28T17:39:35.082833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:42:10.713100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449521+0000","last_change":"2023-11-28T17:39:35.067332+0000","last_active":"2023-11-28T17:39:36.449521+0000","last_peered":"2023-11-28T17:39:36.449521+0000","last_clean":"2023-11-28T17:39:36.449521+0000","last_became_active":"2023-11-28T17:39:35.066983+0000","last_became_peered":"2023-11-28T17:39:35.066983+0000","last_unstale":"2023-11-28T17:39:36.449521+0000","last_undegraded":"2023-11-28T17:39:36.449521+0000","last_fullsized":"2023-11-28T17:39:36.449521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:25.743991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449930+0000","last_change":"2023-11-28T17:39:35.082580+0000","last_active":"2023-11-28T17:39:36.449930+0000","last_peered":"2023-11-28T17:39:36.449930+0000","last_clean":"2023-11-28T17:39:36.449930+0000","last_became_active":"2023-11-28T17:39:35.082091+0000","last_became_peered":"2023-11-28T17:39:35.082091+0000","last_unstale":"2023-11-28T17:39:36.449930+0000","last_undegraded":"2023-11-28T17:39:36.449930+0000","last_fullsized":"2023-11-28T17:39:36.449930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448106+0000","last_change":"2023-11-28T17:39:35.055626+0000","last_active":"2023-11-28T17:39:36.448106+0000","last_peered":"2023-11-28T17:39:36.448106+0000","last_clean":"2023-11-28T17:39:36.448106+0000","last_became_active":"2023-11-28T17:39:35.055320+0000","last_became_peered":"2023-11-28T17:39:35.055320+0000","last_unstale":"2023-11-28T17:39:36.448106+0000","last_undegraded":"2023-11-28T17:39:36.448106+0000","last_fullsized":"2023-11-28T17:39:36.448106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449446+0000","last_change":"2023-11-28T17:39:35.065869+0000","last_active":"2023-11-28T17:39:36.449446+0000","last_peered":"2023-11-28T17:39:36.449446+0000","last_clean":"2023-11-28T17:39:36.449446+0000","last_became_active":"2023-11-28T17:39:35.065570+0000","last_became_peered":"2023-11-28T17:39:35.065570+0000","last_unstale":"2023-11-28T17:39:36.449446+0000","last_undegraded":"2023-11-28T17:39:36.449446+0000","last_fullsized":"2023-11-28T17:39:36.449446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051520+0000","last_change":"2023-11-28T17:39:35.072179+0000","last_active":"2023-11-28T17:39:36.051520+0000","last_peered":"2023-11-28T17:39:36.051520+0000","last_clean":"2023-11-28T17:39:36.051520+0000","last_became_active":"2023-11-28T17:39:35.071851+0000","last_became_peered":"2023-11-28T17:39:35.071851+0000","last_unstale":"2023-11-28T17:39:36.051520+0000","last_undegraded":"2023-11-28T17:39:36.051520+0000","last_fullsized":"2023-11-28T17:39:36.051520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449666+0000","last_change":"2023-11-28T17:39:35.072638+0000","last_active":"2023-11-28T17:39:36.449666+0000","last_peered":"2023-11-28T17:39:36.449666+0000","last_clean":"2023-11-28T17:39:36.449666+0000","last_became_active":"2023-11-28T17:39:35.072144+0000","last_became_peered":"2023-11-28T17:39:35.072144+0000","last_unstale":"2023-11-28T17:39:36.449666+0000","last_undegraded":"2023-11-28T17:39:36.449666+0000","last_fullsized":"2023-11-28T17:39:36.449666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:58.098189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050465+0000","last_change":"2023-11-28T17:39:35.079771+0000","last_active":"2023-11-28T17:39:36.050465+0000","last_peered":"2023-11-28T17:39:36.050465+0000","last_clean":"2023-11-28T17:39:36.050465+0000","last_became_active":"2023-11-28T17:39:35.079423+0000","last_became_peered":"2023-11-28T17:39:35.079423+0000","last_unstale":"2023-11-28T17:39:36.050465+0000","last_undegraded":"2023-11-28T17:39:36.050465+0000","last_fullsized":"2023-11-28T17:39:36.050465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049922+0000","last_change":"2023-11-28T17:39:35.073441+0000","last_active":"2023-11-28T17:39:36.049922+0000","last_peered":"2023-11-28T17:39:36.049922+0000","last_clean":"2023-11-28T17:39:36.049922+0000","last_became_active":"2023-11-28T17:39:35.072851+0000","last_became_peered":"2023-11-28T17:39:35.072851+0000","last_unstale":"2023-11-28T17:39:36.049922+0000","last_undegraded":"2023-11-28T17:39:36.049922+0000","last_fullsized":"2023-11-28T17:39:36.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312430+0000","last_change":"2023-11-28T17:39:35.079706+0000","last_active":"2023-11-28T17:39:36.312430+0000","last_peered":"2023-11-28T17:39:36.312430+0000","last_clean":"2023-11-28T17:39:36.312430+0000","last_became_active":"2023-11-28T17:39:35.079231+0000","last_became_peered":"2023-11-28T17:39:35.079231+0000","last_unstale":"2023-11-28T17:39:36.312430+0000","last_undegraded":"2023-11-28T17:39:36.312430+0000","last_fullsized":"2023-11-28T17:39:36.312430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312261+0000","last_change":"2023-11-28T17:39:35.078579+0000","last_active":"2023-11-28T17:39:36.312261+0000","last_peered":"2023-11-28T17:39:36.312261+0000","last_clean":"2023-11-28T17:39:36.312261+0000","last_became_active":"2023-11-28T17:39:35.078259+0000","last_became_peered":"2023-11-28T17:39:35.078259+0000","last_unstale":"2023-11-28T17:39:36.312261+0000","last_undegraded":"2023-11-28T17:39:36.312261+0000","last_fullsized":"2023-11-28T17:39:36.312261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050907+0000","last_change":"2023-11-28T17:39:35.082408+0000","last_active":"2023-11-28T17:39:36.050907+0000","last_peered":"2023-11-28T17:39:36.050907+0000","last_clean":"2023-11-28T17:39:36.050907+0000","last_became_active":"2023-11-28T17:39:35.082098+0000","last_became_peered":"2023-11-28T17:39:35.082098+0000","last_unstale":"2023-11-28T17:39:36.050907+0000","last_undegraded":"2023-11-28T17:39:36.050907+0000","last_fullsized":"2023-11-28T17:39:36.050907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449034+0000","last_change":"2023-11-28T17:39:35.079528+0000","last_active":"2023-11-28T17:39:36.449034+0000","last_peered":"2023-11-28T17:39:36.449034+0000","last_clean":"2023-11-28T17:39:36.449034+0000","last_became_active":"2023-11-28T17:39:35.079243+0000","last_became_peered":"2023-11-28T17:39:35.079243+0000","last_unstale":"2023-11-28T17:39:36.449034+0000","last_undegraded":"2023-11-28T17:39:36.449034+0000","last_fullsized":"2023-11-28T17:39:36.449034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.082936+0000","last_change":"2023-11-28T17:39:35.078211+0000","last_active":"2023-11-28T17:39:35.082936+0000","last_peered":"2023-11-28T17:39:35.082936+0000","last_clean":"2023-11-28T17:39:35.082936+0000","last_became_active":"2023-11-28T17:39:35.077631+0000","last_became_peered":"2023-11-28T17:39:35.077631+0000","last_unstale":"2023-11-28T17:39:35.082936+0000","last_undegraded":"2023-11-28T17:39:35.082936+0000","last_fullsized":"2023-11-28T17:39:35.082936+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:33:40.356373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049377+0000","last_change":"2023-11-28T17:39:35.072541+0000","last_active":"2023-11-28T17:39:36.049377+0000","last_peered":"2023-11-28T17:39:36.049377+0000","last_clean":"2023-11-28T17:39:36.049377+0000","last_became_active":"2023-11-28T17:39:35.072263+0000","last_became_peered":"2023-11-28T17:39:35.072263+0000","last_unstale":"2023-11-28T17:39:36.049377+0000","last_undegraded":"2023-11-28T17:39:36.049377+0000","last_fullsized":"2023-11-28T17:39:36.049377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:06.392677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449588+0000","last_change":"2023-11-28T17:39:35.070782+0000","last_active":"2023-11-28T17:39:36.449588+0000","last_peered":"2023-11-28T17:39:36.449588+0000","last_clean":"2023-11-28T17:39:36.449588+0000","last_became_active":"2023-11-28T17:39:35.070466+0000","last_became_peered":"2023-11-28T17:39:35.070466+0000","last_unstale":"2023-11-28T17:39:36.449588+0000","last_undegraded":"2023-11-28T17:39:36.449588+0000","last_fullsized":"2023-11-28T17:39:36.449588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050871+0000","last_change":"2023-11-28T17:39:34.073844+0000","last_active":"2023-11-28T17:39:36.050871+0000","last_peered":"2023-11-28T17:39:36.050871+0000","last_clean":"2023-11-28T17:39:36.050871+0000","last_became_active":"2023-11-28T17:39:34.073439+0000","last_became_peered":"2023-11-28T17:39:34.073439+0000","last_unstale":"2023-11-28T17:39:36.050871+0000","last_undegraded":"2023-11-28T17:39:36.050871+0000","last_fullsized":"2023-11-28T17:39:36.050871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448062+0000","last_change":"2023-11-28T17:39:35.077086+0000","last_active":"2023-11-28T17:39:36.448062+0000","last_peered":"2023-11-28T17:39:36.448062+0000","last_clean":"2023-11-28T17:39:36.448062+0000","last_became_active":"2023-11-28T17:39:35.076725+0000","last_became_peered":"2023-11-28T17:39:35.076725+0000","last_unstale":"2023-11-28T17:39:36.448062+0000","last_undegraded":"2023-11-28T17:39:36.448062+0000","last_fullsized":"2023-11-28T17:39:36.448062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449252+0000","last_change":"2023-11-28T17:39:34.072648+0000","last_active":"2023-11-28T17:39:36.449252+0000","last_peered":"2023-11-28T17:39:36.449252+0000","last_clean":"2023-11-28T17:39:36.449252+0000","last_became_active":"2023-11-28T17:39:34.072323+0000","last_became_peered":"2023-11-28T17:39:34.072323+0000","last_unstale":"2023-11-28T17:39:36.449252+0000","last_undegraded":"2023-11-28T17:39:36.449252+0000","last_fullsized":"2023-11-28T17:39:36.449252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:54.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311863+0000","last_change":"2023-11-28T17:39:34.075937+0000","last_active":"2023-11-28T17:39:36.311863+0000","last_peered":"2023-11-28T17:39:36.311863+0000","last_clean":"2023-11-28T17:39:36.311863+0000","last_became_active":"2023-11-28T17:39:34.075701+0000","last_became_peered":"2023-11-28T17:39:34.075701+0000","last_unstale":"2023-11-28T17:39:36.311863+0000","last_undegraded":"2023-11-28T17:39:36.311863+0000","last_fullsized":"2023-11-28T17:39:36.311863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051241+0000","last_change":"2023-11-28T17:39:35.081382+0000","last_active":"2023-11-28T17:39:36.051241+0000","last_peered":"2023-11-28T17:39:36.051241+0000","last_clean":"2023-11-28T17:39:36.051241+0000","last_became_active":"2023-11-28T17:39:35.080860+0000","last_became_peered":"2023-11-28T17:39:35.080860+0000","last_unstale":"2023-11-28T17:39:36.051241+0000","last_undegraded":"2023-11-28T17:39:36.051241+0000","last_fullsized":"2023-11-28T17:39:36.051241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449747+0000","last_change":"2023-11-28T17:39:34.069183+0000","last_active":"2023-11-28T17:39:36.449747+0000","last_peered":"2023-11-28T17:39:36.449747+0000","last_clean":"2023-11-28T17:39:36.449747+0000","last_became_active":"2023-11-28T17:39:34.068877+0000","last_became_peered":"2023-11-28T17:39:34.068877+0000","last_unstale":"2023-11-28T17:39:36.449747+0000","last_undegraded":"2023-11-28T17:39:36.449747+0000","last_fullsized":"2023-11-28T17:39:36.449747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448060+0000","last_change":"2023-11-28T17:39:35.068002+0000","last_active":"2023-11-28T17:39:36.448060+0000","last_peered":"2023-11-28T17:39:36.448060+0000","last_clean":"2023-11-28T17:39:36.448060+0000","last_became_active":"2023-11-28T17:39:35.067573+0000","last_became_peered":"2023-11-28T17:39:35.067573+0000","last_unstale":"2023-11-28T17:39:36.448060+0000","last_undegraded":"2023-11-28T17:39:36.448060+0000","last_fullsized":"2023-11-28T17:39:36.448060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449790+0000","last_change":"2023-11-28T17:39:34.071729+0000","last_active":"2023-11-28T17:39:36.449790+0000","last_peered":"2023-11-28T17:39:36.449790+0000","last_clean":"2023-11-28T17:39:36.449790+0000","last_became_active":"2023-11-28T17:39:34.070600+0000","last_became_peered":"2023-11-28T17:39:34.070600+0000","last_unstale":"2023-11-28T17:39:36.449790+0000","last_undegraded":"2023-11-28T17:39:36.449790+0000","last_fullsized":"2023-11-28T17:39:36.449790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.073594+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.073073+0000","last_became_peered":"2023-11-28T17:39:35.073073+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450176+0000","last_change":"2023-11-28T17:39:34.074904+0000","last_active":"2023-11-28T17:39:36.450176+0000","last_peered":"2023-11-28T17:39:36.450176+0000","last_clean":"2023-11-28T17:39:36.450176+0000","last_became_active":"2023-11-28T17:39:34.074606+0000","last_became_peered":"2023-11-28T17:39:34.074606+0000","last_unstale":"2023-11-28T17:39:36.450176+0000","last_undegraded":"2023-11-28T17:39:36.450176+0000","last_fullsized":"2023-11-28T17:39:36.450176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:32.724833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051559+0000","last_change":"2023-11-28T17:39:35.070120+0000","last_active":"2023-11-28T17:39:36.051559+0000","last_peered":"2023-11-28T17:39:36.051559+0000","last_clean":"2023-11-28T17:39:36.051559+0000","last_became_active":"2023-11-28T17:39:35.069783+0000","last_became_peered":"2023-11-28T17:39:35.069783+0000","last_unstale":"2023-11-28T17:39:36.051559+0000","last_undegraded":"2023-11-28T17:39:36.051559+0000","last_fullsized":"2023-11-28T17:39:36.051559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.390412+0000","last_change":"2023-11-28T17:39:34.067851+0000","last_active":"2023-11-28T17:39:35.390412+0000","last_peered":"2023-11-28T17:39:35.390412+0000","last_clean":"2023-11-28T17:39:35.390412+0000","last_became_active":"2023-11-28T17:39:34.067453+0000","last_became_peered":"2023-11-28T17:39:34.067453+0000","last_unstale":"2023-11-28T17:39:35.390412+0000","last_undegraded":"2023-11-28T17:39:35.390412+0000","last_fullsized":"2023-11-28T17:39:35.390412+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:16.353473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448952+0000","last_change":"2023-11-28T17:39:35.062689+0000","last_active":"2023-11-28T17:39:36.448952+0000","last_peered":"2023-11-28T17:39:36.448952+0000","last_clean":"2023-11-28T17:39:36.448952+0000","last_became_active":"2023-11-28T17:39:35.062421+0000","last_became_peered":"2023-11-28T17:39:35.062421+0000","last_unstale":"2023-11-28T17:39:36.448952+0000","last_undegraded":"2023-11-28T17:39:36.448952+0000","last_fullsized":"2023-11-28T17:39:36.448952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049994+0000","last_change":"2023-11-28T17:39:34.058487+0000","last_active":"2023-11-28T17:39:36.049994+0000","last_peered":"2023-11-28T17:39:36.049994+0000","last_clean":"2023-11-28T17:39:36.049994+0000","last_became_active":"2023-11-28T17:39:34.058159+0000","last_became_peered":"2023-11-28T17:39:34.058159+0000","last_unstale":"2023-11-28T17:39:36.049994+0000","last_undegraded":"2023-11-28T17:39:36.049994+0000","last_fullsized":"2023-11-28T17:39:36.049994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:25.039707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450178+0000","last_change":"2023-11-28T17:39:35.076401+0000","last_active":"2023-11-28T17:39:36.450178+0000","last_peered":"2023-11-28T17:39:36.450178+0000","last_clean":"2023-11-28T17:39:36.450178+0000","last_became_active":"2023-11-28T17:39:35.076015+0000","last_became_peered":"2023-11-28T17:39:35.076015+0000","last_unstale":"2023-11-28T17:39:36.450178+0000","last_undegraded":"2023-11-28T17:39:36.450178+0000","last_fullsized":"2023-11-28T17:39:36.450178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.389142+0000","last_change":"2023-11-28T17:39:34.068303+0000","last_active":"2023-11-28T17:39:35.389142+0000","last_peered":"2023-11-28T17:39:35.389142+0000","last_clean":"2023-11-28T17:39:35.389142+0000","last_became_active":"2023-11-28T17:39:34.066648+0000","last_became_peered":"2023-11-28T17:39:34.066648+0000","last_unstale":"2023-11-28T17:39:35.389142+0000","last_undegraded":"2023-11-28T17:39:35.389142+0000","last_fullsized":"2023-11-28T17:39:35.389142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:39.488626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311919+0000","last_change":"2023-11-28T17:39:35.067106+0000","last_active":"2023-11-28T17:39:36.311919+0000","last_peered":"2023-11-28T17:39:36.311919+0000","last_clean":"2023-11-28T17:39:36.311919+0000","last_became_active":"2023-11-28T17:39:35.066673+0000","last_became_peered":"2023-11-28T17:39:35.066673+0000","last_unstale":"2023-11-28T17:39:36.311919+0000","last_undegraded":"2023-11-28T17:39:36.311919+0000","last_fullsized":"2023-11-28T17:39:36.311919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449337+0000","last_change":"2023-11-28T17:39:34.073519+0000","last_active":"2023-11-28T17:39:36.449337+0000","last_peered":"2023-11-28T17:39:36.449337+0000","last_clean":"2023-11-28T17:39:36.449337+0000","last_became_active":"2023-11-28T17:39:34.073200+0000","last_became_peered":"2023-11-28T17:39:34.073200+0000","last_unstale":"2023-11-28T17:39:36.449337+0000","last_undegraded":"2023-11-28T17:39:36.449337+0000","last_fullsized":"2023-11-28T17:39:36.449337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449088+0000","last_change":"2023-11-28T17:39:35.080909+0000","last_active":"2023-11-28T17:39:36.449088+0000","last_peered":"2023-11-28T17:39:36.449088+0000","last_clean":"2023-11-28T17:39:36.449088+0000","last_became_active":"2023-11-28T17:39:35.080072+0000","last_became_peered":"2023-11-28T17:39:35.080072+0000","last_unstale":"2023-11-28T17:39:36.449088+0000","last_undegraded":"2023-11-28T17:39:36.449088+0000","last_fullsized":"2023-11-28T17:39:36.449088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448347+0000","last_change":"2023-11-28T17:39:34.069169+0000","last_active":"2023-11-28T17:39:36.448347+0000","last_peered":"2023-11-28T17:39:36.448347+0000","last_clean":"2023-11-28T17:39:36.448347+0000","last_became_active":"2023-11-28T17:39:34.067860+0000","last_became_peered":"2023-11-28T17:39:34.067860+0000","last_unstale":"2023-11-28T17:39:36.448347+0000","last_undegraded":"2023-11-28T17:39:36.448347+0000","last_fullsized":"2023-11-28T17:39:36.448347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:18.869334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448881+0000","last_change":"2023-11-28T17:39:35.071533+0000","last_active":"2023-11-28T17:39:36.448881+0000","last_peered":"2023-11-28T17:39:36.448881+0000","last_clean":"2023-11-28T17:39:36.448881+0000","last_became_active":"2023-11-28T17:39:35.071284+0000","last_became_peered":"2023-11-28T17:39:35.071284+0000","last_unstale":"2023-11-28T17:39:36.448881+0000","last_undegraded":"2023-11-28T17:39:36.448881+0000","last_fullsized":"2023-11-28T17:39:36.448881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447799+0000","last_change":"2023-11-28T17:39:34.060653+0000","last_active":"2023-11-28T17:39:36.447799+0000","last_peered":"2023-11-28T17:39:36.447799+0000","last_clean":"2023-11-28T17:39:36.447799+0000","last_became_active":"2023-11-28T17:39:34.060015+0000","last_became_peered":"2023-11-28T17:39:34.060015+0000","last_unstale":"2023-11-28T17:39:36.447799+0000","last_undegraded":"2023-11-28T17:39:36.447799+0000","last_fullsized":"2023-11-28T17:39:36.447799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:05.390132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448738+0000","last_change":"2023-11-28T17:39:35.065169+0000","last_active":"2023-11-28T17:39:36.448738+0000","last_peered":"2023-11-28T17:39:36.448738+0000","last_clean":"2023-11-28T17:39:36.448738+0000","last_became_active":"2023-11-28T17:39:35.064318+0000","last_became_peered":"2023-11-28T17:39:35.064318+0000","last_unstale":"2023-11-28T17:39:36.448738+0000","last_undegraded":"2023-11-28T17:39:36.448738+0000","last_fullsized":"2023-11-28T17:39:36.448738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450204+0000","last_change":"2023-11-28T17:39:34.062100+0000","last_active":"2023-11-28T17:39:36.450204+0000","last_peered":"2023-11-28T17:39:36.450204+0000","last_clean":"2023-11-28T17:39:36.450204+0000","last_became_active":"2023-11-28T17:39:34.061747+0000","last_became_peered":"2023-11-28T17:39:34.061747+0000","last_unstale":"2023-11-28T17:39:36.450204+0000","last_undegraded":"2023-11-28T17:39:36.450204+0000","last_fullsized":"2023-11-28T17:39:36.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050050+0000","last_change":"2023-11-28T17:39:35.065690+0000","last_active":"2023-11-28T17:39:36.050050+0000","last_peered":"2023-11-28T17:39:36.050050+0000","last_clean":"2023-11-28T17:39:36.050050+0000","last_became_active":"2023-11-28T17:39:35.065320+0000","last_became_peered":"2023-11-28T17:39:35.065320+0000","last_unstale":"2023-11-28T17:39:36.050050+0000","last_undegraded":"2023-11-28T17:39:36.050050+0000","last_fullsized":"2023-11-28T17:39:36.050050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448234+0000","last_change":"2023-11-28T17:39:34.061533+0000","last_active":"2023-11-28T17:39:36.448234+0000","last_peered":"2023-11-28T17:39:36.448234+0000","last_clean":"2023-11-28T17:39:36.448234+0000","last_became_active":"2023-11-28T17:39:34.061186+0000","last_became_peered":"2023-11-28T17:39:34.061186+0000","last_unstale":"2023-11-28T17:39:36.448234+0000","last_undegraded":"2023-11-28T17:39:36.448234+0000","last_fullsized":"2023-11-28T17:39:36.448234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450173+0000","last_change":"2023-11-28T17:39:35.087511+0000","last_active":"2023-11-28T17:39:36.450173+0000","last_peered":"2023-11-28T17:39:36.450173+0000","last_clean":"2023-11-28T17:39:36.450173+0000","last_became_active":"2023-11-28T17:39:35.086912+0000","last_became_peered":"2023-11-28T17:39:35.086912+0000","last_unstale":"2023-11-28T17:39:36.450173+0000","last_undegraded":"2023-11-28T17:39:36.450173+0000","last_fullsized":"2023-11-28T17:39:36.450173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050536+0000","last_change":"2023-11-28T17:39:34.071865+0000","last_active":"2023-11-28T17:39:36.050536+0000","last_peered":"2023-11-28T17:39:36.050536+0000","last_clean":"2023-11-28T17:39:36.050536+0000","last_became_active":"2023-11-28T17:39:34.071567+0000","last_became_peered":"2023-11-28T17:39:34.071567+0000","last_unstale":"2023-11-28T17:39:36.050536+0000","last_undegraded":"2023-11-28T17:39:36.050536+0000","last_fullsized":"2023-11-28T17:39:36.050536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450019+0000","last_change":"2023-11-28T17:39:35.082650+0000","last_active":"2023-11-28T17:39:36.450019+0000","last_peered":"2023-11-28T17:39:36.450019+0000","last_clean":"2023-11-28T17:39:36.450019+0000","last_became_active":"2023-11-28T17:39:35.082382+0000","last_became_peered":"2023-11-28T17:39:35.082382+0000","last_unstale":"2023-11-28T17:39:36.450019+0000","last_undegraded":"2023-11-28T17:39:36.450019+0000","last_fullsized":"2023-11-28T17:39:36.450019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312376+0000","last_change":"2023-11-28T17:39:34.078625+0000","last_active":"2023-11-28T17:39:36.312376+0000","last_peered":"2023-11-28T17:39:36.312376+0000","last_clean":"2023-11-28T17:39:36.312376+0000","last_became_active":"2023-11-28T17:39:34.078378+0000","last_became_peered":"2023-11-28T17:39:34.078378+0000","last_unstale":"2023-11-28T17:39:36.312376+0000","last_undegraded":"2023-11-28T17:39:36.312376+0000","last_fullsized":"2023-11-28T17:39:36.312376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449383+0000","last_change":"2023-11-28T17:39:35.084148+0000","last_active":"2023-11-28T17:39:36.449383+0000","last_peered":"2023-11-28T17:39:36.449383+0000","last_clean":"2023-11-28T17:39:36.449383+0000","last_became_active":"2023-11-28T17:39:35.083942+0000","last_became_peered":"2023-11-28T17:39:35.083942+0000","last_unstale":"2023-11-28T17:39:36.449383+0000","last_undegraded":"2023-11-28T17:39:36.449383+0000","last_fullsized":"2023-11-28T17:39:36.449383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:03.153508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.054275+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:39:35.054275+0000","last_peered":"2023-11-28T17:39:35.054275+0000","last_clean":"2023-11-28T17:39:35.054275+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:39:35.054275+0000","last_undegraded":"2023-11-28T17:39:35.054275+0000","last_fullsized":"2023-11-28T17:39:35.054275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449258+0000","last_change":"2023-11-28T17:39:34.067867+0000","last_active":"2023-11-28T17:39:36.449258+0000","last_peered":"2023-11-28T17:39:36.449258+0000","last_clean":"2023-11-28T17:39:36.449258+0000","last_became_active":"2023-11-28T17:39:34.067560+0000","last_became_peered":"2023-11-28T17:39:34.067560+0000","last_unstale":"2023-11-28T17:39:36.449258+0000","last_undegraded":"2023-11-28T17:39:36.449258+0000","last_fullsized":"2023-11-28T17:39:36.449258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448035+0000","last_change":"2023-11-28T17:39:35.064367+0000","last_active":"2023-11-28T17:39:36.448035+0000","last_peered":"2023-11-28T17:39:36.448035+0000","last_clean":"2023-11-28T17:39:36.448035+0000","last_became_active":"2023-11-28T17:39:35.064054+0000","last_became_peered":"2023-11-28T17:39:35.064054+0000","last_unstale":"2023-11-28T17:39:36.448035+0000","last_undegraded":"2023-11-28T17:39:36.448035+0000","last_fullsized":"2023-11-28T17:39:36.448035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449837+0000","last_change":"2023-11-28T17:39:34.068641+0000","last_active":"2023-11-28T17:39:36.449837+0000","last_peered":"2023-11-28T17:39:36.449837+0000","last_clean":"2023-11-28T17:39:36.449837+0000","last_became_active":"2023-11-28T17:39:34.068347+0000","last_became_peered":"2023-11-28T17:39:34.068347+0000","last_unstale":"2023-11-28T17:39:36.449837+0000","last_undegraded":"2023-11-28T17:39:36.449837+0000","last_fullsized":"2023-11-28T17:39:36.449837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:28.994690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311948+0000","last_change":"2023-11-28T17:39:35.070669+0000","last_active":"2023-11-28T17:39:36.311948+0000","last_peered":"2023-11-28T17:39:36.311948+0000","last_clean":"2023-11-28T17:39:36.311948+0000","last_became_active":"2023-11-28T17:39:35.070353+0000","last_became_peered":"2023-11-28T17:39:35.070353+0000","last_unstale":"2023-11-28T17:39:36.311948+0000","last_undegraded":"2023-11-28T17:39:36.311948+0000","last_fullsized":"2023-11-28T17:39:36.311948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:25.524344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.057555+0000","last_change":"2023-11-28T17:39:34.067405+0000","last_active":"2023-11-28T17:39:35.057555+0000","last_peered":"2023-11-28T17:39:35.057555+0000","last_clean":"2023-11-28T17:39:35.057555+0000","last_became_active":"2023-11-28T17:39:34.067099+0000","last_became_peered":"2023-11-28T17:39:34.067099+0000","last_unstale":"2023-11-28T17:39:35.057555+0000","last_undegraded":"2023-11-28T17:39:35.057555+0000","last_fullsized":"2023-11-28T17:39:35.057555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:42.607678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051234+0000","last_change":"2023-11-28T17:39:35.078142+0000","last_active":"2023-11-28T17:39:36.051234+0000","last_peered":"2023-11-28T17:39:36.051234+0000","last_clean":"2023-11-28T17:39:36.051234+0000","last_became_active":"2023-11-28T17:39:35.077867+0000","last_became_peered":"2023-11-28T17:39:35.077867+0000","last_unstale":"2023-11-28T17:39:36.051234+0000","last_undegraded":"2023-11-28T17:39:36.051234+0000","last_fullsized":"2023-11-28T17:39:36.051234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449415+0000","last_change":"2023-11-28T17:39:34.076158+0000","last_active":"2023-11-28T17:39:36.449415+0000","last_peered":"2023-11-28T17:39:36.449415+0000","last_clean":"2023-11-28T17:39:36.449415+0000","last_became_active":"2023-11-28T17:39:34.075800+0000","last_became_peered":"2023-11-28T17:39:34.075800+0000","last_unstale":"2023-11-28T17:39:36.449415+0000","last_undegraded":"2023-11-28T17:39:36.449415+0000","last_fullsized":"2023-11-28T17:39:36.449415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448789+0000","last_change":"2023-11-28T17:39:35.078574+0000","last_active":"2023-11-28T17:39:36.448789+0000","last_peered":"2023-11-28T17:39:36.448789+0000","last_clean":"2023-11-28T17:39:36.448789+0000","last_became_active":"2023-11-28T17:39:35.078265+0000","last_became_peered":"2023-11-28T17:39:35.078265+0000","last_unstale":"2023-11-28T17:39:36.448789+0000","last_undegraded":"2023-11-28T17:39:36.448789+0000","last_fullsized":"2023-11-28T17:39:36.448789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050497+0000","last_change":"2023-11-28T17:39:34.078063+0000","last_active":"2023-11-28T17:39:36.050497+0000","last_peered":"2023-11-28T17:39:36.050497+0000","last_clean":"2023-11-28T17:39:36.050497+0000","last_became_active":"2023-11-28T17:39:34.077766+0000","last_became_peered":"2023-11-28T17:39:34.077766+0000","last_unstale":"2023-11-28T17:39:36.050497+0000","last_undegraded":"2023-11-28T17:39:36.050497+0000","last_fullsized":"2023-11-28T17:39:36.050497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049860+0000","last_change":"2023-11-28T17:39:35.069368+0000","last_active":"2023-11-28T17:39:36.049860+0000","last_peered":"2023-11-28T17:39:36.049860+0000","last_clean":"2023-11-28T17:39:36.049860+0000","last_became_active":"2023-11-28T17:39:35.068994+0000","last_became_peered":"2023-11-28T17:39:35.068994+0000","last_unstale":"2023-11-28T17:39:36.049860+0000","last_undegraded":"2023-11-28T17:39:36.049860+0000","last_fullsized":"2023-11-28T17:39:36.049860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449620+0000","last_change":"2023-11-28T17:39:34.070446+0000","last_active":"2023-11-28T17:39:36.449620+0000","last_peered":"2023-11-28T17:39:36.449620+0000","last_clean":"2023-11-28T17:39:36.449620+0000","last_became_active":"2023-11-28T17:39:34.070015+0000","last_became_peered":"2023-11-28T17:39:34.070015+0000","last_unstale":"2023-11-28T17:39:36.449620+0000","last_undegraded":"2023-11-28T17:39:36.449620+0000","last_fullsized":"2023-11-28T17:39:36.449620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:07.175612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312232+0000","last_change":"2023-11-28T17:39:35.070405+0000","last_active":"2023-11-28T17:39:36.312232+0000","last_peered":"2023-11-28T17:39:36.312232+0000","last_clean":"2023-11-28T17:39:36.312232+0000","last_became_active":"2023-11-28T17:39:35.069566+0000","last_became_peered":"2023-11-28T17:39:35.069566+0000","last_unstale":"2023-11-28T17:39:36.312232+0000","last_undegraded":"2023-11-28T17:39:36.312232+0000","last_fullsized":"2023-11-28T17:39:36.312232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448330+0000","last_change":"2023-11-28T17:39:34.061411+0000","last_active":"2023-11-28T17:39:36.448330+0000","last_peered":"2023-11-28T17:39:36.448330+0000","last_clean":"2023-11-28T17:39:36.448330+0000","last_became_active":"2023-11-28T17:39:34.061056+0000","last_became_peered":"2023-11-28T17:39:34.061056+0000","last_unstale":"2023-11-28T17:39:36.448330+0000","last_undegraded":"2023-11-28T17:39:36.448330+0000","last_fullsized":"2023-11-28T17:39:36.448330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:24.521800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448331+0000","last_change":"2023-11-28T17:39:35.067279+0000","last_active":"2023-11-28T17:39:36.448331+0000","last_peered":"2023-11-28T17:39:36.448331+0000","last_clean":"2023-11-28T17:39:36.448331+0000","last_became_active":"2023-11-28T17:39:35.066864+0000","last_became_peered":"2023-11-28T17:39:35.066864+0000","last_unstale":"2023-11-28T17:39:36.448331+0000","last_undegraded":"2023-11-28T17:39:36.448331+0000","last_fullsized":"2023-11-28T17:39:36.448331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449713+0000","last_change":"2023-11-28T17:39:34.079838+0000","last_active":"2023-11-28T17:39:36.449713+0000","last_peered":"2023-11-28T17:39:36.449713+0000","last_clean":"2023-11-28T17:39:36.449713+0000","last_became_active":"2023-11-28T17:39:34.075803+0000","last_became_peered":"2023-11-28T17:39:34.075803+0000","last_unstale":"2023-11-28T17:39:36.449713+0000","last_undegraded":"2023-11-28T17:39:36.449713+0000","last_fullsized":"2023-11-28T17:39:36.449713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:22.239588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448255+0000","last_change":"2023-11-28T17:39:35.070761+0000","last_active":"2023-11-28T17:39:36.448255+0000","last_peered":"2023-11-28T17:39:36.448255+0000","last_clean":"2023-11-28T17:39:36.448255+0000","last_became_active":"2023-11-28T17:39:35.070419+0000","last_became_peered":"2023-11-28T17:39:35.070419+0000","last_unstale":"2023-11-28T17:39:36.448255+0000","last_undegraded":"2023-11-28T17:39:36.448255+0000","last_fullsized":"2023-11-28T17:39:36.448255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448136+0000","last_change":"2023-11-28T17:39:34.060701+0000","last_active":"2023-11-28T17:39:36.448136+0000","last_peered":"2023-11-28T17:39:36.448136+0000","last_clean":"2023-11-28T17:39:36.448136+0000","last_became_active":"2023-11-28T17:39:34.060371+0000","last_became_peered":"2023-11-28T17:39:34.060371+0000","last_unstale":"2023-11-28T17:39:36.448136+0000","last_undegraded":"2023-11-28T17:39:36.448136+0000","last_fullsized":"2023-11-28T17:39:36.448136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448864+0000","last_change":"2023-11-28T17:39:35.064644+0000","last_active":"2023-11-28T17:39:36.448864+0000","last_peered":"2023-11-28T17:39:36.448864+0000","last_clean":"2023-11-28T17:39:36.448864+0000","last_became_active":"2023-11-28T17:39:35.063958+0000","last_became_peered":"2023-11-28T17:39:35.063958+0000","last_unstale":"2023-11-28T17:39:36.448864+0000","last_undegraded":"2023-11-28T17:39:36.448864+0000","last_fullsized":"2023-11-28T17:39:36.448864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447972+0000","last_change":"2023-11-28T17:39:34.060063+0000","last_active":"2023-11-28T17:39:36.447972+0000","last_peered":"2023-11-28T17:39:36.447972+0000","last_clean":"2023-11-28T17:39:36.447972+0000","last_became_active":"2023-11-28T17:39:34.059667+0000","last_became_peered":"2023-11-28T17:39:34.059667+0000","last_unstale":"2023-11-28T17:39:36.447972+0000","last_undegraded":"2023-11-28T17:39:36.447972+0000","last_fullsized":"2023-11-28T17:39:36.447972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447864+0000","last_change":"2023-11-28T17:39:35.069085+0000","last_active":"2023-11-28T17:39:36.447864+0000","last_peered":"2023-11-28T17:39:36.447864+0000","last_clean":"2023-11-28T17:39:36.447864+0000","last_became_active":"2023-11-28T17:39:35.068282+0000","last_became_peered":"2023-11-28T17:39:35.068282+0000","last_unstale":"2023-11-28T17:39:36.447864+0000","last_undegraded":"2023-11-28T17:39:36.447864+0000","last_fullsized":"2023-11-28T17:39:36.447864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312049+0000","last_change":"2023-11-28T17:39:34.071879+0000","last_active":"2023-11-28T17:39:36.312049+0000","last_peered":"2023-11-28T17:39:36.312049+0000","last_clean":"2023-11-28T17:39:36.312049+0000","last_became_active":"2023-11-28T17:39:34.071374+0000","last_became_peered":"2023-11-28T17:39:34.071374+0000","last_unstale":"2023-11-28T17:39:36.312049+0000","last_undegraded":"2023-11-28T17:39:36.312049+0000","last_fullsized":"2023-11-28T17:39:36.312049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:28.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.082085+0000","last_change":"2023-11-28T17:39:35.076243+0000","last_active":"2023-11-28T17:39:35.082085+0000","last_peered":"2023-11-28T17:39:35.082085+0000","last_clean":"2023-11-28T17:39:35.082085+0000","last_became_active":"2023-11-28T17:39:35.075878+0000","last_became_peered":"2023-11-28T17:39:35.075878+0000","last_unstale":"2023-11-28T17:39:35.082085+0000","last_undegraded":"2023-11-28T17:39:35.082085+0000","last_fullsized":"2023-11-28T17:39:35.082085+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:59.930675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449173+0000","last_change":"2023-11-28T17:39:34.080217+0000","last_active":"2023-11-28T17:39:36.449173+0000","last_peered":"2023-11-28T17:39:36.449173+0000","last_clean":"2023-11-28T17:39:36.449173+0000","last_became_active":"2023-11-28T17:39:34.079885+0000","last_became_peered":"2023-11-28T17:39:34.079885+0000","last_unstale":"2023-11-28T17:39:36.449173+0000","last_undegraded":"2023-11-28T17:39:36.449173+0000","last_fullsized":"2023-11-28T17:39:36.449173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449154+0000","last_change":"2023-11-28T17:39:35.081899+0000","last_active":"2023-11-28T17:39:36.449154+0000","last_peered":"2023-11-28T17:39:36.449154+0000","last_clean":"2023-11-28T17:39:36.449154+0000","last_became_active":"2023-11-28T17:39:35.081239+0000","last_became_peered":"2023-11-28T17:39:35.081239+0000","last_unstale":"2023-11-28T17:39:36.449154+0000","last_undegraded":"2023-11-28T17:39:36.449154+0000","last_fullsized":"2023-11-28T17:39:36.449154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:36.478729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449756+0000","last_change":"2023-11-28T17:39:35.072258+0000","last_active":"2023-11-28T17:39:36.449756+0000","last_peered":"2023-11-28T17:39:36.449756+0000","last_clean":"2023-11-28T17:39:36.449756+0000","last_became_active":"2023-11-28T17:39:35.071820+0000","last_became_peered":"2023-11-28T17:39:35.071820+0000","last_unstale":"2023-11-28T17:39:36.449756+0000","last_undegraded":"2023-11-28T17:39:36.449756+0000","last_fullsized":"2023-11-28T17:39:36.449756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:25.703521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450044+0000","last_change":"2023-11-28T17:39:34.071815+0000","last_active":"2023-11-28T17:39:36.450044+0000","last_peered":"2023-11-28T17:39:36.450044+0000","last_clean":"2023-11-28T17:39:36.450044+0000","last_became_active":"2023-11-28T17:39:34.070404+0000","last_became_peered":"2023-11-28T17:39:34.070404+0000","last_unstale":"2023-11-28T17:39:36.450044+0000","last_undegraded":"2023-11-28T17:39:36.450044+0000","last_fullsized":"2023-11-28T17:39:36.450044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449165+0000","last_change":"2023-11-28T17:39:35.078177+0000","last_active":"2023-11-28T17:39:36.449165+0000","last_peered":"2023-11-28T17:39:36.449165+0000","last_clean":"2023-11-28T17:39:36.449165+0000","last_became_active":"2023-11-28T17:39:35.077903+0000","last_became_peered":"2023-11-28T17:39:35.077903+0000","last_unstale":"2023-11-28T17:39:36.449165+0000","last_undegraded":"2023-11-28T17:39:36.449165+0000","last_fullsized":"2023-11-28T17:39:36.449165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450137+0000","last_change":"2023-11-28T17:39:34.074770+0000","last_active":"2023-11-28T17:39:36.450137+0000","last_peered":"2023-11-28T17:39:36.450137+0000","last_clean":"2023-11-28T17:39:36.450137+0000","last_became_active":"2023-11-28T17:39:34.074470+0000","last_became_peered":"2023-11-28T17:39:34.074470+0000","last_unstale":"2023-11-28T17:39:36.450137+0000","last_undegraded":"2023-11-28T17:39:36.450137+0000","last_fullsized":"2023-11-28T17:39:36.450137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050609+0000","last_change":"2023-11-28T17:39:35.079538+0000","last_active":"2023-11-28T17:39:36.050609+0000","last_peered":"2023-11-28T17:39:36.050609+0000","last_clean":"2023-11-28T17:39:36.050609+0000","last_became_active":"2023-11-28T17:39:35.079236+0000","last_became_peered":"2023-11-28T17:39:35.079236+0000","last_unstale":"2023-11-28T17:39:36.050609+0000","last_undegraded":"2023-11-28T17:39:36.050609+0000","last_fullsized":"2023-11-28T17:39:36.050609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051095+0000","last_change":"2023-11-28T17:39:34.066171+0000","last_active":"2023-11-28T17:39:36.051095+0000","last_peered":"2023-11-28T17:39:36.051095+0000","last_clean":"2023-11-28T17:39:36.051095+0000","last_became_active":"2023-11-28T17:39:34.065133+0000","last_became_peered":"2023-11-28T17:39:34.065133+0000","last_unstale":"2023-11-28T17:39:36.051095+0000","last_undegraded":"2023-11-28T17:39:36.051095+0000","last_fullsized":"2023-11-28T17:39:36.051095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051059+0000","last_change":"2023-11-28T17:39:35.069328+0000","last_active":"2023-11-28T17:39:36.051059+0000","last_peered":"2023-11-28T17:39:36.051059+0000","last_clean":"2023-11-28T17:39:36.051059+0000","last_became_active":"2023-11-28T17:39:35.066256+0000","last_became_peered":"2023-11-28T17:39:35.066256+0000","last_unstale":"2023-11-28T17:39:36.051059+0000","last_undegraded":"2023-11-28T17:39:36.051059+0000","last_fullsized":"2023-11-28T17:39:36.051059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448353+0000","last_change":"2023-11-28T17:39:34.067861+0000","last_active":"2023-11-28T17:39:36.448353+0000","last_peered":"2023-11-28T17:39:36.448353+0000","last_clean":"2023-11-28T17:39:36.448353+0000","last_became_active":"2023-11-28T17:39:34.067203+0000","last_became_peered":"2023-11-28T17:39:34.067203+0000","last_unstale":"2023-11-28T17:39:36.448353+0000","last_undegraded":"2023-11-28T17:39:36.448353+0000","last_fullsized":"2023-11-28T17:39:36.448353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]}]},{"osd":5,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]}]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":72236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":212992,"data_stored":70534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]}]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":70008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":63177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.871}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:39:39.872 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T17:39:39.873 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T17:39:39.873 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T17:39:39.873 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T17:39:39.873 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T17:39:40.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d0a92a640 1 Processor -- start 2023-11-28T17:39:40.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d0a92a640 1 -- start start 2023-11-28T17:39:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d0a92a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9d040cf3b0 0x7f9d040714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d0a92a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d040ce4f0 con 0x7f9d04144c80 2023-11-28T17:39:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d0a92a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d040ce7d0 con 0x7f9d040cef30 2023-11-28T17:39:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d0a92a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d040709b0 con 0x7f9d040cf3b0 2023-11-28T17:39:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d03fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9d04144c80 0x7f9d040cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50324/0 (socket says 172.21.15.16:50324) 2023-11-28T17:39:40.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.055+0000 7f9d03fff640 1 -- 172.21.15.16:0/1147263791 learned_addr learned my addr 172.21.15.16:0/1147263791 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:40.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d08ec7640 1 --2- 172.21.15.16:0/1147263791 >> v2:172.21.15.64:3300/0 conn(0x7f9d040cf3b0 0x7f9d040714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402022769 0 0) 0x7f9d040ce4f0 con 0x7f9d04144c80 2023-11-28T17:39:40.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cec003530 con 0x7f9d04144c80 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898083857 0 0) 0x7f9d040ce7d0 con 0x7f9d040cef30 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d040ce4f0 con 0x7f9d040cef30 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1831377198 0 0) 0x7f9cec003530 con 0x7f9d04144c80 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 >> v2:172.21.15.64:3300/0 conn(0x7f9d040cf3b0 msgr2=0x7f9d040714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 --2- 172.21.15.16:0/1147263791 >> v2:172.21.15.64:3300/0 conn(0x7f9d040cf3b0 0x7f9d040714e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 >> v1:172.21.15.64:6789/0 conn(0x7f9d040cef30 legacy=0x7f9d04070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040ceab0 con 0x7f9d04144c80 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f9cf4001680 con 0x7f9d04144c80 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 >> v1:172.21.15.16:6789/0 conn(0x7f9d04144c80 legacy=0x7f9d040cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cec003b60 0x7f9cec003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9cec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cec005190 0x7f9cec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040709b0 con 0x7f9cec0047d0 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec00c060 con 0x7f9cec005190 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cec00c220 con 0x7f9cec003b60 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d037fe640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9cec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d03fff640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cec003b60 0x7f9cec003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d08ec7640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cec005190 0x7f9cec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d037fe640 1 -- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cec003b60 msgr2=0x7f9cec003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d037fe640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cec003b60 0x7f9cec003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d037fe640 1 -- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cec005190 msgr2=0x7f9cec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d037fe640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cec005190 0x7f9cec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d037fe640 1 -- 172.21.15.16:0/1147263791 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec003530 con 0x7f9cec0047d0 2023-11-28T17:39:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d08ec7640 1 -- 172.21.15.16:0/1147263791 reap_dead start 2023-11-28T17:39:40.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.059+0000 7f9d03fff640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cec003b60 0x7f9cec003f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d037fe640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9cec004c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80018d0 tx=0x7f9cf801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183556aa4ac4a745 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80052d0 con 0x7f9cec0047d0 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8005450 con 0x7f9cec0047d0 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d02ffd640 1 -- 172.21.15.16:0/1147263791 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80a88d0 con 0x7f9cec0047d0 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 -- 172.21.15.16:0/1147263791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 msgr2=0x7f9cec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9cec004c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80018d0 tx=0x7f9cf801ec70 comp rx=0 tx=0).stop 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 -- 172.21.15.16:0/1147263791 shutdown_connections 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/1147263791 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9cec004c50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 -- 172.21.15.16:0/1147263791 >> 172.21.15.16:0/1147263791 conn(0x7f9d0406a5a0 msgr2=0x7f9d0406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:40.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 -- 172.21.15.16:0/1147263791 shutdown_connections 2023-11-28T17:39:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 -- 172.21.15.16:0/1147263791 wait complete. 2023-11-28T17:39:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 Processor -- start 2023-11-28T17:39:40.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.063+0000 7f9d0a92a640 1 -- start start 2023-11-28T17:39:40.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9d040c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d04159780 0x7f9d04158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d04159c00 0x7f9d04158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d041f7150 con 0x7f9cec0047d0 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d041f6e70 con 0x7f9d04159c00 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d040b1fc0 con 0x7f9d04159780 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9d040c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9d040c63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48444/0 (socket says 172.21.15.16:48444) 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 -- 172.21.15.16:0/4048429817 learned_addr learned my addr 172.21.15.16:0/4048429817 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d037fe640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d04159780 0x7f9d04158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d08ec7640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d04159c00 0x7f9d04158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 -- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d04159780 msgr2=0x7f9d04158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d04159780 0x7f9d04158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 -- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d04159c00 msgr2=0x7f9d04158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d04159c00 0x7f9d04158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 -- 172.21.15.16:0/4048429817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d040b22a0 con 0x7f9cec0047d0 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d03fff640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9d040c63d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e780 tx=0x7f9cf400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400c6c0 con 0x7f9cec0047d0 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf400c820 con 0x7f9cec0047d0 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf400cb90 con 0x7f9cec0047d0 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d040b2580 con 0x7f9cec0047d0 2023-11-28T17:39:40.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d041f61f0 con 0x7f9cec0047d0 2023-11-28T17:39:40.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d04068860 con 0x7f9cec0047d0 2023-11-28T17:39:40.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.067+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9cf400ccf0 con 0x7f9cec0047d0 2023-11-28T17:39:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.071+0000 7f9d00ff9640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9cf00668d0 0x7f9cf0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.071+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cf40841c0 con 0x7f9cec0047d0 2023-11-28T17:39:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.071+0000 7f9d037fe640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9cf00668d0 0x7f9cf0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.071+0000 7f9d037fe640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9cf00668d0 0x7f9cf0068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80b0000 tx=0x7f9cf80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.075+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cf4051470 con 0x7f9cec0047d0 2023-11-28T17:39:40.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.267+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f9d0415a180 con 0x7f9cec0047d0 2023-11-28T17:39:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.271+0000 7f9d00ff9640 1 -- 172.21.15.16:0/4048429817 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164969 (secure 0 0 0) 0x7f9cf4054a90 con 0x7f9cec0047d0 2023-11-28T17:39:40.277 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9cf00668d0 msgr2=0x7f9cf0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9cf00668d0 0x7f9cf0068d90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cf80b0000 tx=0x7f9cf80aa070 comp rx=0 tx=0).stop 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 msgr2=0x7f9d040c63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9d040c63d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9cf400e780 tx=0x7f9cf400ec40 comp rx=0 tx=0).stop 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 shutdown_connections 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9cf00668d0 0x7f9cf0068d90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d04159c00 0x7f9d04158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9d04159780 0x7f9d04158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 --2- 172.21.15.16:0/4048429817 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cec0047d0 0x7f9d040c63d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 >> 172.21.15.16:0/4048429817 conn(0x7f9d0406a5a0 msgr2=0x7f9d0415d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:40.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 shutdown_connections 2023-11-28T17:39:40.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.275+0000 7f9d0a92a640 1 -- 172.21.15.16:0/4048429817 wait complete. 2023-11-28T17:39:40.297 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":2559396587},{"type":"v1","addr":"172.21.15.64:6833","nonce":2559396587}]},"active_addr":"172.21.15.64:6833/2559396587","active_change":"2023-11-28T17:39:14.751042+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":3039518495}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":4071679904}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":366768603}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.64:0","nonce":3371152655}]}]} 2023-11-28T17:39:40.301 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T17:39:40.301 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T17:39:40.301 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:40.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.439+0000 7fc36d9e6640 1 Processor -- start 2023-11-28T17:39:40.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.439+0000 7fc36d9e6640 1 -- start start 2023-11-28T17:39:40.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc36d9e6640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc3681548e0 0x7fc3680ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc36d9e6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3680cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc36d9e6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc36815b350 0x7fc3680cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc36d9e6640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36815a6a0 con 0x7fc3681548e0 2023-11-28T17:39:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc36d9e6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3680ced30 con 0x7fc36815b350 2023-11-28T17:39:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc36d9e6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36815a8b0 con 0x7fc368072090 2023-11-28T17:39:40.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc3681548e0 0x7fc3680ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc3681548e0 0x7fc3680ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48460/0 (socket says 172.21.15.16:48460) 2023-11-28T17:39:40.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 -- 172.21.15.16:0/2173301242 learned_addr learned my addr 172.21.15.16:0/2173301242 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:40.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 -- 172.21.15.16:0/2173301242 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 msgr2=0x7fc3680cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:40.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 --2- 172.21.15.16:0/2173301242 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3680cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 -- 172.21.15.16:0/2173301242 >> v2:172.21.15.64:3300/0 conn(0x7fc36815b350 msgr2=0x7fc3680cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:40.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 --2- 172.21.15.16:0/2173301242 >> v2:172.21.15.64:3300/0 conn(0x7fc36815b350 0x7fc3680cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.443+0000 7fc366ffd640 1 -- 172.21.15.16:0/2173301242 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680cea50 con 0x7fc3681548e0 2023-11-28T17:39:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc366ffd640 1 --2- 172.21.15.16:0/2173301242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3681548e0 0x7fc3680ce150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc36806e950 tx=0x7fc35801e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901784f5afd7eb9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc365ffb640 1 -- 172.21.15.16:0/2173301242 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580a8670 con 0x7fc3681548e0 2023-11-28T17:39:40.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc365ffb640 1 -- 172.21.15.16:0/2173301242 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3580a87d0 con 0x7fc3681548e0 2023-11-28T17:39:40.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc365ffb640 1 -- 172.21.15.16:0/2173301242 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3580a8b60 con 0x7fc3681548e0 2023-11-28T17:39:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 -- 172.21.15.16:0/2173301242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3681548e0 msgr2=0x7fc3680ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/2173301242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3681548e0 0x7fc3680ce150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc36806e950 tx=0x7fc35801e6e0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 -- 172.21.15.16:0/2173301242 shutdown_connections 2023-11-28T17:39:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/2173301242 >> v2:172.21.15.64:3300/0 conn(0x7fc36815b350 0x7fc3680cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/2173301242 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3680cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/2173301242 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc3681548e0 0x7fc3680ce150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 -- 172.21.15.16:0/2173301242 >> 172.21.15.16:0/2173301242 conn(0x7fc36806a5a0 msgr2=0x7fc36806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 -- 172.21.15.16:0/2173301242 shutdown_connections 2023-11-28T17:39:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 -- 172.21.15.16:0/2173301242 wait complete. 2023-11-28T17:39:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 Processor -- start 2023-11-28T17:39:40.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.447+0000 7fc36d9e6640 1 -- start start 2023-11-28T17:39:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3681456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3681548e0 0x7fc368144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 0x7fc36814c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc368145f80 con 0x7fc36815b350 2023-11-28T17:39:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3681454a0 con 0x7fc3681548e0 2023-11-28T17:39:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3680b0170 con 0x7fc368072090 2023-11-28T17:39:40.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 0x7fc36814c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 0x7fc36814c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48462/0 (socket says 172.21.15.16:48462) 2023-11-28T17:39:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 -- 172.21.15.16:0/3649093899 learned_addr learned my addr 172.21.15.16:0/3649093899 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:40.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc366ffd640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3681456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3667fc640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3681548e0 0x7fc368144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 -- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 msgr2=0x7fc3681456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3681456e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 -- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3681548e0 msgr2=0x7fc368144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3681548e0 0x7fc368144f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 -- 172.21.15.16:0/3649093899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580094d0 con 0x7fc36815b350 2023-11-28T17:39:40.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc3677fe640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 0x7fc36814c570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc36000b970 tx=0x7fc36000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000cb40 con 0x7fc36815b350 2023-11-28T17:39:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000ccc0 con 0x7fc36815b350 2023-11-28T17:39:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3680b0450 con 0x7fc36815b350 2023-11-28T17:39:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc360014680 con 0x7fc36815b350 2023-11-28T17:39:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3680b0a10 con 0x7fc36815b350 2023-11-28T17:39:40.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.451+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc368071e00 con 0x7fc36815b350 2023-11-28T17:39:40.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.455+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc36001d3b0 con 0x7fc36815b350 2023-11-28T17:39:40.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.455+0000 7fc34ffff640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc3540668d0 0x7fc354068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.455+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc360084330 con 0x7fc36815b350 2023-11-28T17:39:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.455+0000 7fc366ffd640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc3540668d0 0x7fc354068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.455+0000 7fc366ffd640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc3540668d0 0x7fc354068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3580b0000 tx=0x7fc358009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.459+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc360051600 con 0x7fc36815b350 2023-11-28T17:39:40.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.615+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc368068860 con 0x7fc36815b350 2023-11-28T17:39:40.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.615+0000 7fc34ffff640 1 -- 172.21.15.16:0/3649093899 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fc360054c20 con 0x7fc36815b350 2023-11-28T17:39:40.620 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:40.620 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:40.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc3540668d0 msgr2=0x7fc354068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc3540668d0 0x7fc354068d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3580b0000 tx=0x7fc358009040 comp rx=0 tx=0).stop 2023-11-28T17:39:40.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 msgr2=0x7fc36814c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 0x7fc36814c570 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc36000b970 tx=0x7fc36000be30 comp rx=0 tx=0).stop 2023-11-28T17:39:40.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 shutdown_connections 2023-11-28T17:39:40.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc36815b350 0x7fc36814c570 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc3540668d0 0x7fc354068d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3681548e0 0x7fc368144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 --2- 172.21.15.16:0/3649093899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc368072090 0x7fc3681456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 >> 172.21.15.16:0/3649093899 conn(0x7fc36806a5a0 msgr2=0x7fc3680cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:40.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 shutdown_connections 2023-11-28T17:39:40.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.619+0000 7fc36d9e6640 1 -- 172.21.15.16:0/3649093899 wait complete. 2023-11-28T17:39:40.641 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T17:39:40.641 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:40.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 Processor -- start 2023-11-28T17:39:40.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 -- start start 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0ed415d480 0x7f0ed40cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0ed40d3920 0x7f0ed40b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed40b3250 con 0x7f0ed40ce3b0 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40ce8f0 con 0x7f0ed415d480 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed8aad640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed40cebd0 con 0x7f0ed40d3920 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed37fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0ed415d480 0x7f0ed40cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed2ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0ed40ce3b0 0x7f0ed40d3210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50330/0 (socket says 172.21.15.16:50330) 2023-11-28T17:39:40.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed2ffd640 1 -- 172.21.15.16:0/16652624 learned_addr learned my addr 172.21.15.16:0/16652624 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed3fff640 1 --2- 172.21.15.16:0/16652624 >> v2:172.21.15.64:3300/0 conn(0x7f0ed40d3920 0x7f0ed40b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed37fe640 1 -- 172.21.15.16:0/16652624 >> v2:172.21.15.64:3300/0 conn(0x7f0ed40d3920 msgr2=0x7f0ed40b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed37fe640 1 --2- 172.21.15.16:0/16652624 >> v2:172.21.15.64:3300/0 conn(0x7f0ed40d3920 0x7f0ed40b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed37fe640 1 -- 172.21.15.16:0/16652624 >> v1:172.21.15.16:6789/0 conn(0x7f0ed40ce3b0 legacy=0x7f0ed40d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed37fe640 1 -- 172.21.15.16:0/16652624 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed40ceeb0 con 0x7f0ed415d480 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed27fc640 1 -- 172.21.15.16:0/16652624 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221153193 0 0) 0x7f0ed40b3250 con 0x7f0ed40ce3b0 2023-11-28T17:39:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.783+0000 7f0ed3fff640 1 --2- 172.21.15.16:0/16652624 >> v2:172.21.15.64:3300/0 conn(0x7f0ed40d3920 0x7f0ed40b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:40.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed37fe640 1 --2- 172.21.15.16:0/16652624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed40cde70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40d3060 tx=0x7f0ec401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33b9b378fabadb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed27fc640 1 -- 172.21.15.16:0/16652624 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40ab5f0 con 0x7f0ed415d480 2023-11-28T17:39:40.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed27fc640 1 -- 172.21.15.16:0/16652624 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec40ab750 con 0x7f0ed415d480 2023-11-28T17:39:40.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed27fc640 1 -- 172.21.15.16:0/16652624 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40abae0 con 0x7f0ed415d480 2023-11-28T17:39:40.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 -- 172.21.15.16:0/16652624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 msgr2=0x7f0ed40cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/16652624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed40cde70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0ed40d3060 tx=0x7f0ec401c3d0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 -- 172.21.15.16:0/16652624 shutdown_connections 2023-11-28T17:39:40.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/16652624 >> v2:172.21.15.64:3300/0 conn(0x7f0ed40d3920 0x7f0ed40b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/16652624 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed40cde70 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 -- 172.21.15.16:0/16652624 >> 172.21.15.16:0/16652624 conn(0x7f0ed408cc90 msgr2=0x7f0ed409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 -- 172.21.15.16:0/16652624 shutdown_connections 2023-11-28T17:39:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.787+0000 7f0ed8aad640 1 -- 172.21.15.16:0/16652624 wait complete. 2023-11-28T17:39:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 Processor -- start 2023-11-28T17:39:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- start start 2023-11-28T17:39:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ed40ce3b0 0x7f0ed40b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ed40d3920 0x7f0ed4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed4157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4159ac0 con 0x7f0ed415d480 2023-11-28T17:39:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4159d60 con 0x7f0ed40ce3b0 2023-11-28T17:39:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed415a040 con 0x7f0ed40d3920 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed4157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed4157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48482/0 (socket says 172.21.15.16:48482) 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 -- 172.21.15.16:0/1598668933 learned_addr learned my addr 172.21.15.16:0/1598668933 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed37fe640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ed40ce3b0 0x7f0ed40b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed2ffd640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ed40d3920 0x7f0ed4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 -- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ed40d3920 msgr2=0x7f0ed4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ed40d3920 0x7f0ed4154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 -- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ed40ce3b0 msgr2=0x7f0ed40b8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ed40ce3b0 0x7f0ed40b8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 -- 172.21.15.16:0/1598668933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009420 con 0x7f0ed415d480 2023-11-28T17:39:40.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed37fe640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ed40ce3b0 0x7f0ed40b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed3fff640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed4157430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00cea0 tx=0x7f0ecc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc003ba0 con 0x7f0ed415d480 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc003d20 con 0x7f0ed415d480 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc00d880 con 0x7f0ed415d480 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed4158200 con 0x7f0ed415d480 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4154bd0 con 0x7f0ed415d480 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.791+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed40cad60 con 0x7f0ed415d480 2023-11-28T17:39:40.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.795+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0ecc00d9e0 con 0x7f0ed415d480 2023-11-28T17:39:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.795+0000 7f0ebbfff640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0ec00668d0 0x7f0ec0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:40.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.795+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ecc084d60 con 0x7f0ed415d480 2023-11-28T17:39:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.795+0000 7f0ed37fe640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0ec00668d0 0x7f0ec0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:40.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.795+0000 7f0ed37fe640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0ec00668d0 0x7f0ec0068d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40af000 tx=0x7f0ec40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:40.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.799+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ed40cad60 con 0x7f0ed415d480 2023-11-28T17:39:40.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.955+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed40cad60 con 0x7f0ed415d480 2023-11-28T17:39:40.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.955+0000 7f0ebbfff640 1 -- 172.21.15.16:0/1598668933 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f0ed40cad60 con 0x7f0ed415d480 2023-11-28T17:39:40.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:40.960 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:40.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0ec00668d0 msgr2=0x7f0ec0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0ec00668d0 0x7f0ec0068d90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40af000 tx=0x7f0ec40a7000 comp rx=0 tx=0).stop 2023-11-28T17:39:40.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 msgr2=0x7f0ed4157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:40.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed4157430 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00cea0 tx=0x7f0ecc00cf90 comp rx=0 tx=0).stop 2023-11-28T17:39:40.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 shutdown_connections 2023-11-28T17:39:40.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0ed415d480 0x7f0ed4157430 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0ed40d3920 0x7f0ed4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0ec00668d0 0x7f0ec0068d90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 --2- 172.21.15.16:0/1598668933 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ed40ce3b0 0x7f0ed40b8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:40.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 >> 172.21.15.16:0/1598668933 conn(0x7f0ed408cc90 msgr2=0x7f0ed40b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:40.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 shutdown_connections 2023-11-28T17:39:40.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:40.959+0000 7f0ed8aad640 1 -- 172.21.15.16:0/1598668933 wait complete. 2023-11-28T17:39:40.982 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T17:39:40.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T17:39:40.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T17:39:40.984 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T17:39:40.984 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T17:39:40.984 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T17:39:40.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T17:39:40.985 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T17:39:41.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f988add1640 1 Processor -- start 2023-11-28T17:39:41.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f70b359e640 1 Processor -- start 2023-11-28T17:39:41.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f988add1640 1 -- start start 2023-11-28T17:39:41.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f70b359e640 1 -- start start 2023-11-28T17:39:41.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f988add1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9884159540 0x7f988415d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f70b359e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70ac0e3330 0x7f70ac007650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.231+0000 7f988add1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9884072010 0x7f98840cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb41752a640 1 Processor -- start 2023-11-28T17:39:41.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b359e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f70ac0382d0 0x7f70ac053900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b359e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70ac0e3710 con 0x7f70ac037d80 2023-11-28T17:39:41.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b359e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac058d60 con 0x7f70ac0e3330 2023-11-28T17:39:41.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b359e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70ac0587a0 con 0x7f70ac0382d0 2023-11-28T17:39:41.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9883fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9884072010 0x7f98840cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9883fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9884072010 0x7f98840cb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48506/0 (socket says 172.21.15.16:48506) 2023-11-28T17:39:41.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f988add1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988415d410 con 0x7f98840b1ec0 2023-11-28T17:39:41.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f988add1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988406e200 con 0x7f9884072010 2023-11-28T17:39:41.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f988add1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988415dde0 con 0x7f9884159540 2023-11-28T17:39:41.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f70ac0382d0 0x7f70ac053900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b259c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f70ac0e3330 0x7f70ac007650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f70ac0382d0 0x7f70ac053900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54188/0 (socket says 172.21.15.16:54188) 2023-11-28T17:39:41.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2740641530 learned_addr learned my addr 172.21.15.16:0/2740641530 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9884159540 0x7f988415d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9884159540 0x7f988415d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54176/0 (socket says 172.21.15.16:54176) 2023-11-28T17:39:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 -- 172.21.15.16:0/969342256 learned_addr learned my addr 172.21.15.16:0/969342256 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 -- 172.21.15.16:0/969342256 >> v2:172.21.15.16:3300/0 conn(0x7f9884072010 msgr2=0x7f98840cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 --2- 172.21.15.16:0/969342256 >> v2:172.21.15.16:3300/0 conn(0x7f9884072010 0x7f98840cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 -- 172.21.15.16:0/969342256 >> v1:172.21.15.16:6789/0 conn(0x7f98840b1ec0 legacy=0x7f98840703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f9888b6d640 1 -- 172.21.15.16:0/969342256 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988406dc40 con 0x7f9884159540 2023-11-28T17:39:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb41752a640 1 -- start start 2023-11-28T17:39:41.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb41752a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb4100ae8a0 0x7fb41015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb41752a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4100cee10 con 0x7fb4100712f0 2023-11-28T17:39:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb41752a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4100b2ae0 con 0x7fb4100cfac0 2023-11-28T17:39:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb41752a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41015ce10 con 0x7fb4100ae8a0 2023-11-28T17:39:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb4152c6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb4100ae8a0 0x7fb41015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb414ac5640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fb4100cfac0 0x7fb410070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56578/0 (socket says 172.21.15.16:56578) 2023-11-28T17:39:41.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7fb414ac5640 1 -- 172.21.15.16:0/1304003176 learned_addr learned my addr 172.21.15.16:0/1304003176 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2740641530 >> v2:172.21.15.16:3300/0 conn(0x7f70ac0e3330 msgr2=0x7f70ac007650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 --2- 172.21.15.16:0/2740641530 >> v2:172.21.15.16:3300/0 conn(0x7f70ac0e3330 0x7f70ac007650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2740641530 >> v1:172.21.15.16:6789/0 conn(0x7f70ac037d80 legacy=0x7f70ac03c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.235+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2740641530 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac058a80 con 0x7f70ac0382d0 2023-11-28T17:39:41.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7fb407fff640 1 -- 172.21.15.16:0/1304003176 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2668712079 0 0) 0x7fb4100cee10 con 0x7fb4100712f0 2023-11-28T17:39:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7fb407fff640 1 -- 172.21.15.16:0/1304003176 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3fc003530 con 0x7fb4100712f0 2023-11-28T17:39:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7fb4152c6640 1 -- 172.21.15.16:0/1304003176 >> v1:172.21.15.64:6789/0 conn(0x7fb4100cfac0 legacy=0x7fb410070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7fb407fff640 1 -- 172.21.15.16:0/1304003176 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3350712102 0 0) 0x7fb3fc003530 con 0x7fb4100712f0 2023-11-28T17:39:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7fb4152c6640 1 -- 172.21.15.16:0/1304003176 >> v1:172.21.15.16:6789/0 conn(0x7fb4100712f0 legacy=0x7fb4100b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7fb4152c6640 1 -- 172.21.15.16:0/1304003176 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100b21b0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.239+0000 7f835ee32640 1 Processor -- start 2023-11-28T17:39:41.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f9888b6d640 1 --2- 172.21.15.16:0/969342256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9884159540 0x7f988415d8a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98840cfa00 tx=0x7f9874024e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c84189db6ca11b4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b1d9b640 1 --2- 172.21.15.16:0/2740641530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac053900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70ac05a040 tx=0x7f70a401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=323535ecbdfa944f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f835ee32640 1 -- start start 2023-11-28T17:39:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b159a640 1 -- 172.21.15.16:0/2740641530 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40a89f0 con 0x7f70ac0382d0 2023-11-28T17:39:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b159a640 1 -- 172.21.15.16:0/2740641530 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a40a8b50 con 0x7f70ac0382d0 2023-11-28T17:39:41.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b159a640 1 -- 172.21.15.16:0/2740641530 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40b0440 con 0x7f70ac0382d0 2023-11-28T17:39:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f98837fe640 1 -- 172.21.15.16:0/969342256 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740b6410 con 0x7f9884159540 2023-11-28T17:39:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f98837fe640 1 -- 172.21.15.16:0/969342256 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98740b0030 con 0x7f9884159540 2023-11-28T17:39:41.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f98837fe640 1 -- 172.21.15.16:0/969342256 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98740b6790 con 0x7f9884159540 2023-11-28T17:39:41.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b359e640 1 -- 172.21.15.16:0/2740641530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 msgr2=0x7f70ac053900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b359e640 1 --2- 172.21.15.16:0/2740641530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac053900 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f70ac05a040 tx=0x7f70a401ecf0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f96a3617640 1 Processor -- start 2023-11-28T17:39:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b359e640 1 -- 172.21.15.16:0/2740641530 shutdown_connections 2023-11-28T17:39:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b359e640 1 --2- 172.21.15.16:0/2740641530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac053900 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b359e640 1 --2- 172.21.15.16:0/2740641530 >> v2:172.21.15.16:3300/0 conn(0x7f70ac0e3330 0x7f70ac007650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f70b359e640 1 -- 172.21.15.16:0/2740641530 >> 172.21.15.16:0/2740641530 conn(0x7f70ac0590a0 msgr2=0x7f70ac0594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f96a3617640 1 -- start start 2023-11-28T17:39:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f988add1640 1 -- 172.21.15.16:0/969342256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9884159540 msgr2=0x7f988415d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f988add1640 1 --2- 172.21.15.16:0/969342256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9884159540 0x7f988415d8a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f98840cfa00 tx=0x7f9874024e90 comp rx=0 tx=0).stop 2023-11-28T17:39:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f988add1640 1 -- 172.21.15.16:0/969342256 shutdown_connections 2023-11-28T17:39:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f988add1640 1 --2- 172.21.15.16:0/969342256 >> v2:172.21.15.16:3300/0 conn(0x7f9884072010 0x7f98840cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f988add1640 1 --2- 172.21.15.16:0/969342256 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9884159540 0x7f988415d8a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.253 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f988add1640 1 -- 172.21.15.16:0/969342256 >> 172.21.15.16:0/969342256 conn(0x7f988406a5a0 msgr2=0x7f988406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f835ee32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 0x7f8358165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f835ee32640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8358146110 0x7f83580708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f835ee32640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8358070e00 con 0x7f8358070460 2023-11-28T17:39:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f835ee32640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83581662d0 con 0x7f8358146110 2023-11-28T17:39:41.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7f835ee32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835806c6d0 con 0x7f8358161710 2023-11-28T17:39:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.243+0000 7fb4152c6640 1 --2- 172.21.15.16:0/1304003176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41015c8d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00ba50 tx=0x7fb40c01e820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab718fc82b69a4dc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb407fff640 1 -- 172.21.15.16:0/1304003176 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408001a00 con 0x7fb4100ae8a0 2023-11-28T17:39:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb407fff640 1 -- 172.21.15.16:0/1304003176 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c0ab070 con 0x7fb4100ae8a0 2023-11-28T17:39:41.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb407fff640 1 -- 172.21.15.16:0/1304003176 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c0a7810 con 0x7fb4100ae8a0 2023-11-28T17:39:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 0x7f8358165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 0x7f8358165d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60028/0 (socket says 172.21.15.16:60028) 2023-11-28T17:39:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 -- 172.21.15.16:0/249907852 learned_addr learned my addr 172.21.15.16:0/249907852 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f988add1640 1 -- 172.21.15.16:0/969342256 shutdown_connections 2023-11-28T17:39:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f988add1640 1 -- 172.21.15.16:0/969342256 wait complete. 2023-11-28T17:39:41.257 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f70b359e640 1 -- 172.21.15.16:0/2740641530 shutdown_connections 2023-11-28T17:39:41.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835d3cf640 1 --2- 172.21.15.16:0/249907852 >> v2:172.21.15.16:3300/0 conn(0x7f8358146110 0x7f83580708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 -- 172.21.15.16:0/249907852 >> v2:172.21.15.16:3300/0 conn(0x7f8358146110 msgr2=0x7f83580708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 --2- 172.21.15.16:0/249907852 >> v2:172.21.15.16:3300/0 conn(0x7f8358146110 0x7f83580708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 -- 172.21.15.16:0/249907852 >> v1:172.21.15.64:6789/0 conn(0x7f8358070460 legacy=0x7f8358146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835cbce640 1 -- 172.21.15.16:0/249907852 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835806c9b0 con 0x7f8358161710 2023-11-28T17:39:41.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb41752a640 1 -- 172.21.15.16:0/1304003176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 msgr2=0x7fb41015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb41752a640 1 --2- 172.21.15.16:0/1304003176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41015c8d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00ba50 tx=0x7fb40c01e820 comp rx=0 tx=0).stop 2023-11-28T17:39:41.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f835d3cf640 1 --2- 172.21.15.16:0/249907852 >> v2:172.21.15.16:3300/0 conn(0x7f8358146110 0x7f83580708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a3617640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f969c161710 0x7f969c165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a3617640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c1662d0 con 0x7f969c146110 2023-11-28T17:39:41.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a3617640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f969c06c6d0 con 0x7f969c070460 2023-11-28T17:39:41.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a3617640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f969c06c9b0 con 0x7f969c161710 2023-11-28T17:39:41.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a1bb4640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f969c146110 0x7f969c147650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50368/0 (socket says 172.21.15.16:50368) 2023-11-28T17:39:41.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a1bb4640 1 -- 172.21.15.16:0/4030495530 learned_addr learned my addr 172.21.15.16:0/4030495530 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f7fb5780640 1 Processor -- start 2023-11-28T17:39:41.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a13b3640 1 --2- 172.21.15.16:0/4030495530 >> v2:172.21.15.64:3300/0 conn(0x7f969c161710 0x7f969c165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435967558 0 0) 0x7f969c06c6d0 con 0x7f969c070460 2023-11-28T17:39:41.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9688003530 con 0x7f969c070460 2023-11-28T17:39:41.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187752905 0 0) 0x7f969c1662d0 con 0x7f969c146110 2023-11-28T17:39:41.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f969c06c6d0 con 0x7f969c146110 2023-11-28T17:39:41.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f7fb5780640 1 -- start start 2023-11-28T17:39:41.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a13b3640 1 -- 172.21.15.16:0/4030495530 >> v1:172.21.15.64:6789/0 conn(0x7f969c070460 legacy=0x7f969c146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a13b3640 1 -- 172.21.15.16:0/4030495530 >> v1:172.21.15.16:6789/0 conn(0x7f969c146110 legacy=0x7f969c147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f96a13b3640 1 -- 172.21.15.16:0/4030495530 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c06cc90 con 0x7f969c161710 2023-11-28T17:39:41.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f988add1640 1 Processor -- start 2023-11-28T17:39:41.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb41752a640 1 -- 172.21.15.16:0/1304003176 shutdown_connections 2023-11-28T17:39:41.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb41752a640 1 --2- 172.21.15.16:0/1304003176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41015c8d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7fb41752a640 1 -- 172.21.15.16:0/1304003176 >> 172.21.15.16:0/1304003176 conn(0x7fb4100cefa0 msgr2=0x7fb4100cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7fb5780640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7fb015d880 0x7f7fb00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7fb5780640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7fb00cf850 0x7f7fb00d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7fb5780640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb00ce7b0 con 0x7f7fb015d4a0 2023-11-28T17:39:41.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7fb5780640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00cea90 con 0x7f7fb015d880 2023-11-28T17:39:41.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7fb5780640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00ced70 con 0x7f7fb00cf850 2023-11-28T17:39:41.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.247+0000 7f70b359e640 1 -- 172.21.15.16:0/2740641530 wait complete. 2023-11-28T17:39:41.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faeffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f7fb015d4a0 0x7f7fb00cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56608/0 (socket says 172.21.15.16:56608) 2023-11-28T17:39:41.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faeffd640 1 -- 172.21.15.16:0/1243379261 learned_addr learned my addr 172.21.15.16:0/1243379261 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faf7fe640 1 --2- 172.21.15.16:0/1243379261 >> v2:172.21.15.64:3300/0 conn(0x7f7fb00cf850 0x7f7fb00d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faf7fe640 1 -- 172.21.15.16:0/1243379261 >> v2:172.21.15.16:3300/0 conn(0x7f7fb015d880 msgr2=0x7f7fb00d1f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T17:39:41.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faf7fe640 1 --2- 172.21.15.16:0/1243379261 >> v2:172.21.15.16:3300/0 conn(0x7f7fb015d880 0x7f7fb00d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faf7fe640 1 -- 172.21.15.16:0/1243379261 >> v1:172.21.15.64:6789/0 conn(0x7f7fb015d4a0 legacy=0x7f7fb00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7faf7fe640 1 -- 172.21.15.16:0/1243379261 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00cf050 con 0x7f7fb00cf850 2023-11-28T17:39:41.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f7fadffb640 1 -- 172.21.15.16:0/1243379261 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054502640 0 0) 0x7f7fb00ce7b0 con 0x7f7fb015d4a0 2023-11-28T17:39:41.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7fb41752a640 1 -- 172.21.15.16:0/1304003176 shutdown_connections 2023-11-28T17:39:41.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7fb41752a640 1 -- 172.21.15.16:0/1304003176 wait complete. 2023-11-28T17:39:41.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 -- start start 2023-11-28T17:39:41.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f70b359e640 1 Processor -- start 2023-11-28T17:39:41.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f835cbce640 1 --2- 172.21.15.16:0/249907852 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 0x7f8358165d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8354009870 tx=0x7f835401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68ea9c4b61cd8430 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f70b359e640 1 -- start start 2023-11-28T17:39:41.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f834f7fe640 1 -- 172.21.15.16:0/249907852 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540aa5f0 con 0x7f8358161710 2023-11-28T17:39:41.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f834f7fe640 1 -- 172.21.15.16:0/249907852 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83540aa750 con 0x7f8358161710 2023-11-28T17:39:41.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f834f7fe640 1 -- 172.21.15.16:0/249907852 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540aaae0 con 0x7f8358161710 2023-11-28T17:39:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9884072010 0x7f988413d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98840b1ec0 0x7f98841416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7fb41752a640 1 Processor -- start 2023-11-28T17:39:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9884159540 0x7f98841431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840b0460 con 0x7f9884072010 2023-11-28T17:39:41.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a13b3640 1 --2- 172.21.15.16:0/4030495530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c165d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96980097c0 tx=0x7f969801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=839f5516149b2cea server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9884142a40 con 0x7f98840b1ec0 2023-11-28T17:39:41.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7f988add1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98841421a0 con 0x7f9884159540 2023-11-28T17:39:41.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9884159540 0x7f98841431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9884159540 0x7f98841431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60032/0 (socket says 172.21.15.16:60032) 2023-11-28T17:39:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 -- 172.21.15.16:0/2900137665 learned_addr learned my addr 172.21.15.16:0/2900137665 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f9883fff640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98840b1ec0 0x7f98841416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 -- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98840b1ec0 msgr2=0x7f98841416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98840b1ec0 0x7f98841416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 -- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9884072010 msgr2=0x7f988413d230 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T17:39:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.251+0000 7fb41752a640 1 -- start start 2023-11-28T17:39:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980ab650 con 0x7f969c161710 2023-11-28T17:39:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96980ab7b0 con 0x7f969c161710 2023-11-28T17:39:41.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f9693fff640 1 -- 172.21.15.16:0/4030495530 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96980abb40 con 0x7f969c161710 2023-11-28T17:39:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b359e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f70ac037d80 0x7f70ac04f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb41752a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb4100712f0 0x7fb410148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f9888b6d640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9884072010 0x7f988413d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac0db400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9884072010 0x7f988413d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 -- 172.21.15.16:0/2900137665 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987400a570 con 0x7f9884159540 2023-11-28T17:39:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f9888b6d640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9884072010 0x7f988413d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988936e640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9884159540 0x7f98841431a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f987c00c780 tx=0x7f987c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb41752a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41014c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb41752a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4100cfac0 0x7fb4101f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb41752a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41014a850 con 0x7fb4100cfac0 2023-11-28T17:39:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb41752a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4101493b0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb41752a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb410149bd0 con 0x7fb4100712f0 2023-11-28T17:39:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb4152c6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb4100712f0 0x7fb410148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb4152c6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb4100712f0 0x7fb410148e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60054/0 (socket says 172.21.15.16:60054) 2023-11-28T17:39:41.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb4152c6640 1 -- 172.21.15.16:0/2982368176 learned_addr learned my addr 172.21.15.16:0/2982368176 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb414ac5640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41014c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70ac0e3330 0x7f70ac03cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f70ac037d80 0x7f70ac04f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b89c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70ac0e3330 0x7f70ac03cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b89c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70ac0e3330 0x7f70ac03cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48526/0 (socket says 172.21.15.16:48526) 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac0db400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f70ac037d80 0x7f70ac04f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60044/0 (socket says 172.21.15.16:60044) 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac0db400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54234/0 (socket says 172.21.15.16:54234) 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b89c4640 1 -- 172.21.15.16:0/2471506493 learned_addr learned my addr 172.21.15.16:0/2471506493 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac04fcf0 con 0x7f70ac0e3330 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0dc8a0 con 0x7f70ac0382d0 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70ac0dcb80 con 0x7f70ac037d80 2023-11-28T17:39:41.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f70ac037d80 msgr2=0x7f70ac04f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b1d9b640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f70ac037d80 0x7f70ac04f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70ac0e3330 msgr2=0x7f70ac03cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b1d9b640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f70ac0e3330 0x7f70ac03cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b1d9b640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40094d0 con 0x7f70ac0382d0 2023-11-28T17:39:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 -- 172.21.15.16:0/4030495530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 msgr2=0x7f969c165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 --2- 172.21.15.16:0/4030495530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c165d90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f96980097c0 tx=0x7f969801c450 comp rx=0 tx=0).stop 2023-11-28T17:39:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 -- 172.21.15.16:0/4030495530 shutdown_connections 2023-11-28T17:39:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 --2- 172.21.15.16:0/4030495530 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c165d90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 -- 172.21.15.16:0/4030495530 >> 172.21.15.16:0/4030495530 conn(0x7f969c06a5a0 msgr2=0x7f969c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.285 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 -- 172.21.15.16:0/4030495530 shutdown_connections 2023-11-28T17:39:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c003d90 con 0x7f9884159540 2023-11-28T17:39:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c00ce90 con 0x7f9884159540 2023-11-28T17:39:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988add1640 1 -- 172.21.15.16:0/2900137665 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9884142480 con 0x7f9884159540 2023-11-28T17:39:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f988add1640 1 -- 172.21.15.16:0/2900137665 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988414c9c0 con 0x7f9884159540 2023-11-28T17:39:41.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0052b0 con 0x7f9884159540 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb415ac7640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4100cfac0 0x7fb4101f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb414ac5640 1 -- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb4100712f0 msgr2=0x7fb410148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb414ac5640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb4100712f0 0x7fb410148e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb414ac5640 1 -- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4100cfac0 msgr2=0x7fb4101f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb414ac5640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4100cfac0 0x7fb4101f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb414ac5640 1 -- 172.21.15.16:0/2982368176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c00b6b0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7fb415ac7640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb4100cfac0 0x7fb4101f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb414ac5640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41014c450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c310 tx=0x7fb40000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f7faf7fe640 1 --2- 172.21.15.16:0/1243379261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb00d3070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00cd990 tx=0x7f7fa801d390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a925adb1acc8c480 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f7fadffb640 1 -- 172.21.15.16:0/1243379261 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80a5900 con 0x7f7fb00cf850 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f7fadffb640 1 -- 172.21.15.16:0/1243379261 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa80a5a60 con 0x7f7fb00cf850 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f7fadffb640 1 -- 172.21.15.16:0/1243379261 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa80a5df0 con 0x7f7fb00cf850 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f7fb5780640 1 -- 172.21.15.16:0/1243379261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 msgr2=0x7f7fb00d3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f7fb5780640 1 --2- 172.21.15.16:0/1243379261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb00d3070 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00cd990 tx=0x7f7fa801d390 comp rx=0 tx=0).stop 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f7fb5780640 1 -- 172.21.15.16:0/1243379261 shutdown_connections 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f7fb5780640 1 --2- 172.21.15.16:0/1243379261 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb00d3070 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f7fb5780640 1 --2- 172.21.15.16:0/1243379261 >> v2:172.21.15.16:3300/0 conn(0x7f7fb015d880 0x7f7fb00d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f7fb5780640 1 -- 172.21.15.16:0/1243379261 >> 172.21.15.16:0/1243379261 conn(0x7f7fb008cd70 msgr2=0x7f7fb009c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f835ee32640 1 -- 172.21.15.16:0/249907852 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 msgr2=0x7f8358165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f835ee32640 1 --2- 172.21.15.16:0/249907852 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 0x7f8358165d90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8354009870 tx=0x7f835401c4d0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f835ee32640 1 -- 172.21.15.16:0/249907852 shutdown_connections 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f835ee32640 1 --2- 172.21.15.16:0/249907852 >> v2:172.21.15.16:3300/0 conn(0x7f8358146110 0x7f83580708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f835ee32640 1 --2- 172.21.15.16:0/249907852 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358161710 0x7f8358165d90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f835ee32640 1 -- 172.21.15.16:0/249907852 >> 172.21.15.16:0/249907852 conn(0x7f835806a5a0 msgr2=0x7f835806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f835ee32640 1 -- 172.21.15.16:0/249907852 shutdown_connections 2023-11-28T17:39:41.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f835ee32640 1 -- 172.21.15.16:0/249907852 wait complete. 2023-11-28T17:39:41.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.255+0000 7f96a3617640 1 -- 172.21.15.16:0/4030495530 wait complete. 2023-11-28T17:39:41.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b1d9b640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac0db400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70a40af000 tx=0x7f70a401ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400005cf0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f96a3617640 1 Processor -- start 2023-11-28T17:39:41.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f786f7b8640 1 Processor -- start 2023-11-28T17:39:41.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb400005e50 con 0x7fb4100ae8a0 2023-11-28T17:39:41.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4000072d0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40ba600 con 0x7f70ac0382d0 2023-11-28T17:39:41.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a40ba7a0 con 0x7f70ac0382d0 2023-11-28T17:39:41.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a40bab50 con 0x7f70ac0382d0 2023-11-28T17:39:41.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb410149eb0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70ac0dce60 con 0x7f70ac0382d0 2023-11-28T17:39:41.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f7fb5780640 1 -- 172.21.15.16:0/1243379261 shutdown_connections 2023-11-28T17:39:41.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70ac0dd420 con 0x7f70ac0382d0 2023-11-28T17:39:41.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f987c005410 con 0x7f9884159540 2023-11-28T17:39:41.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f985c000fd0 con 0x7f9884159540 2023-11-28T17:39:41.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f7fb5780640 1 -- 172.21.15.16:0/1243379261 wait complete. 2023-11-28T17:39:41.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f786f7b8640 1 -- start start 2023-11-28T17:39:41.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f615525a640 1 Processor -- start 2023-11-28T17:39:41.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f615525a640 1 -- start start 2023-11-28T17:39:41.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f98817fa640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f98700669a0 0x7f9870068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f987c083bd0 con 0x7f9884159540 2023-11-28T17:39:41.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f96a3617640 1 -- start start 2023-11-28T17:39:41.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f96a3617640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c070460 0x7f969c16cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f96a3617640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f969c146110 0x7f969c138270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f96a3617640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f96a3617640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c15a7f0 con 0x7f969c070460 2023-11-28T17:39:41.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a3617640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1371d0 con 0x7f969c161710 2023-11-28T17:39:41.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a3617640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f969c138ca0 con 0x7f969c146110 2023-11-28T17:39:41.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f9888b6d640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f98700669a0 0x7f9870068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70ac054630 con 0x7f70ac0382d0 2023-11-28T17:39:41.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f98817fa640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f987006ebc0 0x7f9870070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41014a470 con 0x7fb4100ae8a0 2023-11-28T17:39:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.259+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4100cdfe0 con 0x7fb4100ae8a0 2023-11-28T17:39:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54244/0 (socket says 172.21.15.16:54244) 2023-11-28T17:39:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 -- 172.21.15.16:0/991291469 learned_addr learned my addr 172.21.15.16:0/991291469 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786f7b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7868072090 0x7f78680cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786f7b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f786815b350 0x7f78680cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786f7b8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f786815a8b0 con 0x7f78681548e0 2023-11-28T17:39:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786f7b8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78680ce860 con 0x7f786815b350 2023-11-28T17:39:41.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786f7b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786815a6a0 con 0x7f7868072090 2023-11-28T17:39:41.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 --> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9870071690 con 0x7f987006ebc0 2023-11-28T17:39:41.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f987c088240 con 0x7f9884159540 2023-11-28T17:39:41.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786d554640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f78681548e0 0x7f78680ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56614/0 (socket says 172.21.15.16:56614) 2023-11-28T17:39:41.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786d554640 1 -- 172.21.15.16:0/3624267835 learned_addr learned my addr 172.21.15.16:0/3624267835 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f9883fff640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f987006ebc0 0x7f9870070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f786dd55640 1 --2- 172.21.15.16:0/3624267835 >> v2:172.21.15.16:3300/0 conn(0x7f786815b350 0x7f78680cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f835ee32640 1 Processor -- start 2023-11-28T17:39:41.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f70a40bacb0 con 0x7f70ac0382d0 2023-11-28T17:39:41.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a0bb2640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f969c146110 0x7f969c138270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f615525a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f615525a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f615015d880 0x7f61500cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f615525a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61500ce7b0 con 0x7f61500cf850 2023-11-28T17:39:41.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f835ee32640 1 -- start start 2023-11-28T17:39:41.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f9888b6d640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f98700669a0 0x7f9870068e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98740b8000 tx=0x7f9874008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f9883fff640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f987006ebc0 0x7f9870070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f615525a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61500cea90 con 0x7f615015d880 2023-11-28T17:39:41.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f615525a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61500ced70 con 0x7f615015d4a0 2023-11-28T17:39:41.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60076/0 (socket says 172.21.15.16:60076) 2023-11-28T17:39:41.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 -- 172.21.15.16:0/1221556791 learned_addr learned my addr 172.21.15.16:0/1221556791 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 -- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f969c146110 msgr2=0x7f969c138270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f969c146110 0x7f969c138270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 -- 172.21.15.16:0/991291469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c070460 msgr2=0x7f969c16cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f969c070460 0x7f969c16cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f96a1bb4640 1 -- 172.21.15.16:0/991291469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9698009420 con 0x7f969c161710 2023-11-28T17:39:41.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f785ffff640 1 -- 172.21.15.16:0/3624267835 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995333273 0 0) 0x7f786815a8b0 con 0x7f78681548e0 2023-11-28T17:39:41.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f785ffff640 1 -- 172.21.15.16:0/3624267835 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7854003530 con 0x7f78681548e0 2023-11-28T17:39:41.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 -- 172.21.15.16:0/1221556791 >> v2:172.21.15.16:3300/0 conn(0x7f615015d880 msgr2=0x7f61500cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 --2- 172.21.15.16:0/1221556791 >> v2:172.21.15.16:3300/0 conn(0x7f615015d880 0x7f61500cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 -- 172.21.15.16:0/1221556791 >> v1:172.21.15.16:6789/0 conn(0x7f61500cf850 legacy=0x7f61500d3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70aaffd640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7094066920 0x7f7094068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70a4122860 con 0x7f70ac0382d0 2023-11-28T17:39:41.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f7fb5780640 1 Processor -- start 2023-11-28T17:39:41.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70aaffd640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7f709406eb40 0x7f7094070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7094071610 con 0x7f709406eb40 2023-11-28T17:39:41.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70a4124e40 con 0x7f70ac0382d0 2023-11-28T17:39:41.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f70b259c640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7094066920 0x7f7094068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f614ed9d640 1 -- 172.21.15.16:0/1221556791 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61500cf050 con 0x7f615015d4a0 2023-11-28T17:39:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== osd.0 v2:172.21.15.16:6804/4085033533 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9870071690 con 0x7f987006ebc0 2023-11-28T17:39:41.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f70b89c4640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7f709406eb40 0x7f7094070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb400007430 con 0x7fb4100ae8a0 2023-11-28T17:39:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835ee32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358070460 0x7f835815ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835ee32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8358146110 0x7f835815f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835ee32640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8358161710 0x7f835815f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835ee32640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835815f170 con 0x7f8358146110 2023-11-28T17:39:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835ee32640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83580b3bb0 con 0x7f8358161710 2023-11-28T17:39:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835ee32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83580b3030 con 0x7f8358070460 2023-11-28T17:39:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358070460 0x7f835815ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358070460 0x7f835815ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60082/0 (socket says 172.21.15.16:60082) 2023-11-28T17:39:41.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 -- 172.21.15.16:0/826527836 learned_addr learned my addr 172.21.15.16:0/826527836 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f70b89c4640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7f709406eb40 0x7f7094070f60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.263+0000 7f7fb5780640 1 -- start start 2023-11-28T17:39:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fb5780640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb0202200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fb5780640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fb015d4a0 0x7f7fb015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f96a1bb4640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c149dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f969400cb70 tx=0x7f969400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835d3cf640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8358161710 0x7f835815f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 -- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8358161710 msgr2=0x7f835815f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8358161710 0x7f835815f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 -- 172.21.15.16:0/826527836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8358146110 msgr2=0x7f835815f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8358146110 0x7f835815f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 -- 172.21.15.16:0/826527836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83540094d0 con 0x7f8358070460 2023-11-28T17:39:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7faeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb0202200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7faeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb0202200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54262/0 (socket says 172.21.15.16:54262) 2023-11-28T17:39:41.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f835cbce640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358070460 0x7f835815ec30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83540ac040 tx=0x7f835401ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7fb405ffb640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb3f4066920 0x7fb3f4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f70b259c640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7094066920 0x7f7094068de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f709c006fd0 tx=0x7f709c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400ad40 con 0x7f969c161710 2023-11-28T17:39:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7faeffd640 1 -- 172.21.15.16:0/1159754560 learned_addr learned my addr 172.21.15.16:0/1159754560 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540b3800 con 0x7f8358070460 2023-11-28T17:39:41.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83540b3980 con 0x7f8358070460 2023-11-28T17:39:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fb5780640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7fb015d880 0x7f7fb00c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fae7fc640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fb015d4a0 0x7f7fb015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb015d0c0 con 0x7f7fb015d4a0 2023-11-28T17:39:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb015cc30 con 0x7f7fb00cf850 2023-11-28T17:39:41.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb015c020 con 0x7f7fb015d880 2023-11-28T17:39:41.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9694012400 con 0x7f969c161710 2023-11-28T17:39:41.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400aea0 con 0x7f969c161710 2023-11-28T17:39:41.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb400083640 con 0x7fb4100ae8a0 2023-11-28T17:39:41.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7fb4152c6640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb3f4066920 0x7fb3f4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f786dd55640 1 -- 172.21.15.16:0/3624267835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7868072090 msgr2=0x7f78680cef30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T17:39:41.324 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f786dd55640 1 --2- 172.21.15.16:0/3624267835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7868072090 0x7f78680cef30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f786dd55640 1 -- 172.21.15.16:0/3624267835 >> v1:172.21.15.64:6789/0 conn(0x7f78681548e0 legacy=0x7f78680ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f786dd55640 1 -- 172.21.15.16:0/3624267835 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78680cea50 con 0x7f786815b350 2023-11-28T17:39:41.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7faf7fe640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7fb015d880 0x7f7fb00c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.325 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f7faeffd640 1 -- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7fb015d880 msgr2=0x7f7fb00c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7faeffd640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7fb015d880 0x7f7fb00c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f614ed9d640 1 --2- 172.21.15.16:0/1221556791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500d1f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6140009870 tx=0x7f614001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d59c47a0b807ba server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83540b3d30 con 0x7f8358070460 2023-11-28T17:39:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7faeffd640 1 -- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fb015d4a0 msgr2=0x7f7fb015b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7faeffd640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7fb015d4a0 0x7f7fb015b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83580b3310 con 0x7f8358070460 2023-11-28T17:39:41.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7faeffd640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa8009a70 con 0x7f7fb00cf850 2023-11-28T17:39:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83580b38d0 con 0x7f8358070460 2023-11-28T17:39:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f614dd9b640 1 -- 172.21.15.16:0/1221556791 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400ab640 con 0x7f615015d4a0 2023-11-28T17:39:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f614dd9b640 1 -- 172.21.15.16:0/1221556791 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61400a7070 con 0x7f615015d4a0 2023-11-28T17:39:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f614dd9b640 1 -- 172.21.15.16:0/1221556791 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61400ab9c0 con 0x7f615015d4a0 2023-11-28T17:39:41.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== osd.2 v2:172.21.15.16:6800/1740423870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7094071610 con 0x7f709406eb40 2023-11-28T17:39:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.267+0000 7fb405ffb640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7fb3f406eb40 0x7fb3f4070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 --> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb3f4071610 con 0x7fb3f406eb40 2023-11-28T17:39:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb400083980 con 0x7fb4100ae8a0 2023-11-28T17:39:41.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7faeffd640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb0202200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000c520 tx=0x7f7fa000c9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c136b80 con 0x7f969c161710 2023-11-28T17:39:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786dd55640 1 --2- 172.21.15.16:0/3624267835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f786815b350 0x7f78680cf470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f78640097c0 tx=0x7f786401c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ff9c1700c43e5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 -- 172.21.15.16:0/1221556791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 msgr2=0x7f61500d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 --2- 172.21.15.16:0/1221556791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500d1f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6140009870 tx=0x7f614001c510 comp rx=0 tx=0).stop 2023-11-28T17:39:41.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7fb4152c6640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb3f4066920 0x7fb3f4068de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb40c01c450 tx=0x7fb40c0a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c138f80 con 0x7f969c161710 2023-11-28T17:39:41.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 -- 172.21.15.16:0/1221556791 shutdown_connections 2023-11-28T17:39:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f785ffff640 1 -- 172.21.15.16:0/3624267835 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7858001680 con 0x7f786815b350 2023-11-28T17:39:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f785ffff640 1 -- 172.21.15.16:0/3624267835 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78640a7050 con 0x7f786815b350 2023-11-28T17:39:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f785ffff640 1 -- 172.21.15.16:0/3624267835 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78640ab620 con 0x7f786815b350 2023-11-28T17:39:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 --2- 172.21.15.16:0/1221556791 >> v2:172.21.15.16:3300/0 conn(0x7f615015d880 0x7f61500cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 --2- 172.21.15.16:0/1221556791 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500d1f30 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 -- 172.21.15.16:0/1221556791 >> 172.21.15.16:0/1221556791 conn(0x7f615008cd70 msgr2=0x7f615009c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 -- 172.21.15.16:0/1221556791 shutdown_connections 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7fb415ac7640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7fb3f406eb40 0x7fb3f4070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00074e0 con 0x7f7fb00cf850 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa0007640 con 0x7f7fb00cf850 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00049f0 con 0x7f7fb00cf850 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb015c300 con 0x7f7fb00cf850 2023-11-28T17:39:41.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb015c8c0 con 0x7f7fb00cf850 2023-11-28T17:39:41.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f969c070cd0 con 0x7f969c161710 2023-11-28T17:39:41.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f835814b130 con 0x7f8358070460 2023-11-28T17:39:41.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786f7b8640 1 -- 172.21.15.16:0/3624267835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f786815b350 msgr2=0x7f78680cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786f7b8640 1 --2- 172.21.15.16:0/3624267835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f786815b350 0x7f78680cf470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f78640097c0 tx=0x7f786401c2e0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f615525a640 1 -- 172.21.15.16:0/1221556791 wait complete. 2023-11-28T17:39:41.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786f7b8640 1 -- 172.21.15.16:0/3624267835 shutdown_connections 2023-11-28T17:39:41.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786f7b8640 1 --2- 172.21.15.16:0/3624267835 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f786815b350 0x7f78680cf470 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786f7b8640 1 --2- 172.21.15.16:0/3624267835 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7868072090 0x7f78680cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7f786f7b8640 1 -- 172.21.15.16:0/3624267835 >> 172.21.15.16:0/3624267835 conn(0x7f786806a5a0 msgr2=0x7f786806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.271+0000 7fb415ac7640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7fb3f406eb40 0x7fb3f4070f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f786f7b8640 1 -- 172.21.15.16:0/3624267835 shutdown_connections 2023-11-28T17:39:41.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 Processor -- start 2023-11-28T17:39:41.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== osd.1 v2:172.21.15.16:6805/1338459427 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb3f4071610 con 0x7fb3f406eb40 2023-11-28T17:39:41.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 -- start start 2023-11-28T17:39:41.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7fb0067530 con 0x7f7fb00cf850 2023-11-28T17:39:41.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f786f7b8640 1 -- 172.21.15.16:0/3624267835 wait complete. 2023-11-28T17:39:41.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f786f7b8640 1 Processor -- start 2023-11-28T17:39:41.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f786f7b8640 1 -- start start 2023-11-28T17:39:41.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7fa0004b50 con 0x7f7fb00cf850 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61500cf850 0x7f6150158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f615015d880 0x7f6150156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61500c8030 con 0x7f61500cf850 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61500c8310 con 0x7f615015d880 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f615525a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61500c85f0 con 0x7f615015d4a0 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f614e59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9694007070 con 0x7f969c161710 2023-11-28T17:39:41.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f9691ffb640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f96800669a0 0x7f9680068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f614e59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60100/0 (socket says 172.21.15.16:60100) 2023-11-28T17:39:41.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f614e59c640 1 -- 172.21.15.16:0/2334384827 learned_addr learned my addr 172.21.15.16:0/2334384827 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9694084510 con 0x7f969c161710 2023-11-28T17:39:41.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f96a13b3640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f96800669a0 0x7f9680068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f9691ffb640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7f968006ebc0 0x7f9680070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f614f59e640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f615015d880 0x7f6150156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 --> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9680071690 con 0x7f968006ebc0 2023-11-28T17:39:41.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9694086b30 con 0x7f969c161710 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.275+0000 7f614ed9d640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61500cf850 0x7f6150158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f614e59c640 1 -- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f615015d880 msgr2=0x7f6150156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f614e59c640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f615015d880 0x7f6150156d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f614e59c640 1 -- 172.21.15.16:0/2334384827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61500cf850 msgr2=0x7f6150158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f614e59c640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61500cf850 0x7f6150158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f614e59c640 1 -- 172.21.15.16:0/2334384827 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61400094d0 con 0x7f615015d4a0 2023-11-28T17:39:41.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f614e59c640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500b6c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f614400b410 tx=0x7f614400b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7f977fe640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7f9c0669a0 0x7f7f9c068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa0083a00 con 0x7f7fb00cf850 2023-11-28T17:39:41.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786f7b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7868072090 0x7f78681434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7fae7fc640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7f9c0669a0 0x7f7f9c068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7f977fe640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7f7f9c06ebc0 0x7f7f9c070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786f7b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78681548e0 0x7f7868143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7f9c071690 con 0x7f7f9c06ebc0 2023-11-28T17:39:41.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fa0088260 con 0x7f7fb00cf850 2023-11-28T17:39:41.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786f7b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f786815b350 0x7f786812e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786cd53640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78681548e0 0x7f7868143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f96a0bb2640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7f968006ebc0 0x7f9680070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f96a13b3640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f96800669a0 0x7f9680068e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96980af000 tx=0x7f9698008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786cd53640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78681548e0 0x7f7868143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54280/0 (socket says 172.21.15.16:54280) 2023-11-28T17:39:41.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7faf7fe640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7f7f9c06ebc0 0x7f7f9c070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786dd55640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f786815b350 0x7f786812e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786dd55640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f786815b350 0x7f786812e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60116/0 (socket says 172.21.15.16:60116) 2023-11-28T17:39:41.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786dd55640 1 -- 172.21.15.16:0/4073847930 learned_addr learned my addr 172.21.15.16:0/4073847930 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f96a0bb2640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7f968006ebc0 0x7f9680070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680ccd10 con 0x7f7868072090 2023-11-28T17:39:41.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78680ccff0 con 0x7f78681548e0 2023-11-28T17:39:41.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78680cd2d0 con 0x7f786815b350 2023-11-28T17:39:41.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7fae7fc640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7f9c0669a0 0x7f7f9c068e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b40e0 tx=0x7f7fa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f83540c6390 con 0x7f8358070460 2023-11-28T17:39:41.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144011830 con 0x7f615015d4a0 2023-11-28T17:39:41.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144011990 con 0x7f615015d4a0 2023-11-28T17:39:41.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144011d40 con 0x7f615015d4a0 2023-11-28T17:39:41.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f7faf7fe640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7f7f9c06ebc0 0x7f7f9c070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61500c88d0 con 0x7f615015d4a0 2023-11-28T17:39:41.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6150157b30 con 0x7f615015d4a0 2023-11-28T17:39:41.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f786d554640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7868072090 0x7f78681434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6150067530 con 0x7f615015d4a0 2023-11-28T17:39:41.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.279+0000 7f834d7fa640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f83440669d0 0x7f8344068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83540a7070 con 0x7f8358070460 2023-11-28T17:39:41.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f834ffff640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f83440669d0 0x7f8344068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f834d7fa640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f834406eb70 0x7f8344070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 --> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8344071640 con 0x7f834406eb70 2023-11-28T17:39:41.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== osd.4 v2:172.21.15.64:6808/2542652674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9680071690 con 0x7f968006ebc0 2023-11-28T17:39:41.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786cd53640 1 -- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f786815b350 msgr2=0x7f786812e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786cd53640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f786815b350 0x7f786812e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786cd53640 1 -- 172.21.15.16:0/4073847930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7868072090 msgr2=0x7f78681434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786cd53640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7868072090 0x7f78681434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786cd53640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7864009420 con 0x7f78681548e0 2023-11-28T17:39:41.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83540ec0e0 con 0x7f8358070460 2023-11-28T17:39:41.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== osd.3 v2:172.21.15.16:6824/2069307542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7f9c071690 con 0x7f7f9c06ebc0 2023-11-28T17:39:41.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f835d3cf640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f834406eb70 0x7f8344070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f834ffff640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f83440669d0 0x7f8344068e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83581fd7d0 tx=0x7f83480079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786cd53640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78681548e0 0x7f7868143a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f786000bdf0 tx=0x7f7860009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860014440 con 0x7f78681548e0 2023-11-28T17:39:41.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600145c0 con 0x7f78681548e0 2023-11-28T17:39:41.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7860014970 con 0x7f78681548e0 2023-11-28T17:39:41.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78680cd5b0 con 0x7f78681548e0 2023-11-28T17:39:41.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78680cc930 con 0x7f78681548e0 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6144038490 con 0x7f615015d4a0 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f61377fe640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f613c066920 0x7f613c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6144084700 con 0x7f615015d4a0 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f61377fe640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f613c06eb40 0x7f613c070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 --> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f613c071610 con 0x7f613c06eb40 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.283+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6144084a70 con 0x7f615015d4a0 2023-11-28T17:39:41.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7848000fd0 con 0x7f78681548e0 2023-11-28T17:39:41.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f835d3cf640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f834406eb70 0x7f8344070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f614f59e640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f613c06eb40 0x7f613c070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f614ed9d640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f613c066920 0x7f613c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7860014ad0 con 0x7f78681548e0 2023-11-28T17:39:41.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== osd.5 v2:172.21.15.64:6816/1005985598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8344071640 con 0x7f834406eb70 2023-11-28T17:39:41.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f785dffb640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f784c0668d0 0x7f784c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7860084320 con 0x7f78681548e0 2023-11-28T17:39:41.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f614ed9d640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f613c066920 0x7f613c068de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61400af000 tx=0x7f61400a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f786d554640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f784c0668d0 0x7f784c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f785dffb640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7f784c06ea70 0x7f784c070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f784c071540 con 0x7f784c06ea70 2023-11-28T17:39:41.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78600845e0 con 0x7f78681548e0 2023-11-28T17:39:41.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.287+0000 7f786dd55640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7f784c06ea70 0x7f784c070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.291+0000 7f614f59e640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f613c06eb40 0x7f613c070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.291+0000 7f786dd55640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7f784c06ea70 0x7f784c070e90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.291+0000 7f786d554640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f784c0668d0 0x7f784c068d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7858000f70 tx=0x7f7858001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.291+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== osd.6 v2:172.21.15.64:6824/4135110643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f784c071540 con 0x7f784c06ea70 2023-11-28T17:39:41.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.291+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== osd.7 v2:172.21.15.64:6800/946925986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f613c071610 con 0x7f613c06eb40 2023-11-28T17:39:41.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.295+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 --> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70ac007130 con 0x7f709406eb40 2023-11-28T17:39:41.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70aaffd640 1 -- 172.21.15.16:0/2471506493 <== osd.2 v2:172.21.15.16:6800/1740423870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f70b404e890 con 0x7f709406eb40 2023-11-28T17:39:41.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 --> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f985c002cc0 con 0x7f987006ebc0 2023-11-28T17:39:41.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7f709406eb40 msgr2=0x7f7094070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7f709406eb40 0x7f7094070f60 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f98817fa640 1 -- 172.21.15.16:0/2900137665 <== osd.0 v2:172.21.15.16:6804/4085033533 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f985c002cc0 con 0x7f987006ebc0 2023-11-28T17:39:41.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7094066920 msgr2=0x7f7094068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7094066920 0x7f7094068de0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f709c006fd0 tx=0x7f709c008040 comp rx=0 tx=0).stop 2023-11-28T17:39:41.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 msgr2=0x7f70ac0db400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 --2- 172.21.15.16:0/2471506493 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70ac0382d0 0x7f70ac0db400 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f70a40af000 tx=0x7f70a401ba90 comp rx=0 tx=0).stop 2023-11-28T17:39:41.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b89c4640 1 -- 172.21.15.16:0/2471506493 reap_dead start 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f987006ebc0 msgr2=0x7f9870070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f987006ebc0 0x7f9870070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f98700669a0 msgr2=0x7f9870068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f98700669a0 0x7f9870068e60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98740b8000 tx=0x7f9874008040 comp rx=0 tx=0).stop 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9884159540 msgr2=0x7f98841431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 --2- 172.21.15.16:0/2900137665 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9884159540 0x7f98841431a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f987c00c780 tx=0x7f987c00cc40 comp rx=0 tx=0).stop 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.299+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 shutdown_connections 2023-11-28T17:39:41.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 >> 172.21.15.16:0/2471506493 conn(0x7f70ac0590a0 msgr2=0x7f70ac0e1ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 --> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f969c14b130 con 0x7f968006ebc0 2023-11-28T17:39:41.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f988936e640 1 -- 172.21.15.16:0/2900137665 reap_dead start 2023-11-28T17:39:41.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 shutdown_connections 2023-11-28T17:39:41.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 shutdown_connections 2023-11-28T17:39:41.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 >> 172.21.15.16:0/2900137665 conn(0x7f988406a5a0 msgr2=0x7f988406c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 shutdown_connections 2023-11-28T17:39:41.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f70b359e640 1 -- 172.21.15.16:0/2471506493 wait complete. 2023-11-28T17:39:41.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f986affd640 1 -- 172.21.15.16:0/2900137665 wait complete. 2023-11-28T17:39:41.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.303+0000 7f9691ffb640 1 -- 172.21.15.16:0/991291469 <== osd.4 v2:172.21.15.64:6808/2542652674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f968c001330 con 0x7f968006ebc0 2023-11-28T17:39:41.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7f968006ebc0 msgr2=0x7f9680070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7f968006ebc0 0x7f9680070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f96800669a0 msgr2=0x7f9680068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f96800669a0 0x7f9680068e60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f96980af000 tx=0x7f9698008040 comp rx=0 tx=0).stop 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 msgr2=0x7f969c149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 --2- 172.21.15.16:0/991291469 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f969c161710 0x7f969c149dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f969400cb70 tx=0x7f969400a430 comp rx=0 tx=0).stop 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a1bb4640 1 -- 172.21.15.16:0/991291469 reap_dead start 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 shutdown_connections 2023-11-28T17:39:41.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 >> 172.21.15.16:0/991291469 conn(0x7f969c06a5a0 msgr2=0x7f969c13ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 --> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb4100cf950 con 0x7fb3f406eb40 2023-11-28T17:39:41.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7fb405ffb640 1 -- 172.21.15.16:0/2982368176 <== osd.1 v2:172.21.15.16:6805/1338459427 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb4100cf950 con 0x7fb3f406eb40 2023-11-28T17:39:41.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 shutdown_connections 2023-11-28T17:39:41.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.307+0000 7f96a3617640 1 -- 172.21.15.16:0/991291469 wait complete. 2023-11-28T17:39:41.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7fb5780640 1 -- 172.21.15.16:0/1159754560 --> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7fb015cd70 con 0x7f7f9c06ebc0 2023-11-28T17:39:41.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f977fe640 1 -- 172.21.15.16:0/1159754560 <== osd.3 v2:172.21.15.16:6824/2069307542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7f9c071690 con 0x7f7f9c06ebc0 2023-11-28T17:39:41.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7f7f9c06ebc0 msgr2=0x7f7f9c070fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7f7f9c06ebc0 0x7f7f9c070fe0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7f9c0669a0 msgr2=0x7f7f9c068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7f9c0669a0 0x7f7f9c068e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b40e0 tx=0x7f7fa4008040 comp rx=0 tx=0).stop 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 msgr2=0x7f7fb0202200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 --2- 172.21.15.16:0/1159754560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7fb00cf850 0x7f7fb0202200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7fa000c520 tx=0x7f7fa000c9e0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7faf7fe640 1 -- 172.21.15.16:0/1159754560 reap_dead start 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 shutdown_connections 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.315+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 >> 172.21.15.16:0/1159754560 conn(0x7f7fb008cd70 msgr2=0x7f7fb006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 shutdown_connections 2023-11-28T17:39:41.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 --> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7848002cc0 con 0x7f784c06ea70 2023-11-28T17:39:41.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7fb3f406eb40 msgr2=0x7fb3f4070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7fb3f406eb40 0x7fb3f4070f60 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f7f957fa640 1 -- 172.21.15.16:0/1159754560 wait complete. 2023-11-28T17:39:41.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb3f4066920 msgr2=0x7fb3f4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb3f4066920 0x7fb3f4068de0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb40c01c450 tx=0x7fb40c0a9070 comp rx=0 tx=0).stop 2023-11-28T17:39:41.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 msgr2=0x7fb41014c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 --2- 172.21.15.16:0/2982368176 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4100ae8a0 0x7fb41014c450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c310 tx=0x7fb40000c7d0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb415ac7640 1 -- 172.21.15.16:0/2982368176 reap_dead start 2023-11-28T17:39:41.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f785dffb640 1 -- 172.21.15.16:0/4073847930 <== osd.6 v2:172.21.15.64:6824/4135110643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7848002cc0 con 0x7f784c06ea70 2023-11-28T17:39:41.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 shutdown_connections 2023-11-28T17:39:41.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 >> 172.21.15.16:0/2982368176 conn(0x7fb4100cefa0 msgr2=0x7fb410150620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 shutdown_connections 2023-11-28T17:39:41.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7fb41752a640 1 -- 172.21.15.16:0/2982368176 wait complete. 2023-11-28T17:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7f784c06ea70 msgr2=0x7f784c070e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7f784c06ea70 0x7f784c070e90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f784c0668d0 msgr2=0x7f784c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f784c0668d0 0x7f784c068d90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7858000f70 tx=0x7f7858001a80 comp rx=0 tx=0).stop 2023-11-28T17:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78681548e0 msgr2=0x7f7868143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 --2- 172.21.15.16:0/4073847930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78681548e0 0x7f7868143a20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f786000bdf0 tx=0x7f7860009f70 comp rx=0 tx=0).stop 2023-11-28T17:39:41.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786dd55640 1 -- 172.21.15.16:0/4073847930 reap_dead start 2023-11-28T17:39:41.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 shutdown_connections 2023-11-28T17:39:41.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 >> 172.21.15.16:0/4073847930 conn(0x7f786806a5a0 msgr2=0x7f786806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 --> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8358066c10 con 0x7f834406eb70 2023-11-28T17:39:41.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.319+0000 7f834d7fa640 1 -- 172.21.15.16:0/826527836 <== osd.5 v2:172.21.15.64:6816/1005985598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8358066c10 con 0x7f834406eb70 2023-11-28T17:39:41.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 shutdown_connections 2023-11-28T17:39:41.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f786f7b8640 1 -- 172.21.15.16:0/4073847930 wait complete. 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f834406eb70 msgr2=0x7f8344070f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f834406eb70 0x7f8344070f90 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f83440669d0 msgr2=0x7f8344068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f83440669d0 0x7f8344068e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f83581fd7d0 tx=0x7f83480079c0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358070460 msgr2=0x7f835815ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 --2- 172.21.15.16:0/826527836 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8358070460 0x7f835815ec30 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83540ac040 tx=0x7f835401ad10 comp rx=0 tx=0).stop 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835d3cf640 1 -- 172.21.15.16:0/826527836 reap_dead start 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 shutdown_connections 2023-11-28T17:39:41.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 >> 172.21.15.16:0/826527836 conn(0x7f835806a5a0 msgr2=0x7f8358146c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 --> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f61500c8d80 con 0x7f613c06eb40 2023-11-28T17:39:41.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.323+0000 7f61377fe640 1 -- 172.21.15.16:0/2334384827 <== osd.7 v2:172.21.15.64:6800/946925986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f61500c8d80 con 0x7f613c06eb40 2023-11-28T17:39:41.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 shutdown_connections 2023-11-28T17:39:41.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f835ee32640 1 -- 172.21.15.16:0/826527836 wait complete. 2023-11-28T17:39:41.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f613c06eb40 msgr2=0x7f613c070f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f613c06eb40 0x7f613c070f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f613c066920 msgr2=0x7f613c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f613c066920 0x7f613c068de0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61400af000 tx=0x7f61400a7000 comp rx=0 tx=0).stop 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 msgr2=0x7f61500b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 --2- 172.21.15.16:0/2334384827 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f615015d4a0 0x7f61500b6c30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f614400b410 tx=0x7f614400b8d0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f614f59e640 1 -- 172.21.15.16:0/2334384827 reap_dead start 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 shutdown_connections 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 >> 172.21.15.16:0/2334384827 conn(0x7f615008cd70 msgr2=0x7f61500cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 shutdown_connections 2023-11-28T17:39:41.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.327+0000 7f615525a640 1 -- 172.21.15.16:0/2334384827 wait complete. 2023-11-28T17:39:41.380 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:41.380 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T17:39:41.381 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:41.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T17:39:41.382 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:41.382 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T17:39:41.383 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2023-11-28T17:39:41.383 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T17:39:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:41.384 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T17:39:41.385 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:41.385 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T17:39:41.386 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2023-11-28T17:39:41.386 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T17:39:41.387 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2023-11-28T17:39:41.388 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T17:39:41.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.663+0000 7fb6bec5a640 1 Processor -- start 2023-11-28T17:39:41.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.663+0000 7fb6bec5a640 1 -- start start 2023-11-28T17:39:41.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bec5a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb6b806b0c0 0x7fb6b815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bec5a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b815d410 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bec5a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b806e200 con 0x7fb6b8072010 2023-11-28T17:39:41.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bec5a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b815dde0 con 0x7fb6b806b0c0 2023-11-28T17:39:41.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bd1f7640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb6b80b1ec0 0x7fb6b81640f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50384/0 (socket says 172.21.15.16:50384) 2023-11-28T17:39:41.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bd1f7640 1 -- 172.21.15.16:0/2323636830 learned_addr learned my addr 172.21.15.16:0/2323636830 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bc9f6640 1 --2- 172.21.15.16:0/2323636830 >> v2:172.21.15.64:3300/0 conn(0x7fb6b806b0c0 0x7fb6b815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6b77fe640 1 -- 172.21.15.16:0/2323636830 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112619133 0 0) 0x7fb6b815d410 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6b77fe640 1 -- 172.21.15.16:0/2323636830 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6a0003530 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bc9f6640 1 -- 172.21.15.16:0/2323636830 >> v1:172.21.15.64:6789/0 conn(0x7fb6b8072010 legacy=0x7fb6b80703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bc9f6640 1 -- 172.21.15.16:0/2323636830 >> v1:172.21.15.16:6789/0 conn(0x7fb6b80b1ec0 legacy=0x7fb6b81640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.667+0000 7fb6bc9f6640 1 -- 172.21.15.16:0/2323636830 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b806dc40 con 0x7fb6b806b0c0 2023-11-28T17:39:41.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bc9f6640 1 --2- 172.21.15.16:0/2323636830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b806b0c0 0x7fb6b815d8a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0097c0 tx=0x7fb6ac01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b35d21508112f49 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6b77fe640 1 -- 172.21.15.16:0/2323636830 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0ab600 con 0x7fb6b806b0c0 2023-11-28T17:39:41.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6b77fe640 1 -- 172.21.15.16:0/2323636830 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ac0a7050 con 0x7fb6b806b0c0 2023-11-28T17:39:41.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6b77fe640 1 -- 172.21.15.16:0/2323636830 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ac0ab980 con 0x7fb6b806b0c0 2023-11-28T17:39:41.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 -- 172.21.15.16:0/2323636830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b806b0c0 msgr2=0x7fb6b815d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/2323636830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b806b0c0 0x7fb6b815d8a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0097c0 tx=0x7fb6ac01c330 comp rx=0 tx=0).stop 2023-11-28T17:39:41.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 -- 172.21.15.16:0/2323636830 shutdown_connections 2023-11-28T17:39:41.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/2323636830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b806b0c0 0x7fb6b815d8a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 -- 172.21.15.16:0/2323636830 >> 172.21.15.16:0/2323636830 conn(0x7fb6b806a5a0 msgr2=0x7fb6b806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 -- 172.21.15.16:0/2323636830 shutdown_connections 2023-11-28T17:39:41.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.675+0000 7fb6bec5a640 1 -- 172.21.15.16:0/2323636830 wait complete. 2023-11-28T17:39:41.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7fb6bec5a640 1 Processor -- start 2023-11-28T17:39:41.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7fb6bec5a640 1 -- start start 2023-11-28T17:39:41.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7f031b409640 1 Processor -- start 2023-11-28T17:39:41.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7f031b409640 1 -- start start 2023-11-28T17:39:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7fb6bec5a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6b806b0c0 0x7fb6b814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7fb6bec5a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6b8072010 0x7fb6b80b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.679+0000 7fb6bec5a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 0x7fb6b814b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bec5a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b81491e0 con 0x7fb6b8072010 2023-11-28T17:39:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bec5a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b8143ef0 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bec5a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b814a750 con 0x7fb6b806b0c0 2023-11-28T17:39:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 0x7fb6b814b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 0x7fb6b814b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54296/0 (socket says 172.21.15.16:54296) 2023-11-28T17:39:41.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 -- 172.21.15.16:0/1088152515 learned_addr learned my addr 172.21.15.16:0/1088152515 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f031b409640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140b1750 0x7f03140713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f031b409640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03140ccaa0 con 0x7f03141590f0 2023-11-28T17:39:41.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f031b409640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f031406cd40 con 0x7f03140ce310 2023-11-28T17:39:41.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f031b409640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03140cec60 con 0x7f03140b1750 2023-11-28T17:39:41.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f031a407640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f03141590f0 0x7f031406c630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50400/0 (socket says 172.21.15.16:50400) 2023-11-28T17:39:41.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f031a407640 1 -- 172.21.15.16:0/3268152279 learned_addr learned my addr 172.21.15.16:0/3268152279 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bc9f6640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6b806b0c0 0x7fb6b814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6b7fff640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6b8072010 0x7fb6b80b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 -- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6b806b0c0 msgr2=0x7fb6b814a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6b806b0c0 0x7fb6b814a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 -- 172.21.15.16:0/1088152515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6b8072010 msgr2=0x7fb6b80b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319c06640 1 --2- 172.21.15.16:0/3268152279 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140b1750 0x7f03140713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6b8072010 0x7fb6b80b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 -- 172.21.15.16:0/1088152515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac009420 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6b7fff640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6b8072010 0x7fb6b80b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bd1f7640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 0x7fb6b814b110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000cb40 tx=0x7fb6b000a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124465281 0 0) 0x7f03140ccaa0 con 0x7f03141590f0 2023-11-28T17:39:41.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0300003530 con 0x7f03141590f0 2023-11-28T17:39:41.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934475858 0 0) 0x7f031406cd40 con 0x7f03140ce310 2023-11-28T17:39:41.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03140ccaa0 con 0x7f03140ce310 2023-11-28T17:39:41.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b000aca0 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b8149450 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6b000ae00 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.687+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b8149a10 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.687+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6b0012620 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319c06640 1 -- 172.21.15.16:0/3268152279 >> v1:172.21.15.64:6789/0 conn(0x7f03140ce310 legacy=0x7f03140cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319c06640 1 -- 172.21.15.16:0/3268152279 >> v1:172.21.15.16:6789/0 conn(0x7f03141590f0 legacy=0x7f031406c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.683+0000 7f0319c06640 1 -- 172.21.15.16:0/3268152279 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03140b2ac0 con 0x7f03140b1750 2023-11-28T17:39:41.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.687+0000 7fe4858c9640 1 Processor -- start 2023-11-28T17:39:41.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.687+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6b0007070 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fd324e09640 1 Processor -- start 2023-11-28T17:39:41.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.687+0000 7fe4858c9640 1 -- start start 2023-11-28T17:39:41.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb698005260 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fd324e09640 1 -- start start 2023-11-28T17:39:41.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7f0319c06640 1 --2- 172.21.15.16:0/3268152279 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140b1750 0x7f03140713e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03100097f0 tx=0x7f031001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e2f7a00e55ceb2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fabaa6bb640 1 Processor -- start 2023-11-28T17:39:41.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fb6b57fa640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb6a40669a0 0x7fb6a4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fabaa6bb640 1 -- start start 2023-11-28T17:39:41.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6b0084510 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fb6bc9f6640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb6a40669a0 0x7fb6a4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100ad660 con 0x7f03140b1750 2023-11-28T17:39:41.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe4858c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480161710 0x7fe480165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe4858c9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe480070460 0x7fe4800708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe4858c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe480070e00 con 0x7fe480146f40 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe4858c9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4801662d0 con 0x7fe480070460 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe4858c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48006c6d0 con 0x7fe480161710 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47f7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe480146f40 0x7fe4801473b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50414/0 (socket says 172.21.15.16:50414) 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03100ad7c0 con 0x7f03140b1750 2023-11-28T17:39:41.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7f0319405640 1 -- 172.21.15.16:0/3268152279 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100adb90 con 0x7f03140b1750 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47effd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480161710 0x7fe480165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47f7fe640 1 -- 172.21.15.16:0/1314269880 learned_addr learned my addr 172.21.15.16:0/1314269880 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47e7fc640 1 --2- 172.21.15.16:0/1314269880 >> v2:172.21.15.16:3300/0 conn(0x7fe480070460 0x7fe4800708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47effd640 1 -- 172.21.15.16:0/1314269880 >> v2:172.21.15.16:3300/0 conn(0x7fe480070460 msgr2=0x7fe4800708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47effd640 1 --2- 172.21.15.16:0/1314269880 >> v2:172.21.15.16:3300/0 conn(0x7fe480070460 0x7fe4800708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47effd640 1 -- 172.21.15.16:0/1314269880 >> v1:172.21.15.16:6789/0 conn(0x7fe480146f40 legacy=0x7fe4801473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.691+0000 7fe47effd640 1 -- 172.21.15.16:0/1314269880 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48006c9b0 con 0x7fe480161710 2023-11-28T17:39:41.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 -- 172.21.15.16:0/3268152279 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140b1750 msgr2=0x7f03140713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 --2- 172.21.15.16:0/3268152279 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140b1750 0x7f03140713e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f03100097f0 tx=0x7f031001c470 comp rx=0 tx=0).stop 2023-11-28T17:39:41.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fb6bc9f6640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb6a40669a0 0x7fb6a4068e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0ad000 tx=0x7fb6ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 -- 172.21.15.16:0/3268152279 shutdown_connections 2023-11-28T17:39:41.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 --2- 172.21.15.16:0/3268152279 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140b1750 0x7f03140713e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 -- 172.21.15.16:0/3268152279 >> 172.21.15.16:0/3268152279 conn(0x7f03140b0c30 msgr2=0x7f03140b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd324e09640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd3200712f0 0x7fd320164150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd324e09640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200cee10 con 0x7fd32015c8d0 2023-11-28T17:39:41.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd324e09640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3200cebd0 con 0x7fd3200ae8a0 2023-11-28T17:39:41.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd324e09640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3200b2ae0 con 0x7fd3200712f0 2023-11-28T17:39:41.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 -- 172.21.15.16:0/3268152279 shutdown_connections 2023-11-28T17:39:41.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 -- 172.21.15.16:0/3268152279 wait complete. 2023-11-28T17:39:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fabaa6bb640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faba41590f0 0x7faba406c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fabaa6bb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faba40ce310 0x7faba40713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f07aab10640 1 Processor -- start 2023-11-28T17:39:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7faba8eb8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faba40ce310 0x7faba40713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7faba8eb8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faba40ce310 0x7faba40713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54322/0 (socket says 172.21.15.16:54322) 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7faba96b9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faba41590f0 0x7faba406c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7faba96b9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faba41590f0 0x7faba406c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48628/0 (socket says 172.21.15.16:48628) 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7faba9eba640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7faba41594d0 0x7faba40cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50442/0 (socket says 172.21.15.16:50442) 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7faba8eb8640 1 -- 172.21.15.16:0/893009158 learned_addr learned my addr 172.21.15.16:0/893009158 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba40ccaa0 con 0x7faba41594d0 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40cec60 con 0x7faba41590f0 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba40b2ac0 con 0x7faba40ce310 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd31ed9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd3200712f0 0x7fd320164150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd31ed9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd3200712f0 0x7fd320164150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54308/0 (socket says 172.21.15.16:54308) 2023-11-28T17:39:41.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd31ed9d640 1 -- 172.21.15.16:0/3773883803 learned_addr learned my addr 172.21.15.16:0/3773883803 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f07aab10640 1 -- start start 2023-11-28T17:39:41.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd31ed9d640 1 -- 172.21.15.16:0/3773883803 >> v1:172.21.15.64:6789/0 conn(0x7fd3200ae8a0 legacy=0x7fd320070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd31ed9d640 1 -- 172.21.15.16:0/3773883803 >> v1:172.21.15.16:6789/0 conn(0x7fd32015c8d0 legacy=0x7fd3200ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7fd31ed9d640 1 -- 172.21.15.16:0/3773883803 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3200b21b0 con 0x7fd3200712f0 2023-11-28T17:39:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.695+0000 7f031b409640 1 Processor -- start 2023-11-28T17:39:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 -- start start 2023-11-28T17:39:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe47effd640 1 --2- 172.21.15.16:0/1314269880 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480161710 0x7fe480165d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4740097c0 tx=0x7fe47401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ca8598ece7f6591 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe47dffb640 1 -- 172.21.15.16:0/1314269880 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740ab650 con 0x7fe480161710 2023-11-28T17:39:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe47dffb640 1 -- 172.21.15.16:0/1314269880 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4740ab7b0 con 0x7fe480161710 2023-11-28T17:39:41.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe47dffb640 1 -- 172.21.15.16:0/1314269880 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740ab650 con 0x7fe480161710 2023-11-28T17:39:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb6b0051730 con 0x7fb6b80b1ec0 2023-11-28T17:39:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7faba96b9640 1 -- 172.21.15.16:0/893009158 >> v2:172.21.15.64:3300/0 conn(0x7faba40ce310 msgr2=0x7faba40713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7faba96b9640 1 --2- 172.21.15.16:0/893009158 >> v2:172.21.15.64:3300/0 conn(0x7faba40ce310 0x7faba40713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7faba96b9640 1 -- 172.21.15.16:0/893009158 >> v1:172.21.15.16:6789/0 conn(0x7faba41594d0 legacy=0x7faba40cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7faba96b9640 1 -- 172.21.15.16:0/893009158 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba40b2da0 con 0x7faba41590f0 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 -- 172.21.15.16:0/1314269880 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480161710 msgr2=0x7fe480165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1314269880 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480161710 0x7fe480165d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe4740097c0 tx=0x7fe47401c470 comp rx=0 tx=0).stop 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07aab10640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a4071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07aab10640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f07a4165880 0x7f07a40cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07aab10640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f07a4165e50 0x7f07a40ce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07aab10640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a4071d40 con 0x7f07a4165e50 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07aab10640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a40ccc20 con 0x7f07a4165880 2023-11-28T17:39:41.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07aab10640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40b20b0 con 0x7f07a41654a0 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f07a4165880 0x7f07a40cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f07a4165880 0x7f07a40cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54338/0 (socket says 172.21.15.16:54338) 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 -- 172.21.15.16:0/2317606727 learned_addr learned my addr 172.21.15.16:0/2317606727 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 -- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 msgr2=0x7f07a4071800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 --2- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a4071800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 -- 172.21.15.16:0/2317606727 >> v2:172.21.15.16:3300/0 conn(0x7f07a4165e50 msgr2=0x7f07a40ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 --2- 172.21.15.16:0/2317606727 >> v2:172.21.15.16:3300/0 conn(0x7f07a4165e50 0x7f07a40ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f07a930d640 1 -- 172.21.15.16:0/2317606727 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a40b2390 con 0x7f07a4165880 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 -- 172.21.15.16:0/1314269880 shutdown_connections 2023-11-28T17:39:41.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1314269880 >> v2:172.21.15.16:3300/0 conn(0x7fe480070460 0x7fe4800708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1314269880 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480161710 0x7fe480165d90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 -- 172.21.15.16:0/1314269880 >> 172.21.15.16:0/1314269880 conn(0x7fe48006a5a0 msgr2=0x7fe48006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 -- 172.21.15.16:0/1314269880 shutdown_connections 2023-11-28T17:39:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7fe4858c9640 1 -- 172.21.15.16:0/1314269880 wait complete. 2023-11-28T17:39:41.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140b1750 0x7f03141566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 0x7f0314155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03141590f0 0x7f031413e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031413e8d0 con 0x7f03140b1750 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0314153170 con 0x7f03141590f0 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.699+0000 7f031b409640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031413ece0 con 0x7f03140ce310 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 0x7f0314155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 0x7f0314155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60152/0 (socket says 172.21.15.16:60152) 2023-11-28T17:39:41.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 -- 172.21.15.16:0/1051002470 learned_addr learned my addr 172.21.15.16:0/1051002470 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f031ac08640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03141590f0 0x7f031413e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 -- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03141590f0 msgr2=0x7f031413e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03141590f0 0x7f031413e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 -- 172.21.15.16:0/1051002470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140b1750 msgr2=0x7f03141566f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140b1750 0x7f03141566f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 -- 172.21.15.16:0/1051002470 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0310009420 con 0x7f03140ce310 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f0319c06640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 0x7f0314155000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0310019080 tx=0x7f0310019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f588b05f640 1 Processor -- start 2023-11-28T17:39:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100b6600 con 0x7f03140ce310 2023-11-28T17:39:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0314156cd0 con 0x7f03140ce310 2023-11-28T17:39:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0314157290 con 0x7f03140ce310 2023-11-28T17:39:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7faba96b9640 1 --2- 172.21.15.16:0/893009158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba406c630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faba40b3840 tx=0x7fab9c01d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3faa335aff7b2de8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7fd31ed9d640 1 --2- 172.21.15.16:0/3773883803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320164150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d370 tx=0x7fd31801ed40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b567f17b20a085d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f588b05f640 1 -- start start 2023-11-28T17:39:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.703+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03100b67a0 con 0x7f03140ce310 2023-11-28T17:39:41.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03100b6b50 con 0x7f03140ce310 2023-11-28T17:39:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd31d59a640 1 -- 172.21.15.16:0/3773883803 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180a7e30 con 0x7fd3200712f0 2023-11-28T17:39:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd31d59a640 1 -- 172.21.15.16:0/3773883803 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3180ab070 con 0x7fd3200712f0 2023-11-28T17:39:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd31d59a640 1 -- 172.21.15.16:0/3773883803 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180b1620 con 0x7fd3200712f0 2023-11-28T17:39:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fe4858c9640 1 Processor -- start 2023-11-28T17:39:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f588b05f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5884161710 0x7f5884165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f588b05f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5884146110 0x7f58840708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f588b05f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5884070e00 con 0x7f5884070460 2023-11-28T17:39:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f588b05f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58841662d0 con 0x7f5884161710 2023-11-28T17:39:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f588b05f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588406c6d0 con 0x7f5884146110 2023-11-28T17:39:41.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fe4858c9640 1 -- start start 2023-11-28T17:39:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f5883fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f5884070460 0x7f5884146f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56648/0 (socket says 172.21.15.16:56648) 2023-11-28T17:39:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f5883fff640 1 -- 172.21.15.16:0/2907815572 learned_addr learned my addr 172.21.15.16:0/2907815572 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f5888dfb640 1 --2- 172.21.15.16:0/2907815572 >> v2:172.21.15.16:3300/0 conn(0x7f5884161710 0x7f5884165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f58837fe640 1 -- 172.21.15.16:0/2907815572 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 992530659 0 0) 0x7f5884070e00 con 0x7f5884070460 2023-11-28T17:39:41.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f58837fe640 1 -- 172.21.15.16:0/2907815572 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5874003530 con 0x7f5884070460 2023-11-28T17:39:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02fc005260 con 0x7f03140ce310 2023-11-28T17:39:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fab9bfff640 1 -- 172.21.15.16:0/893009158 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a6820 con 0x7faba41590f0 2023-11-28T17:39:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fab9bfff640 1 -- 172.21.15.16:0/893009158 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c0a6980 con 0x7faba41590f0 2023-11-28T17:39:41.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fab9bfff640 1 -- 172.21.15.16:0/893009158 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0a6820 con 0x7faba41590f0 2023-11-28T17:39:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd324e09640 1 -- 172.21.15.16:0/3773883803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 msgr2=0x7fd320164150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd324e09640 1 --2- 172.21.15.16:0/3773883803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320164150 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd31800d370 tx=0x7fd31801ed40 comp rx=0 tx=0).stop 2023-11-28T17:39:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fdd2b017640 1 Processor -- start 2023-11-28T17:39:41.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fdd2b017640 1 -- start start 2023-11-28T17:39:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fe4858c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 0x7fe48013cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe4858c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe480146f40 0x7fe4800b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07a930d640 1 --2- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a4165880 0x7f07a40cc6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07a406e5d0 tx=0x7f07a001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=534bca115c50b999 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd324e09640 1 -- 172.21.15.16:0/3773883803 shutdown_connections 2023-11-28T17:39:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd324e09640 1 --2- 172.21.15.16:0/3773883803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320164150 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7fd324e09640 1 -- 172.21.15.16:0/3773883803 >> 172.21.15.16:0/3773883803 conn(0x7fd3200cefa0 msgr2=0x7fd3200cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f03100b4040 con 0x7f03140ce310 2023-11-28T17:39:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f030affd640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f02f80668d0 0x7f02f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f031011e290 con 0x7f03140ce310 2023-11-28T17:39:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f031a407640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f02f80668d0 0x7f02f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fd324e09640 1 -- 172.21.15.16:0/3773883803 shutdown_connections 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe4858c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe480161710 0x7fe480161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 0x7fe48013cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe4858c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48015d550 con 0x7fe480161710 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe4858c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48013d120 con 0x7fe480146f40 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe4858c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48015c140 con 0x7fe480070460 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 0x7fe48013cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60162/0 (socket says 172.21.15.16:60162) 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 -- 172.21.15.16:0/1850726513 learned_addr learned my addr 172.21.15.16:0/1850726513 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47e7fc640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe480146f40 0x7fe4800b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f58895fc640 1 --2- 172.21.15.16:0/2907815572 >> v2:172.21.15.64:3300/0 conn(0x7f5884146110 0x7f58840708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.707+0000 7f58837fe640 1 -- 172.21.15.16:0/2907815572 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4176375607 0 0) 0x7f5874003530 con 0x7f5884070460 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f5888dfb640 1 -- 172.21.15.16:0/2907815572 >> v2:172.21.15.64:3300/0 conn(0x7f5884146110 msgr2=0x7f58840708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f5888dfb640 1 --2- 172.21.15.16:0/2907815572 >> v2:172.21.15.64:3300/0 conn(0x7f5884146110 0x7f58840708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f5888dfb640 1 -- 172.21.15.16:0/2907815572 >> v1:172.21.15.64:6789/0 conn(0x7f5884070460 legacy=0x7f5884146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f5888dfb640 1 -- 172.21.15.16:0/2907815572 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588406c9b0 con 0x7f5884161710 2023-11-28T17:39:41.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f58895fc640 1 --2- 172.21.15.16:0/2907815572 >> v2:172.21.15.64:3300/0 conn(0x7f5884146110 0x7f58840708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07a8b0c640 1 -- 172.21.15.16:0/2317606727 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00ab620 con 0x7f07a4165880 2023-11-28T17:39:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07a8b0c640 1 -- 172.21.15.16:0/2317606727 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a00ab780 con 0x7f07a4165880 2023-11-28T17:39:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07a8b0c640 1 -- 172.21.15.16:0/2317606727 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00abb10 con 0x7f07a4165880 2023-11-28T17:39:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47f7fe640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe480161710 0x7fe480161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f031a407640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f02f80668d0 0x7f02f8068d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f030c0012f0 tx=0x7f030c001430 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fd324e09640 1 -- 172.21.15.16:0/3773883803 wait complete. 2023-11-28T17:39:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 -- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a4165880 msgr2=0x7f07a40cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 --2- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a4165880 0x7f07a40cc6e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f07a406e5d0 tx=0x7f07a001c460 comp rx=0 tx=0).stop 2023-11-28T17:39:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 -- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe480146f40 msgr2=0x7fe4800b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe480146f40 0x7fe4800b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 -- 172.21.15.16:0/1850726513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe480161710 msgr2=0x7fe480161af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe480161710 0x7fe480161af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 -- 172.21.15.16:0/1850726513 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474009420 con 0x7fe480070460 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47f7fe640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe480161710 0x7fe480161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47effd640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 0x7fe48013cbe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe47401ab20 tx=0x7fe474019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 -- 172.21.15.16:0/2317606727 shutdown_connections 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 --2- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a4165880 0x7f07a40cc6e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 --2- 172.21.15.16:0/2317606727 >> v2:172.21.15.16:3300/0 conn(0x7f07a4165e50 0x7f07a40ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 --2- 172.21.15.16:0/2317606727 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a4071800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 -- 172.21.15.16:0/2317606727 >> 172.21.15.16:0/2317606727 conn(0x7f07a406a7a0 msgr2=0x7f07a406abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd2b017640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdd2415c8d0 0x7fdd240ce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fe47e7fc640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe480146f40 0x7fe4800b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd2b017640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdd240712f0 0x7fdd240b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 msgr2=0x7faba406c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/893009158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba406c630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7faba40b3840 tx=0x7fab9c01d880 comp rx=0 tx=0).stop 2023-11-28T17:39:41.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd2b017640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd240cee10 con 0x7fdd240ae8a0 2023-11-28T17:39:41.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 -- 172.21.15.16:0/2317606727 shutdown_connections 2023-11-28T17:39:41.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7f07aab10640 1 -- 172.21.15.16:0/2317606727 wait complete. 2023-11-28T17:39:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd1bfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdd240ae8a0 0x7fdd24070be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56662/0 (socket says 172.21.15.16:56662) 2023-11-28T17:39:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd1bfff640 1 -- 172.21.15.16:0/1999162749 learned_addr learned my addr 172.21.15.16:0/1999162749 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240b2ae0 con 0x7fdd240712f0 2023-11-28T17:39:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240b21b0 con 0x7fdd2415c8d0 2023-11-28T17:39:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd28db3640 1 --2- 172.21.15.16:0/1999162749 >> v2:172.21.15.64:3300/0 conn(0x7fdd2415c8d0 0x7fdd240ce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd295b4640 1 --2- 172.21.15.16:0/1999162749 >> v2:172.21.15.16:3300/0 conn(0x7fdd240712f0 0x7fdd240b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 shutdown_connections 2023-11-28T17:39:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fdd1b7fe640 1 -- 172.21.15.16:0/1999162749 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3337991262 0 0) 0x7fdd240cee10 con 0x7fdd240ae8a0 2023-11-28T17:39:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/893009158 >> v2:172.21.15.64:3300/0 conn(0x7faba40ce310 0x7faba40713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/893009158 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba406c630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.711+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 >> 172.21.15.16:0/893009158 conn(0x7faba40b0c30 msgr2=0x7faba40b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fdd1b7fe640 1 -- 172.21.15.16:0/1999162749 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd0c003530 con 0x7fdd240ae8a0 2023-11-28T17:39:41.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 shutdown_connections 2023-11-28T17:39:41.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fabaa6bb640 1 -- 172.21.15.16:0/893009158 wait complete. 2023-11-28T17:39:41.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fdd28db3640 1 -- 172.21.15.16:0/1999162749 >> v2:172.21.15.16:3300/0 conn(0x7fdd240712f0 msgr2=0x7fdd240b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:41.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fdd28db3640 1 --2- 172.21.15.16:0/1999162749 >> v2:172.21.15.16:3300/0 conn(0x7fdd240712f0 0x7fdd240b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fdd28db3640 1 -- 172.21.15.16:0/1999162749 >> v1:172.21.15.64:6789/0 conn(0x7fdd240ae8a0 legacy=0x7fdd24070be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fdd28db3640 1 -- 172.21.15.16:0/1999162749 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd240b2490 con 0x7fdd2415c8d0 2023-11-28T17:39:41.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fdd1b7fe640 1 -- 172.21.15.16:0/1999162749 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3655893803 0 0) 0x7fdd0c003530 con 0x7fdd240ae8a0 2023-11-28T17:39:41.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 Processor -- start 2023-11-28T17:39:41.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 -- start start 2023-11-28T17:39:41.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f5888dfb640 1 --2- 172.21.15.16:0/2907815572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884161710 0x7f5884165d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f588406d630 tx=0x7f587801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9cc5591c4e9cec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f58837fe640 1 -- 172.21.15.16:0/2907815572 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870001680 con 0x7f5884161710 2023-11-28T17:39:41.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fd324e09640 1 Processor -- start 2023-11-28T17:39:41.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f58837fe640 1 -- 172.21.15.16:0/2907815572 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780a5640 con 0x7f5884161710 2023-11-28T17:39:41.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fd324e09640 1 -- start start 2023-11-28T17:39:41.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fabaa6bb640 1 Processor -- start 2023-11-28T17:39:41.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a41fa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07a4165e50 0x7f07a4151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4740abb20 con 0x7fe480070460 2023-11-28T17:39:41.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a41612f0 0x7f07a4166da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4160ad0 con 0x7f07a4165e50 2023-11-28T17:39:41.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a415fec0 con 0x7f07a41612f0 2023-11-28T17:39:41.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aab10640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a41601a0 con 0x7f07a41654a0 2023-11-28T17:39:41.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f588b05f640 1 -- 172.21.15.16:0/2907815572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884161710 msgr2=0x7f5884165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f588b05f640 1 --2- 172.21.15.16:0/2907815572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884161710 0x7f5884165d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f588406d630 tx=0x7f587801c800 comp rx=0 tx=0).stop 2023-11-28T17:39:41.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aa30f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a41612f0 0x7f07a4166da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aa30f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a41612f0 0x7f07a4166da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54400/0 (socket says 172.21.15.16:54400) 2023-11-28T17:39:41.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07aa30f640 1 -- 172.21.15.16:0/1617801969 learned_addr learned my addr 172.21.15.16:0/1617801969 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7f07a9b0e640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a41fa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4740abc80 con 0x7fe480070460 2023-11-28T17:39:41.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe474003620 con 0x7fe480070460 2023-11-28T17:39:41.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe48015c420 con 0x7fe480070460 2023-11-28T17:39:41.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.715+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe48015c9e0 con 0x7fe480070460 2023-11-28T17:39:41.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07a9b0e640 1 -- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a41612f0 msgr2=0x7f07a4166da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07a9b0e640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a41612f0 0x7f07a4166da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07a9b0e640 1 -- 172.21.15.16:0/1617801969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07a4165e50 msgr2=0x7f07a4151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07a9b0e640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07a4165e50 0x7f07a4151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07a9b0e640 1 -- 172.21.15.16:0/1617801969 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a00094d0 con 0x7f07a41654a0 2023-11-28T17:39:41.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07a9b0e640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a41fa790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f079c00bd50 tx=0x7f079c00be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe480165d70 con 0x7fe480070460 2023-11-28T17:39:41.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00ce90 con 0x7f07a41654a0 2023-11-28T17:39:41.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c014440 con 0x7f07a41654a0 2023-11-28T17:39:41.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c014830 con 0x7f07a41654a0 2023-11-28T17:39:41.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a4160480 con 0x7f07a41654a0 2023-11-28T17:39:41.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a41521b0 con 0x7f07a41654a0 2023-11-28T17:39:41.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03100eb5f0 con 0x7f03140ce310 2023-11-28T17:39:41.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd324e09640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f588b05f640 1 -- 172.21.15.16:0/2907815572 shutdown_connections 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f588b05f640 1 --2- 172.21.15.16:0/2907815572 >> v2:172.21.15.64:3300/0 conn(0x7f5884146110 0x7f58840708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f588b05f640 1 --2- 172.21.15.16:0/2907815572 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884161710 0x7f5884165d90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f588b05f640 1 -- 172.21.15.16:0/2907815572 >> 172.21.15.16:0/2907815572 conn(0x7f588406a5a0 msgr2=0x7f588406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fdd28db3640 1 --2- 172.21.15.16:0/1999162749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd2415c8d0 0x7fdd240ce4c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd240d00a0 tx=0x7fdd1401d460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c340d8681f7f1ed5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320148920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54406/0 (socket says 172.21.15.16:54406) 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd324e09640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3200ae8a0 0x7fd320155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a404e890 con 0x7f07a41654a0 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 -- start start 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faba40ce310 0x7faba4147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba4146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 0x7faba414db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4148050 con 0x7faba41590f0 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba4147540 con 0x7faba41594d0 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fabaa6bb640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba4147a90 con 0x7faba40ce310 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7faba9eba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 0x7faba414db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7faba9eba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 0x7faba414db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54410/0 (socket says 172.21.15.16:54410) 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7faba9eba640 1 -- 172.21.15.16:0/4289925251 learned_addr learned my addr 172.21.15.16:0/4289925251 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7faba9eba640 1 -- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faba40ce310 msgr2=0x7faba4147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f079c014990 con 0x7f07a41654a0 2023-11-28T17:39:41.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd324e09640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd32015c8d0 0x7fd320155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd324e09640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd320148e60 con 0x7fd3200ae8a0 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd324e09640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32014e740 con 0x7fd3200712f0 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd324e09640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd32014e2b0 con 0x7fd32015c8d0 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31e59c640 1 -- 172.21.15.16:0/818667289 learned_addr learned my addr 172.21.15.16:0/818667289 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31ed9d640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd32015c8d0 0x7fd320155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31ed9d640 1 -- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 msgr2=0x7fd320148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31ed9d640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31ed9d640 1 -- 172.21.15.16:0/818667289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3200ae8a0 msgr2=0x7fd320155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fd31ed9d640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3200ae8a0 0x7fd320155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fd31ed9d640 1 -- 172.21.15.16:0/818667289 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31800d050 con 0x7fd32015c8d0 2023-11-28T17:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f588b05f640 1 -- 172.21.15.16:0/2907815572 shutdown_connections 2023-11-28T17:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7f588b05f640 1 -- 172.21.15.16:0/2907815572 wait complete. 2023-11-28T17:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fdd1b7fe640 1 -- 172.21.15.16:0/1999162749 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd20001680 con 0x7fdd2415c8d0 2023-11-28T17:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fdd1b7fe640 1 -- 172.21.15.16:0/1999162749 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140a8050 con 0x7fdd2415c8d0 2023-11-28T17:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.719+0000 7fdd1b7fe640 1 -- 172.21.15.16:0/1999162749 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14004250 con 0x7fdd2415c8d0 2023-11-28T17:39:41.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd2415c8d0 msgr2=0x7fdd240ce4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba8eb8640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba4146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1999162749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd2415c8d0 0x7fdd240ce4c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdd240d00a0 tx=0x7fdd1401d460 comp rx=0 tx=0).stop 2023-11-28T17:39:41.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fd31ed9d640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd32015c8d0 0x7fd320155f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3180af000 tx=0x7fd31801bae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 shutdown_connections 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1999162749 >> v2:172.21.15.16:3300/0 conn(0x7fdd240712f0 0x7fdd240b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1999162749 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd2415c8d0 0x7fdd240ce4c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 >> 172.21.15.16:0/1999162749 conn(0x7fdd240cefa0 msgr2=0x7fdd240cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f079a7fc640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f07880668d0 0x7f0788068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f079c084b40 con 0x7f07a41654a0 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f07a930d640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f07880668d0 0x7f0788068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe474003780 con 0x7fe480070460 2023-11-28T17:39:41.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 shutdown_connections 2023-11-28T17:39:41.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f07a930d640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f07880668d0 0x7f0788068d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07a00af000 tx=0x7f07a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fe467fff640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe46c066920 0x7fe46c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f588b05f640 1 Processor -- start 2023-11-28T17:39:41.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba96b9640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faba40ce310 0x7faba4147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe47411eb40 con 0x7fe480070460 2023-11-28T17:39:41.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7f588b05f640 1 -- start start 2023-11-28T17:39:41.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba9eba640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faba40ce310 0x7faba4147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba9eba640 1 -- 172.21.15.16:0/4289925251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 msgr2=0x7faba4146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba9eba640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba4146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba9eba640 1 -- 172.21.15.16:0/4289925251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c00aa70 con 0x7faba41594d0 2023-11-28T17:39:41.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fe47e7fc640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe46c066920 0x7fe46c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba96b9640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faba40ce310 0x7faba4147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba9eba640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 0x7faba414db00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faba000c410 tx=0x7faba000c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7faba8eb8640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba4146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:41.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fdd2b017640 1 -- 172.21.15.16:0/1999162749 wait complete. 2023-11-28T17:39:41.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00074e0 con 0x7faba41594d0 2023-11-28T17:39:41.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba0007640 con 0x7faba41594d0 2023-11-28T17:39:41.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00049f0 con 0x7faba41594d0 2023-11-28T17:39:41.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.723+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba4147d70 con 0x7faba41594d0 2023-11-28T17:39:41.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fe47e7fc640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe46c066920 0x7fe46c068de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4801fdf70 tx=0x7fe47800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba40af820 con 0x7faba41594d0 2023-11-28T17:39:41.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 0x7f588415e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884146110 0x7f588413c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5884161710 0x7f5884148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5888dfb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 0x7f588415e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5888dfb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 0x7f588415e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54414/0 (socket says 172.21.15.16:54414) 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5888dfb640 1 -- 172.21.15.16:0/2453228533 learned_addr learned my addr 172.21.15.16:0/2453228533 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588415f240 con 0x7f5884146110 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588415f520 con 0x7f5884070460 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588415f800 con 0x7f5884161710 2023-11-28T17:39:41.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f079c051ef0 con 0x7f07a41654a0 2023-11-28T17:39:41.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884146110 0x7f588413c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f58895fc640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5884161710 0x7f5884148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab84005260 con 0x7faba41594d0 2023-11-28T17:39:41.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 -- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5884161710 msgr2=0x7f5884148ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5884161710 0x7f5884148ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 -- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 msgr2=0x7f588415e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 0x7f588415e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5878009a70 con 0x7f5884146110 2023-11-28T17:39:41.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5888dfb640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 0x7f588415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:41.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f5883fff640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884146110 0x7f588413c470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5870005890 tx=0x7f587000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 Processor -- start 2023-11-28T17:39:41.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 -- start start 2023-11-28T17:39:41.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdd240712f0 0x7fdd2414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870005cf0 con 0x7f5884146110 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5870005e50 con 0x7f5884146110 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870007290 con 0x7f5884146110 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588415fae0 con 0x7f5884146110 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd240ae8a0 0x7fdd2414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd2415c8d0 0x7fdd24150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2414ffc0 con 0x7fdd2415c8d0 2023-11-28T17:39:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2414cf30 con 0x7fdd240ae8a0 2023-11-28T17:39:41.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.727+0000 7fdd2b017640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2414d210 con 0x7fdd240712f0 2023-11-28T17:39:41.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe4740ebcd0 con 0x7fe480070460 2023-11-28T17:39:41.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180bf070 con 0x7fd32015c8d0 2023-11-28T17:39:41.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588415ee40 con 0x7f5884146110 2023-11-28T17:39:41.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd1bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd240ae8a0 0x7fdd2414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdd240712f0 0x7fdd2414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd1bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd240ae8a0 0x7fdd2414e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54418/0 (socket says 172.21.15.16:54418) 2023-11-28T17:39:41.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd1bfff640 1 -- 172.21.15.16:0/1646679287 learned_addr learned my addr 172.21.15.16:0/1646679287 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:41.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd295b4640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd2415c8d0 0x7fdd24150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 -- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd240ae8a0 msgr2=0x7fdd2414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd240ae8a0 0x7fdd2414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 -- 172.21.15.16:0/1646679287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd2415c8d0 msgr2=0x7fdd24150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd2415c8d0 0x7fdd24150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 -- 172.21.15.16:0/1646679287 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd14009cb0 con 0x7fdd240712f0 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd28db3640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdd240712f0 0x7fdd2414dfd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004000 tx=0x7fdd1401a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd318008310 con 0x7fd32015c8d0 2023-11-28T17:39:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5884068860 con 0x7f5884146110 2023-11-28T17:39:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faba0004b50 con 0x7faba41594d0 2023-11-28T17:39:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fab99ffb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fab880668d0 0x7fab88068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faba0083f80 con 0x7faba41594d0 2023-11-28T17:39:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7faba96b9640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fab880668d0 0x7fab88068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180086a0 con 0x7fd32015c8d0 2023-11-28T17:39:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd32014d6a0 con 0x7fd32015c8d0 2023-11-28T17:39:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd32014dc60 con 0x7fd32015c8d0 2023-11-28T17:39:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd140ba070 con 0x7fdd240712f0 2023-11-28T17:39:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140038f0 con 0x7fdd240712f0 2023-11-28T17:39:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd14003c60 con 0x7fdd240712f0 2023-11-28T17:39:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2414d4f0 con 0x7fdd240712f0 2023-11-28T17:39:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.731+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2414dab0 con 0x7fdd240712f0 2023-11-28T17:39:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24068860 con 0x7fdd240712f0 2023-11-28T17:39:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdd140b3040 con 0x7fdd240712f0 2023-11-28T17:39:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7faba96b9640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fab880668d0 0x7fab88068d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b0000 tx=0x7fab9c0a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faba00510a0 con 0x7faba41594d0 2023-11-28T17:39:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32014e440 con 0x7fd32015c8d0 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd318008800 con 0x7fd32015c8d0 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fd30effd640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3000668d0 0x7fd300068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd31811f320 con 0x7fd32015c8d0 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fd31e59c640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3000668d0 0x7fd300068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5870001480 con 0x7f5884146110 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7f58817fa640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f58680668d0 0x7f5868068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5870083aa0 con 0x7f5884146110 2023-11-28T17:39:41.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7f5888dfb640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f58680668d0 0x7f5868068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fdd197fa640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdd100669a0 0x7fdd10068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:41.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.735+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd1411da40 con 0x7fdd240712f0 2023-11-28T17:39:41.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fdd1bfff640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdd100669a0 0x7fdd10068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:41.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fdd1bfff640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdd100669a0 0x7fdd10068e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdd20001510 tx=0x7fdd20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7f5888dfb640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f58680668d0 0x7f5868068d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f587801c840 tx=0x7f58780a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fd31e59c640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3000668d0 0x7fd300068d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098b0 tx=0x7fd310008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.739+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd140eacf0 con 0x7fdd240712f0 2023-11-28T17:39:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.743+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5870050d80 con 0x7f5884146110 2023-11-28T17:39:41.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:41.743+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3180ec570 con 0x7fd32015c8d0 2023-11-28T17:39:42.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.031+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb698005510 con 0x7fb6b80b1ec0 2023-11-28T17:39:42.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.031+0000 7fb6b57fa640 1 -- 172.21.15.16:0/1088152515 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6b0054d50 con 0x7fb6b80b1ec0 2023-11-28T17:39:42.036 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2023-11-28T17:39:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb6a40669a0 msgr2=0x7fb6a4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb6a40669a0 0x7fb6a4068e60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0ad000 tx=0x7fb6ac008040 comp rx=0 tx=0).stop 2023-11-28T17:39:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 msgr2=0x7fb6b814b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 0x7fb6b814b110 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb6b000cb40 tx=0x7fb6b000a060 comp rx=0 tx=0).stop 2023-11-28T17:39:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 shutdown_connections 2023-11-28T17:39:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb6a40669a0 0x7fb6a4068e60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6b80b1ec0 0x7fb6b814b110 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6b8072010 0x7fb6b80b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 --2- 172.21.15.16:0/1088152515 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6b806b0c0 0x7fb6b814a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.035+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 >> 172.21.15.16:0/1088152515 conn(0x7fb6b806a5a0 msgr2=0x7fb6b80af390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.039+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 shutdown_connections 2023-11-28T17:39:42.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.039+0000 7fb6bec5a640 1 -- 172.21.15.16:0/1088152515 wait complete. 2023-11-28T17:39:42.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.059+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f02fc0057e0 con 0x7f03140ce310 2023-11-28T17:39:42.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.063+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f07a41602e0 con 0x7f07a41654a0 2023-11-28T17:39:42.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.063+0000 7f030affd640 1 -- 172.21.15.16:0/1051002470 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f03100eec10 con 0x7f03140ce310 2023-11-28T17:39:42.069 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2023-11-28T17:39:42.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.067+0000 7f079a7fc640 1 -- 172.21.15.16:0/1617801969 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f07a41602e0 con 0x7f07a41654a0 2023-11-28T17:39:42.072 INFO:teuthology.orchestra.run.smithi016.stdout:64424509444 2023-11-28T17:39:42.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2023-11-28T17:39:42.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f02f80668d0 msgr2=0x7f02f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f02f80668d0 0x7f02f8068d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f030c0012f0 tx=0x7f030c001430 comp rx=0 tx=0).stop 2023-11-28T17:39:42.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 msgr2=0x7f0314155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 0x7f0314155000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0310019080 tx=0x7f0310019210 comp rx=0 tx=0).stop 2023-11-28T17:39:42.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 shutdown_connections 2023-11-28T17:39:42.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f02f80668d0 0x7f02f8068d90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03141590f0 0x7f031413e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03140ce310 0x7f0314155000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 --2- 172.21.15.16:0/1051002470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03140b1750 0x7f03141566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 >> 172.21.15.16:0/1051002470 conn(0x7f03140b0c30 msgr2=0x7f0314166870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 shutdown_connections 2023-11-28T17:39:42.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f031b409640 1 -- 172.21.15.16:0/1051002470 wait complete. 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f07880668d0 msgr2=0x7f0788068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f07880668d0 0x7f0788068d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07a00af000 tx=0x7f07a0008040 comp rx=0 tx=0).stop 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 msgr2=0x7f07a41fa790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a41fa790 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f079c00bd50 tx=0x7f079c00be40 comp rx=0 tx=0).stop 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 shutdown_connections 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f07880668d0 0x7f0788068d90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f07a41612f0 0x7f07a4166da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f07a4165e50 0x7f07a4151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 --2- 172.21.15.16:0/1617801969 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f07a41654a0 0x7f07a41fa790 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.071+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 >> 172.21.15.16:0/1617801969 conn(0x7f07a406a7a0 msgr2=0x7f07a406c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.075+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 shutdown_connections 2023-11-28T17:39:42.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.075+0000 7f07aab10640 1 -- 172.21.15.16:0/1617801969 wait complete. 2023-11-28T17:39:42.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.075+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe480068860 con 0x7fe480070460 2023-11-28T17:39:42.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.075+0000 7fe467fff640 1 -- 172.21.15.16:0/1850726513 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe4740ef2f0 con 0x7fe480070460 2023-11-28T17:39:42.079 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2023-11-28T17:39:42.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fab84005510 con 0x7faba41594d0 2023-11-28T17:39:42.082 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fab99ffb640 1 -- 172.21.15.16:0/4289925251 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faba00546c0 con 0x7faba41594d0 2023-11-28T17:39:42.082 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2023-11-28T17:39:42.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe46c066920 msgr2=0x7fe46c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe46c066920 0x7fe46c068de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe4801fdf70 tx=0x7fe47800b040 comp rx=0 tx=0).stop 2023-11-28T17:39:42.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 msgr2=0x7fe48013cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 0x7fe48013cbe0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe47401ab20 tx=0x7fe474019210 comp rx=0 tx=0).stop 2023-11-28T17:39:42.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 shutdown_connections 2023-11-28T17:39:42.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe480161710 0x7fe480161af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe46c066920 0x7fe46c068de0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe480146f40 0x7fe4800b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 --2- 172.21.15.16:0/1850726513 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe480070460 0x7fe48013cbe0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 >> 172.21.15.16:0/1850726513 conn(0x7fe48006a5a0 msgr2=0x7fe48013e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 shutdown_connections 2023-11-28T17:39:42.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.079+0000 7fe4858c9640 1 -- 172.21.15.16:0/1850726513 wait complete. 2023-11-28T17:39:42.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f58840b3270 con 0x7f5884146110 2023-11-28T17:39:42.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fab880668d0 msgr2=0x7fab88068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fab880668d0 0x7fab88068d90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab9c0b0000 tx=0x7fab9c0a8070 comp rx=0 tx=0).stop 2023-11-28T17:39:42.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 msgr2=0x7faba414db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 0x7faba414db00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faba000c410 tx=0x7faba000c8d0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd32014a170 con 0x7fd32015c8d0 2023-11-28T17:39:42.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fd30effd640 1 -- 172.21.15.16:0/818667289 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3180efb90 con 0x7fd32015c8d0 2023-11-28T17:39:42.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7f58817fa640 1 -- 172.21.15.16:0/2453228533 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5870017020 con 0x7f5884146110 2023-11-28T17:39:42.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 shutdown_connections 2023-11-28T17:39:42.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fab880668d0 0x7fab88068d90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faba41594d0 0x7faba414db00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faba41590f0 0x7faba4146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 --2- 172.21.15.16:0/4289925251 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faba40ce310 0x7faba4147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 >> 172.21.15.16:0/4289925251 conn(0x7faba40b0c30 msgr2=0x7faba40717a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.088 INFO:teuthology.orchestra.run.smithi016.stdout:64424509445 2023-11-28T17:39:42.088 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:42.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 shutdown_connections 2023-11-28T17:39:42.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.083+0000 7fabaa6bb640 1 -- 172.21.15.16:0/4289925251 wait complete. 2023-11-28T17:39:42.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fdd2414f6a0 con 0x7fdd240712f0 2023-11-28T17:39:42.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f58680668d0 msgr2=0x7f5868068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7f588b05f640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f58680668d0 0x7f5868068d90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f587801c840 tx=0x7f58780a7070 comp rx=0 tx=0).stop 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884146110 msgr2=0x7f588413c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7f588b05f640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884146110 0x7f588413c470 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5870005890 tx=0x7f587000cf50 comp rx=0 tx=0).stop 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3000668d0 msgr2=0x7fd300068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3000668d0 0x7fd300068d90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3100098b0 tx=0x7fd310008040 comp rx=0 tx=0).stop 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd32015c8d0 msgr2=0x7fd320155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd32015c8d0 0x7fd320155f30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd3180af000 tx=0x7fd31801bae0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 shutdown_connections 2023-11-28T17:39:42.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd32015c8d0 0x7fd320155f30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3200ae8a0 0x7fd320155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3000668d0 0x7fd300068d90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 --2- 172.21.15.16:0/818667289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3200712f0 0x7fd320148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.087+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 >> 172.21.15.16:0/818667289 conn(0x7fd3200cefa0 msgr2=0x7fd3200affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 shutdown_connections 2023-11-28T17:39:42.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 shutdown_connections 2023-11-28T17:39:42.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5884161710 0x7f5884148ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5884146110 0x7f588413c470 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f58680668d0 0x7f5868068d90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 --2- 172.21.15.16:0/2453228533 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5884070460 0x7f588415e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7fdd197fa640 1 -- 172.21.15.16:0/1646679287 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd140ee310 con 0x7fdd240712f0 2023-11-28T17:39:42.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 >> 172.21.15.16:0/2453228533 conn(0x7f588406a5a0 msgr2=0x7f5884147fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 shutdown_connections 2023-11-28T17:39:42.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7f588b05f640 1 -- 172.21.15.16:0/2453228533 wait complete. 2023-11-28T17:39:42.094 INFO:teuthology.orchestra.run.smithi016.stdout:60129542150 2023-11-28T17:39:42.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7fd324e09640 1 -- 172.21.15.16:0/818667289 wait complete. 2023-11-28T17:39:42.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdd100669a0 msgr2=0x7fdd10068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.091+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdd100669a0 0x7fdd10068e60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdd20001510 tx=0x7fdd20009040 comp rx=0 tx=0).stop 2023-11-28T17:39:42.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdd240712f0 msgr2=0x7fdd2414dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:42.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdd240712f0 0x7fdd2414dfd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004000 tx=0x7fdd1401a200 comp rx=0 tx=0).stop 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 shutdown_connections 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdd2415c8d0 0x7fdd24150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdd100669a0 0x7fdd10068e60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd240ae8a0 0x7fdd2414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 --2- 172.21.15.16:0/1646679287 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdd240712f0 0x7fdd2414dfd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 >> 172.21.15.16:0/1646679287 conn(0x7fdd240cefa0 msgr2=0x7fdd240af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:42.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 shutdown_connections 2023-11-28T17:39:42.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:42.095+0000 7fdd2b017640 1 -- 172.21.15.16:0/1646679287 wait complete. 2023-11-28T17:39:42.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509444 for osd.3 2023-11-28T17:39:42.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2023-11-28T17:39:42.124 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.4 2023-11-28T17:39:42.126 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.6 2023-11-28T17:39:42.131 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2023-11-28T17:39:42.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.5 2023-11-28T17:39:42.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542150 for osd.7 2023-11-28T17:39:43.074 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T17:39:43.112 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T17:39:43.114 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T17:39:43.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T17:39:43.127 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T17:39:43.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T17:39:43.136 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T17:39:43.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T17:39:43.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 Processor -- start 2023-11-28T17:39:43.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 -- start start 2023-11-28T17:39:43.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdc68159540 0x7fdc6815d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc680703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc6815d410 con 0x7fdc68072010 2023-11-28T17:39:43.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc6806e200 con 0x7fdc68159540 2023-11-28T17:39:43.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.275+0000 7fdc70079640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815dde0 con 0x7fdc680cbfb0 2023-11-28T17:39:43.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc680703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc680703d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60240/0 (socket says 172.21.15.16:60240) 2023-11-28T17:39:43.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 -- 172.21.15.16:0/841203748 learned_addr learned my addr 172.21.15.16:0/841203748 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 -- 172.21.15.16:0/841203748 >> v2:172.21.15.16:3300/0 conn(0x7fdc68159540 msgr2=0x7fdc6815d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 --2- 172.21.15.16:0/841203748 >> v2:172.21.15.16:3300/0 conn(0x7fdc68159540 0x7fdc6815d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 -- 172.21.15.16:0/841203748 >> v1:172.21.15.64:6789/0 conn(0x7fdc68072010 legacy=0x7fdc680cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.279+0000 7fdc6e616640 1 -- 172.21.15.16:0/841203748 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6806dc40 con 0x7fdc680cbfb0 2023-11-28T17:39:43.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.283+0000 7fdc6e616640 1 --2- 172.21.15.16:0/841203748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc680703d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000d370 tx=0x7fdc6001ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7acc5a3a913fca9d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc6ce13640 1 -- 172.21.15.16:0/841203748 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc600a7cd0 con 0x7fdc680cbfb0 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc6ce13640 1 -- 172.21.15.16:0/841203748 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600ab070 con 0x7fdc680cbfb0 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc6ce13640 1 -- 172.21.15.16:0/841203748 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc600b1620 con 0x7fdc680cbfb0 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 -- 172.21.15.16:0/841203748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 msgr2=0x7fdc680703d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 --2- 172.21.15.16:0/841203748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc680703d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdc6000d370 tx=0x7fdc6001ec40 comp rx=0 tx=0).stop 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 -- 172.21.15.16:0/841203748 shutdown_connections 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 --2- 172.21.15.16:0/841203748 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc680703d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 --2- 172.21.15.16:0/841203748 >> v2:172.21.15.16:3300/0 conn(0x7fdc68159540 0x7fdc6815d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 -- 172.21.15.16:0/841203748 >> 172.21.15.16:0/841203748 conn(0x7fdc6806a5a0 msgr2=0x7fdc6806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 -- 172.21.15.16:0/841203748 shutdown_connections 2023-11-28T17:39:43.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.287+0000 7fdc70079640 1 -- 172.21.15.16:0/841203748 wait complete. 2023-11-28T17:39:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.291+0000 7fdc70079640 1 Processor -- start 2023-11-28T17:39:43.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.291+0000 7fdc70079640 1 -- start start 2023-11-28T17:39:43.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc70079640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 0x7fdc6814c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc70079640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc6815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc70079640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc68159540 0x7fdc681599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc6de15640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 0x7fdc6814c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc6de15640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 0x7fdc6814c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54426/0 (socket says 172.21.15.16:54426) 2023-11-28T17:39:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc6d614640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc6815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc6d614640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc6815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60244/0 (socket says 172.21.15.16:60244) 2023-11-28T17:39:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc6de15640 1 -- 172.21.15.16:0/989420938 learned_addr learned my addr 172.21.15.16:0/989420938 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814d760 con 0x7fdc68159540 2023-11-28T17:39:43.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc6e616640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc68159540 0x7fdc681599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6815b1b0 con 0x7fdc68072010 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.295+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6814cb50 con 0x7fdc680cbfb0 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6e616640 1 -- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 msgr2=0x7fdc6815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6e616640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc6815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6e616640 1 -- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 msgr2=0x7fdc6814c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6e616640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 0x7fdc6814c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6e616640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6000d050 con 0x7fdc68159540 2023-11-28T17:39:43.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6de15640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 0x7fdc6814c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6d614640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc6815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc6e616640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc68159540 0x7fdc681599b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc600af000 tx=0x7fdc6001b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc60008040 con 0x7fdc68159540 2023-11-28T17:39:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc600081a0 con 0x7fdc68159540 2023-11-28T17:39:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc600085d0 con 0x7fdc68159540 2023-11-28T17:39:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6814ce30 con 0x7fdc68159540 2023-11-28T17:39:43.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.299+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6814d3f0 con 0x7fdc68159540 2023-11-28T17:39:43.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.303+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc60008730 con 0x7fdc68159540 2023-11-28T17:39:43.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.307+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc6814d8d0 con 0x7fdc68159540 2023-11-28T17:39:43.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.307+0000 7fdc5e7fc640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc4c0668d0 0x7fdc4c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.307+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc6011e540 con 0x7fdc68159540 2023-11-28T17:39:43.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.307+0000 7fdc6de15640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc4c0668d0 0x7fdc4c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.307+0000 7fdc6de15640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc4c0668d0 0x7fdc4c068d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009d80 tx=0x7fdc64009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.315+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc600eb790 con 0x7fdc68159540 2023-11-28T17:39:43.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.331+0000 7fbb4178d640 1 Processor -- start 2023-11-28T17:39:43.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.331+0000 7fbb4178d640 1 -- start start 2023-11-28T17:39:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb4178d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fbb3c06c630 0x7fbb3c0ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb4178d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c143dc0 con 0x7fbb3c1439e0 2023-11-28T17:39:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb4178d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3c06cb80 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb4178d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3c06d800 con 0x7fbb3c06c630 2023-11-28T17:39:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb3affd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fbb3c1439e0 0x7fbb3c0b2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50454/0 (socket says 172.21.15.16:50454) 2023-11-28T17:39:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb3affd640 1 -- 172.21.15.16:0/2679139879 learned_addr learned my addr 172.21.15.16:0/2679139879 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb3b7fe640 1 --2- 172.21.15.16:0/2679139879 >> v2:172.21.15.16:3300/0 conn(0x7fbb3c06c630 0x7fbb3c0ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb3b7fe640 1 -- 172.21.15.16:0/2679139879 >> v1:172.21.15.64:6789/0 conn(0x7fbb3c0b2a10 legacy=0x7fbb3c070480 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-28T17:39:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb3b7fe640 1 -- 172.21.15.16:0/2679139879 >> v1:172.21.15.16:6789/0 conn(0x7fbb3c1439e0 legacy=0x7fbb3c0b2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.335+0000 7fbb3b7fe640 1 -- 172.21.15.16:0/2679139879 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3c06ce60 con 0x7fbb3c06c630 2023-11-28T17:39:43.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.339+0000 7fbb3b7fe640 1 --2- 172.21.15.16:0/2679139879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c06c630 0x7fbb3c0ce090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000ba60 tx=0x7fbb3001eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc0e8be04de3bcc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.339+0000 7fe26511d640 1 Processor -- start 2023-11-28T17:39:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe26511d640 1 -- start start 2023-11-28T17:39:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb39ffb640 1 -- 172.21.15.16:0/2679139879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb300a7ac0 con 0x7fbb3c06c630 2023-11-28T17:39:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb39ffb640 1 -- 172.21.15.16:0/2679139879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb300a7c20 con 0x7fbb3c06c630 2023-11-28T17:39:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb39ffb640 1 -- 172.21.15.16:0/2679139879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb300af440 con 0x7fbb3c06c630 2023-11-28T17:39:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 -- 172.21.15.16:0/2679139879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c06c630 msgr2=0x7fbb3c0ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 --2- 172.21.15.16:0/2679139879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c06c630 0x7fbb3c0ce090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbb3000ba60 tx=0x7fbb3001eae0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe26511d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe26006e870 0x7fe2600adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe26511d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe26006d870 0x7fe26006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe26511d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2600b21d0 con 0x7fe26015d6a0 2023-11-28T17:39:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe26511d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2600ae9c0 con 0x7fe26006e870 2023-11-28T17:39:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe26511d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26006e240 con 0x7fe26006d870 2023-11-28T17:39:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25e59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe26006e870 0x7fe2600adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25e59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe26006e870 0x7fe2600adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48752/0 (socket says 172.21.15.16:48752) 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25e59c640 1 -- 172.21.15.16:0/1167423120 learned_addr learned my addr 172.21.15.16:0/1167423120 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25f59e640 1 --2- 172.21.15.16:0/1167423120 >> v2:172.21.15.64:3300/0 conn(0x7fe26006d870 0x7fe26006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25f59e640 1 -- 172.21.15.16:0/1167423120 >> v2:172.21.15.16:3300/0 conn(0x7fe26006e870 msgr2=0x7fe2600adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25f59e640 1 --2- 172.21.15.16:0/1167423120 >> v2:172.21.15.16:3300/0 conn(0x7fe26006e870 0x7fe2600adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25f59e640 1 -- 172.21.15.16:0/1167423120 >> v1:172.21.15.16:6789/0 conn(0x7fe26015d6a0 legacy=0x7fe2601616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fe25f59e640 1 -- 172.21.15.16:0/1167423120 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2600ae120 con 0x7fe26006d870 2023-11-28T17:39:43.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 -- 172.21.15.16:0/2679139879 shutdown_connections 2023-11-28T17:39:43.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 --2- 172.21.15.16:0/2679139879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c06c630 0x7fbb3c0ce090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 -- 172.21.15.16:0/2679139879 >> 172.21.15.16:0/2679139879 conn(0x7fbb3c06a5a0 msgr2=0x7fbb3c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 -- 172.21.15.16:0/2679139879 shutdown_connections 2023-11-28T17:39:43.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.343+0000 7fbb4178d640 1 -- 172.21.15.16:0/2679139879 wait complete. 2023-11-28T17:39:43.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.347+0000 7fbb4178d640 1 Processor -- start 2023-11-28T17:39:43.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 -- start start 2023-11-28T17:39:43.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fe25f59e640 1 --2- 172.21.15.16:0/1167423120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26006dd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe260074460 tx=0x7fe25801c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2999410b72d4ae6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb3c06c630 0x7fbb3c157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 0x7fbb3c13b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c1439e0 0x7fbb3c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c15da50 con 0x7fbb3c1439e0 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c158520 con 0x7fbb3c06c630 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb4178d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3c155ec0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 0x7fbb3c13b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fe25dd9b640 1 -- 172.21.15.16:0/1167423120 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580a5960 con 0x7fe26006d870 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 0x7fbb3c13b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60258/0 (socket says 172.21.15.16:60258) 2023-11-28T17:39:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 -- 172.21.15.16:0/4125969175 learned_addr learned my addr 172.21.15.16:0/4125969175 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb3c06c630 0x7fbb3c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fe25dd9b640 1 -- 172.21.15.16:0/1167423120 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2580a5ac0 con 0x7fe26006d870 2023-11-28T17:39:43.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fe25dd9b640 1 -- 172.21.15.16:0/1167423120 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2580a5e50 con 0x7fe26006d870 2023-11-28T17:39:43.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 -- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb3c06c630 msgr2=0x7fbb3c157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb3c06c630 0x7fbb3c157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 -- 172.21.15.16:0/4125969175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c1439e0 msgr2=0x7fbb3c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3b7fe640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c1439e0 0x7fbb3c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c1439e0 0x7fbb3c155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 -- 172.21.15.16:0/4125969175 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3000b6c0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb3a7fc640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 0x7fbb3c13b960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400b9e0 tx=0x7fbb3400bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fe26511d640 1 -- 172.21.15.16:0/1167423120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 msgr2=0x7fe26006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fe26511d640 1 --2- 172.21.15.16:0/1167423120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26006dd00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe260074460 tx=0x7fe25801c8a0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.351+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb3400cba0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fe26511d640 1 -- 172.21.15.16:0/1167423120 shutdown_connections 2023-11-28T17:39:43.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fe26511d640 1 --2- 172.21.15.16:0/1167423120 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26006dd00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fe26511d640 1 --2- 172.21.15.16:0/1167423120 >> v2:172.21.15.16:3300/0 conn(0x7fe26006e870 0x7fe2600adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fe26511d640 1 -- 172.21.15.16:0/1167423120 >> 172.21.15.16:0/1167423120 conn(0x7fe2600cefa0 msgr2=0x7fe2600cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb3400cd00 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34014680 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3c157910 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb3c157ed0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fe26511d640 1 -- 172.21.15.16:0/1167423120 shutdown_connections 2023-11-28T17:39:43.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3c04e890 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.355+0000 7fe26511d640 1 -- 172.21.15.16:0/1167423120 wait complete. 2023-11-28T17:39:43.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 Processor -- start 2023-11-28T17:39:43.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 -- start start 2023-11-28T17:39:43.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26014ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26006e870 0x7fe260202810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe26015d6a0 0x7fe260154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fbb340147e0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fbb237fe640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fbb280669d0 0x7fbb28068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb340842e0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe25ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26014ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe25ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26014ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54458/0 (socket says 172.21.15.16:54458) 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe25ed9d640 1 -- 172.21.15.16:0/3874328199 learned_addr learned my addr 172.21.15.16:0/3874328199 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe260202d50 con 0x7fe26006e870 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26014b310 con 0x7fe26006d870 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe260156bd0 con 0x7fe26015d6a0 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fe25e59c640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26006e870 0x7fe260202810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25f59e640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe26015d6a0 0x7fe260154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.359+0000 7fbb3affd640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fbb280669d0 0x7fbb28068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25ed9d640 1 -- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe26015d6a0 msgr2=0x7fe260154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25ed9d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe26015d6a0 0x7fe260154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25ed9d640 1 -- 172.21.15.16:0/3874328199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26006e870 msgr2=0x7fe260202810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25ed9d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26006e870 0x7fe260202810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25ed9d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe258009a70 con 0x7fe26006d870 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe25ed9d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26014ba20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe25000b410 tx=0x7fe25000b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250004020 con 0x7fe26006d870 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe250004180 con 0x7fe26006d870 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250011630 con 0x7fe26006d870 2023-11-28T17:39:43.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe260156e70 con 0x7fe26006d870 2023-11-28T17:39:43.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2601581d0 con 0x7fe26006d870 2023-11-28T17:39:43.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fbb3affd640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fbb280669d0 0x7fbb28068e90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005890 tx=0x7fbb2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.363+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbb340515b0 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.367+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe260068860 con 0x7fe26006d870 2023-11-28T17:39:43.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.367+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe250011790 con 0x7fe26006d870 2023-11-28T17:39:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.367+0000 7fe2477fe640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe24c0669a0 0x7fe24c068e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.371+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe250084080 con 0x7fe26006d870 2023-11-28T17:39:43.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.371+0000 7fe25e59c640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe24c0669a0 0x7fe24c068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.371+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe250051350 con 0x7fe26006d870 2023-11-28T17:39:43.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.375+0000 7fe25e59c640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe24c0669a0 0x7fe24c068e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe26015cc90 tx=0x7fe254009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.423+0000 7fa6e17b8640 1 Processor -- start 2023-11-28T17:39:43.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.423+0000 7fa6e17b8640 1 -- start start 2023-11-28T17:39:43.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.423+0000 7fa6e17b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa6dc0b2d80 0x7fa6dc06b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.423+0000 7fa6e17b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6dc159150 0x7fa6dc0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.423+0000 7fa6e17b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 0x7fa6dc0d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.423+0000 7fa6e17b8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc0ccfe0 con 0x7fa6dc159150 2023-11-28T17:39:43.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6daffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa6dc0b2d80 0x7fa6dc06b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 0x7fa6dc0d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 0x7fa6dc0d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60280/0 (socket says 172.21.15.16:60280) 2023-11-28T17:39:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 -- 172.21.15.16:0/1053454831 learned_addr learned my addr 172.21.15.16:0/1053454831 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6da7fc640 1 --2- 172.21.15.16:0/1053454831 >> v2:172.21.15.16:3300/0 conn(0x7fa6dc159150 0x7fa6dc0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6dc1595b0 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0b4250 con 0x7fa6dc0b3aa0 2023-11-28T17:39:43.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 -- 172.21.15.16:0/1053454831 >> v2:172.21.15.64:3300/0 conn(0x7fa6dc0b2d80 msgr2=0x7fa6dc06b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 --2- 172.21.15.16:0/1053454831 >> v2:172.21.15.64:3300/0 conn(0x7fa6dc0b2d80 0x7fa6dc06b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 -- 172.21.15.16:0/1053454831 >> v2:172.21.15.16:3300/0 conn(0x7fa6dc159150 msgr2=0x7fa6dc0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 --2- 172.21.15.16:0/1053454831 >> v2:172.21.15.16:3300/0 conn(0x7fa6dc159150 0x7fa6dc0b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6dbfff640 1 -- 172.21.15.16:0/1053454831 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc06a6d0 con 0x7fa6dc0b3aa0 2023-11-28T17:39:43.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7fa6daffd640 1 --2- 172.21.15.16:0/1053454831 >> v2:172.21.15.64:3300/0 conn(0x7fa6dc0b2d80 0x7fa6dc06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7ff2cffff640 1 Processor -- start 2023-11-28T17:39:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.427+0000 7ff2cffff640 1 -- start start 2023-11-28T17:39:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fa6dbfff640 1 --2- 172.21.15.16:0/1053454831 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 0x7fa6dc0d01b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc06ed40 tx=0x7fa6d4020d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7f5422fedc71fe2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fa6d9ffb640 1 -- 172.21.15.16:0/1053454831 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40a9be0 con 0x7fa6dc0b3aa0 2023-11-28T17:39:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fa6d9ffb640 1 -- 172.21.15.16:0/1053454831 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d40a9d40 con 0x7fa6dc0b3aa0 2023-11-28T17:39:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fa6d9ffb640 1 -- 172.21.15.16:0/1053454831 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d40b1610 con 0x7fa6dc0b3aa0 2023-11-28T17:39:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0165210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2cffff640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d006ca60 con 0x7ff2d0161bf0 2023-11-28T17:39:43.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2cffff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d015c0d0 con 0x7ff2d015bcf0 2023-11-28T17:39:43.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2cffff640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0165830 con 0x7ff2d0071d10 2023-11-28T17:39:43.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2ceffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff2d015bcf0 0x7ff2d0071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56702/0 (socket says 172.21.15.16:56702) 2023-11-28T17:39:43.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2ceffd640 1 -- 172.21.15.16:0/3844238568 learned_addr learned my addr 172.21.15.16:0/3844238568 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:43.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2ce7fc640 1 --2- 172.21.15.16:0/3844238568 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0165210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 Processor -- start 2023-11-28T17:39:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 -- start start 2023-11-28T17:39:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe85015d5e0 0x7fe8500b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe8500d1a80 0x7fe8500d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500b2d60 con 0x7fe8500d3000 2023-11-28T17:39:43.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500b3040 con 0x7fe85015d5e0 2023-11-28T17:39:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7fe857d65640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500b3320 con 0x7fe8500d1a80 2023-11-28T17:39:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.431+0000 7ff2cdffb640 1 -- 172.21.15.16:0/3844238568 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2177988967 0 0) 0x7ff2d015c0d0 con 0x7ff2d015bcf0 2023-11-28T17:39:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe856302640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fe8500d3000 0x7fe8500d3470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56710/0 (socket says 172.21.15.16:56710) 2023-11-28T17:39:43.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe856302640 1 -- 172.21.15.16:0/740869213 learned_addr learned my addr 172.21.15.16:0/740869213 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 msgr2=0x7fa6dc0d01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/1053454831 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 0x7fa6dc0d01b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc06ed40 tx=0x7fa6d4020d30 comp rx=0 tx=0).stop 2023-11-28T17:39:43.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7ff2cdffb640 1 -- 172.21.15.16:0/3844238568 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b8003530 con 0x7ff2d015bcf0 2023-11-28T17:39:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 shutdown_connections 2023-11-28T17:39:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe855300640 1 --2- 172.21.15.16:0/740869213 >> v2:172.21.15.64:3300/0 conn(0x7fe8500d1a80 0x7fe8500d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970067713 0 0) 0x7fe8500b2d60 con 0x7fe8500d3000 2023-11-28T17:39:43.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe83c003530 con 0x7fe8500d3000 2023-11-28T17:39:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/1053454831 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b3aa0 0x7fa6dc0d01b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/1053454831 >> v2:172.21.15.16:3300/0 conn(0x7fa6dc159150 0x7fa6dc0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/1053454831 >> v2:172.21.15.64:3300/0 conn(0x7fa6dc0b2d80 0x7fa6dc06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 >> 172.21.15.16:0/1053454831 conn(0x7fa6dc0b2260 msgr2=0x7fa6dc0b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 shutdown_connections 2023-11-28T17:39:43.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fa6e17b8640 1 -- 172.21.15.16:0/1053454831 wait complete. 2023-11-28T17:39:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7ff2ce7fc640 1 -- 172.21.15.16:0/3844238568 >> v1:172.21.15.64:6789/0 conn(0x7ff2d015bcf0 legacy=0x7ff2d0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7ff2ce7fc640 1 -- 172.21.15.16:0/3844238568 >> v1:172.21.15.16:6789/0 conn(0x7ff2d0161bf0 legacy=0x7ff2d006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.444 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7ff2ce7fc640 1 -- 172.21.15.16:0/3844238568 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0165b10 con 0x7ff2d0071d10 2023-11-28T17:39:43.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718260300 0 0) 0x7fe83c003530 con 0x7fe8500d3000 2023-11-28T17:39:43.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 >> v2:172.21.15.64:3300/0 conn(0x7fe8500d1a80 msgr2=0x7fe8500d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 --2- 172.21.15.16:0/740869213 >> v2:172.21.15.64:3300/0 conn(0x7fe8500d1a80 0x7fe8500d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 >> v2:172.21.15.16:3300/0 conn(0x7fe85015d5e0 msgr2=0x7fe8500b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 --2- 172.21.15.16:0/740869213 >> v2:172.21.15.16:3300/0 conn(0x7fe85015d5e0 0x7fe8500b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500b3600 con 0x7fe8500d3000 2023-11-28T17:39:43.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 <== mon.1 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7fe848001a00 con 0x7fe8500d3000 2023-11-28T17:39:43.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 >> v1:172.21.15.64:6789/0 conn(0x7fe8500d3000 legacy=0x7fe8500d3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe83c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe83c0047d0 0x7fe83c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe83c005190 0x7fe83c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b3040 con 0x7fe83c005190 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b3320 con 0x7fe83c003980 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c00c0b0 con 0x7fe83c0047d0 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe856302640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe83c005190 0x7fe83c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe855300640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe83c0047d0 0x7fe83c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe855b01640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe83c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe855b01640 1 -- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe83c0047d0 msgr2=0x7fe83c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.435+0000 7fe855b01640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe83c0047d0 0x7fe83c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fe855b01640 1 -- 172.21.15.16:0/740869213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe83c005190 msgr2=0x7fe83c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fe855b01640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe83c005190 0x7fe83c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fe855b01640 1 -- 172.21.15.16:0/740869213 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500b3600 con 0x7fe83c003980 2023-11-28T17:39:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fe856302640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe83c005190 0x7fe83c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fe855300640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe83c0047d0 0x7fe83c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fe856302640 1 -- 172.21.15.16:0/740869213 reap_dead start 2023-11-28T17:39:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fa6e17b8640 1 Processor -- start 2023-11-28T17:39:43.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fa6e17b8640 1 -- start start 2023-11-28T17:39:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7ff2ce7fc640 1 --2- 172.21.15.16:0/3844238568 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0165210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40097f0 tx=0x7ff2c401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cc8ef7884a137b1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7ff2cdffb640 1 -- 172.21.15.16:0/3844238568 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40ac410 con 0x7ff2d0071d10 2023-11-28T17:39:43.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fd40bc17640 1 Processor -- start 2023-11-28T17:39:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7ff2cdffb640 1 -- 172.21.15.16:0/3844238568 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c40ac570 con 0x7ff2d0071d10 2023-11-28T17:39:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7ff2cdffb640 1 -- 172.21.15.16:0/3844238568 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40ac900 con 0x7ff2d0071d10 2023-11-28T17:39:43.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.439+0000 7fd40bc17640 1 -- start start 2023-11-28T17:39:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 -- 172.21.15.16:0/3844238568 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 msgr2=0x7ff2d0165210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 --2- 172.21.15.16:0/3844238568 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0165210 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff2c40097f0 tx=0x7ff2c401c4c0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6e17b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 0x7fa6dc1535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 -- 172.21.15.16:0/3844238568 shutdown_connections 2023-11-28T17:39:43.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 --2- 172.21.15.16:0/3844238568 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0165210 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 -- 172.21.15.16:0/3844238568 >> 172.21.15.16:0/3844238568 conn(0x7ff2d006a5a0 msgr2=0x7ff2d006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6e17b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc0b3aa0 0x7fa6dc14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 -- 172.21.15.16:0/3844238568 shutdown_connections 2023-11-28T17:39:43.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 0x7fa6dc1535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 0x7fa6dc1535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60304/0 (socket says 172.21.15.16:60304) 2023-11-28T17:39:43.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6da7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc0b3aa0 0x7fa6dc14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd40bc17640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd4040cedf0 0x7fd404167fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6da7fc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc0b3aa0 0x7fa6dc14fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48790/0 (socket says 172.21.15.16:48790) 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 -- 172.21.15.16:0/895918949 learned_addr learned my addr 172.21.15.16:0/895918949 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6dc159150 0x7fa6dc15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c8fb0 con 0x7fa6dc0b3aa0 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c6150 con 0x7fa6dc159150 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc0c6430 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6dbfff640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6dc159150 0x7fa6dc15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd40bc17640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040b32c0 con 0x7fd4040d1f50 2023-11-28T17:39:43.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4099b3640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd40415d540 0x7fd4040b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56718/0 (socket says 172.21.15.16:56718) 2023-11-28T17:39:43.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4099b3640 1 -- 172.21.15.16:0/3548070511 learned_addr learned my addr 172.21.15.16:0/3548070511 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:43.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040b35a0 con 0x7fd40415d540 2023-11-28T17:39:43.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd40a1b4640 1 --2- 172.21.15.16:0/3548070511 >> v2:172.21.15.16:3300/0 conn(0x7fd4040cedf0 0x7fd404167fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4040b30d0 con 0x7fd4040cedf0 2023-11-28T17:39:43.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 -- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6dc159150 msgr2=0x7fa6dc15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6dc159150 0x7fa6dc15ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 -- 172.21.15.16:0/895918949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc0b3aa0 msgr2=0x7fa6dc14fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 -- 172.21.15.16:0/3844238568 wait complete. 2023-11-28T17:39:43.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 Processor -- start 2023-11-28T17:39:43.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494458354 0 0) 0x7fd4040b35a0 con 0x7fd40415d540 2023-11-28T17:39:43.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3f0003530 con 0x7fd40415d540 2023-11-28T17:39:43.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc0b3aa0 0x7fa6dc14fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fa6daffd640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc009420 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7f225492a640 1 Processor -- start 2023-11-28T17:39:43.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1136938419 0 0) 0x7fd3f0003530 con 0x7fd40415d540 2023-11-28T17:39:43.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 >> v2:172.21.15.16:3300/0 conn(0x7fd4040cedf0 msgr2=0x7fd404167fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 --2- 172.21.15.16:0/3548070511 >> v2:172.21.15.16:3300/0 conn(0x7fd4040cedf0 0x7fd404167fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 >> v1:172.21.15.16:6789/0 conn(0x7fd4040d1f50 legacy=0x7fd4040d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040b3880 con 0x7fd40415d540 2023-11-28T17:39:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7ff2cffff640 1 -- start start 2023-11-28T17:39:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.443+0000 7f225492a640 1 -- start start 2023-11-28T17:39:43.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6daffd640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 0x7fa6dc1535d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00ebe0 tx=0x7fa6cc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 <== mon.1 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7fd400001680 con 0x7fd40415d540 2023-11-28T17:39:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 >> v1:172.21.15.64:6789/0 conn(0x7fd40415d540 legacy=0x7fd4040b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd3f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3f00047d0 0x7fd3f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc00eee0 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f00051e0 0x7fd3f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fe855b01640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe83c003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009890 tx=0x7fe84c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a4864bfe47c1e95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4091b2640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3f00047d0 0x7fd3f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4099b3640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd3f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6cc00cc30 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6cc013470 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6d4009b30 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc0c6e90 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c0ab600 con 0x7fe83c003980 2023-11-28T17:39:43.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84c0a7050 con 0x7fe83c003980 2023-11-28T17:39:43.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fe854aff640 1 -- 172.21.15.16:0/740869213 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84c0aba00 con 0x7fe83c003980 2023-11-28T17:39:43.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd40a1b4640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f00051e0 0x7fd3f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000c0e0 con 0x7fd3f00051e0 2023-11-28T17:39:43.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000c250 con 0x7fd3f00047d0 2023-11-28T17:39:43.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f000c410 con 0x7fd3f00039a0 2023-11-28T17:39:43.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2cffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2d015bcf0 0x7ff2d0153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2ceffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2ceffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60322/0 (socket says 172.21.15.16:60322) 2023-11-28T17:39:43.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f225492a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f225015d4a0 0x7f22500d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc068860 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f225492a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f22500d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2ceffd640 1 -- 172.21.15.16:0/3359814475 learned_addr learned my addr 172.21.15.16:0/3359814475 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f224dd9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f225015d880 0x7f22500cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56732/0 (socket says 172.21.15.16:56732) 2023-11-28T17:39:43.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f224dd9b640 1 -- 172.21.15.16:0/3423587980 learned_addr learned my addr 172.21.15.16:0/3423587980 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:43.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2cffff640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d0161bf0 0x7ff2d01fd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2cffff640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0157910 con 0x7ff2d015bcf0 2023-11-28T17:39:43.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7ff2cffff640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0156c90 con 0x7ff2d0161bf0 2023-11-28T17:39:43.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f224ed9d640 1 --2- 172.21.15.16:0/3423587980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f22500d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22500ce7b0 con 0x7f225015d880 2023-11-28T17:39:43.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22500cea90 con 0x7f225015d4a0 2023-11-28T17:39:43.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22500ced70 con 0x7f22500cf850 2023-11-28T17:39:43.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7f224d59a640 1 -- 172.21.15.16:0/3423587980 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3836714438 0 0) 0x7f22500ce7b0 con 0x7f225015d880 2023-11-28T17:39:43.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7f224d59a640 1 -- 172.21.15.16:0/3423587980 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f223c003530 con 0x7f225015d880 2023-11-28T17:39:43.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d0161bf0 0x7ff2d01fd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cffff640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0156f70 con 0x7ff2d0071d10 2023-11-28T17:39:43.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa6cc0135d0 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 -- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 msgr2=0x7ff2d0154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 -- 172.21.15.16:0/3359814475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2d015bcf0 msgr2=0x7ff2d0153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2d015bcf0 0x7ff2d0153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c4009420 con 0x7ff2d0161bf0 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 -- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 msgr2=0x7fe83c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe83c003da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe84c009890 tx=0x7fe84c01c360 comp rx=0 tx=0).stop 2023-11-28T17:39:43.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4099b3640 1 -- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3f00047d0 msgr2=0x7fd3f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4099b3640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3f00047d0 0x7fd3f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4099b3640 1 -- 172.21.15.16:0/3548070511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f00051e0 msgr2=0x7fd3f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4099b3640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3f00051e0 0x7fd3f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.447+0000 7fd4099b3640 1 -- 172.21.15.16:0/3548070511 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4040b35a0 con 0x7fd3f00039a0 2023-11-28T17:39:43.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fa6c37fe640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa6c80669d0 0x7fa6c8068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cf7fe640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d0161bf0 0x7ff2d01fd980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000c3c0 tx=0x7ff2c000c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6cc084610 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 -- 172.21.15.16:0/740869213 shutdown_connections 2023-11-28T17:39:43.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 --2- 172.21.15.16:0/740869213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe83c003da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.478 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 -- 172.21.15.16:0/740869213 >> 172.21.15.16:0/740869213 conn(0x7fe85008cd20 msgr2=0x7fe85009c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fd40a1b4640 1 -- 172.21.15.16:0/3548070511 reap_dead start 2023-11-28T17:39:43.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c00052d0 con 0x7ff2d0161bf0 2023-11-28T17:39:43.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c0005430 con 0x7ff2d0161bf0 2023-11-28T17:39:43.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cffff640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d0157250 con 0x7ff2d0161bf0 2023-11-28T17:39:43.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0007260 con 0x7ff2d0161bf0 2023-11-28T17:39:43.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7ff2cffff640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d0156960 con 0x7ff2d0161bf0 2023-11-28T17:39:43.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 -- 172.21.15.16:0/740869213 shutdown_connections 2023-11-28T17:39:43.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7f224ed9d640 1 -- 172.21.15.16:0/3423587980 >> v2:172.21.15.16:3300/0 conn(0x7f225015d4a0 msgr2=0x7f22500d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:43.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7f224ed9d640 1 --2- 172.21.15.16:0/3423587980 >> v2:172.21.15.16:3300/0 conn(0x7f225015d4a0 0x7f22500d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7f224ed9d640 1 -- 172.21.15.16:0/3423587980 >> v1:172.21.15.64:6789/0 conn(0x7f225015d880 legacy=0x7f22500cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7f224ed9d640 1 -- 172.21.15.16:0/3423587980 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22500cf050 con 0x7f22500cf850 2023-11-28T17:39:43.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fa6da7fc640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa6c80669d0 0x7fa6c8068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.451+0000 7fe857d65640 1 -- 172.21.15.16:0/740869213 wait complete. 2023-11-28T17:39:43.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d004e890 con 0x7ff2d0161bf0 2023-11-28T17:39:43.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fd4099b3640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd3f0003de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd400007cb0 tx=0x7fd400027ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f299444c0e446cf3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fa6da7fc640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa6c80669d0 0x7fa6c8068e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0b5350 tx=0x7fa6d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400004ab0 con 0x7fd3f00039a0 2023-11-28T17:39:43.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff2c00073c0 con 0x7ff2d0161bf0 2023-11-28T17:39:43.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4000b5070 con 0x7fd3f00039a0 2023-11-28T17:39:43.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fd4089b1640 1 -- 172.21.15.16:0/3548070511 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd400004ab0 con 0x7fd3f00039a0 2023-11-28T17:39:43.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7f224ed9d640 1 --2- 172.21.15.16:0/3423587980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f22500d3070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2248009d90 tx=0x7f224801d3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c132b80fccdc79a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6cc051970 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7f224d59a640 1 -- 172.21.15.16:0/3423587980 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480a5920 con 0x7f22500cf850 2023-11-28T17:39:43.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fe857d65640 1 Processor -- start 2023-11-28T17:39:43.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7f224d59a640 1 -- 172.21.15.16:0/3423587980 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22480a5a80 con 0x7f22500cf850 2023-11-28T17:39:43.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7f224d59a640 1 -- 172.21.15.16:0/3423587980 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22480a5e10 con 0x7f22500cf850 2023-11-28T17:39:43.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fe857d65640 1 -- start start 2023-11-28T17:39:43.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 msgr2=0x7fd3f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7ff2b7fff640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff2bc0668d0 0x7ff2bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2c0083650 con 0x7ff2d0161bf0 2023-11-28T17:39:43.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.455+0000 7fd40bc17640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd3f0003de0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd400007cb0 tx=0x7fd400027ba0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7ff2ceffd640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff2bc0668d0 0x7ff2bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 msgr2=0x7f22500d3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 --2- 172.21.15.16:0/3423587980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f22500d3070 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2248009d90 tx=0x7f224801d3d0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 shutdown_connections 2023-11-28T17:39:43.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fd40bc17640 1 --2- 172.21.15.16:0/3548070511 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd3f0003de0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 >> 172.21.15.16:0/3548070511 conn(0x7fd40408ccf0 msgr2=0x7fd40409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe857d65640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe8501525a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 shutdown_connections 2023-11-28T17:39:43.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 --2- 172.21.15.16:0/3423587980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f22500d3070 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 --2- 172.21.15.16:0/3423587980 >> v2:172.21.15.16:3300/0 conn(0x7f225015d4a0 0x7f22500d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 >> 172.21.15.16:0/3423587980 conn(0x7f225008cd70 msgr2=0x7f225009c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7ff2ceffd640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff2bc0668d0 0x7ff2bc068d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8001570 tx=0x7ff2c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe857d65640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8500b5ea0 0x7fe85015fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 shutdown_connections 2023-11-28T17:39:43.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fd40bc17640 1 -- 172.21.15.16:0/3548070511 wait complete. 2023-11-28T17:39:43.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe855b01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe8501525a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe855b01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe8501525a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:54504/0 (socket says 172.21.15.16:54504) 2023-11-28T17:39:43.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe855b01640 1 -- 172.21.15.16:0/3372357879 learned_addr learned my addr 172.21.15.16:0/3372357879 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 shutdown_connections 2023-11-28T17:39:43.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8501600b0 0x7fe8500c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7f225492a640 1 -- 172.21.15.16:0/3423587980 wait complete. 2023-11-28T17:39:43.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe855300640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8500b5ea0 0x7fe85015fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe856302640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8501600b0 0x7fe8500c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850160530 con 0x7fe8501600b0 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850152ae0 con 0x7fe83c003980 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.459+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b8460 con 0x7fe8500b5ea0 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe856302640 1 -- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8500b5ea0 msgr2=0x7fe85015fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe856302640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8500b5ea0 0x7fe85015fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe856302640 1 -- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 msgr2=0x7fe8501525a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe856302640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe8501525a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe856302640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500b8740 con 0x7fe8501600b0 2023-11-28T17:39:43.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fd40bc17640 1 Processor -- start 2023-11-28T17:39:43.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe855b01640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe8501525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:43.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fd40bc17640 1 -- start start 2023-11-28T17:39:43.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff2c0050960 con 0x7ff2d0161bf0 2023-11-28T17:39:43.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe856302640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8501600b0 0x7fe8500c74e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8500d0e40 tx=0x7fe84800af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848007980 con 0x7fe8501600b0 2023-11-28T17:39:43.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7f225492a640 1 Processor -- start 2023-11-28T17:39:43.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fd40bc17640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd4040b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fd40bc17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 0x7fd40414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7f225492a640 1 -- start start 2023-11-28T17:39:43.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe848007b00 con 0x7fe8501600b0 2023-11-28T17:39:43.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8500b8a20 con 0x7fe8501600b0 2023-11-28T17:39:43.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8500b8fe0 con 0x7fe8501600b0 2023-11-28T17:39:43.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fd4099b3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd4040b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fd4099b3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd4040b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60348/0 (socket says 172.21.15.16:60348) 2023-11-28T17:39:43.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.463+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe848013630 con 0x7fe8501600b0 2023-11-28T17:39:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 0x7fd40414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 0x7fd40414e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48852/0 (socket says 172.21.15.16:48852) 2023-11-28T17:39:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4099b3640 1 -- 172.21.15.16:0/2268551633 learned_addr learned my addr 172.21.15.16:0/2268551633 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f225492a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f225015dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f225492a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f225015d4a0 0x7f225015c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f225492a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225015d880 0x7f2250150b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f225015dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f225015dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:60360/0 (socket says 172.21.15.16:60360) 2023-11-28T17:39:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 -- 172.21.15.16:0/571908159 learned_addr learned my addr 172.21.15.16:0/571908159 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:43.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd40415f830 0x7fd404156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224dd9b640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f225015d4a0 0x7f225015c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225015d0b0 con 0x7f225015d880 2023-11-28T17:39:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225015f570 con 0x7f225015d4a0 2023-11-28T17:39:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225015f810 con 0x7f22500cf850 2023-11-28T17:39:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 -- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f225015d4a0 msgr2=0x7f225015c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f225015d4a0 0x7f225015c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 -- 172.21.15.16:0/571908159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225015d880 msgr2=0x7f2250150b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225015d880 0x7f2250150b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248009a70 con 0x7f22500cf850 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040cd6c0 con 0x7fd40414e840 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40414e640 con 0x7fd40415f830 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40415e790 con 0x7fd3f00039a0 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd40a1b4640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd40415f830 0x7fd404156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 -- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 msgr2=0x7fd4040b19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd4040b19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 -- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd40415f830 msgr2=0x7fd404156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd40415f830 0x7fd404156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40415ea70 con 0x7fd40414e840 2023-11-28T17:39:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4099b3640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd4040b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd4091b2640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 0x7fd40414e100 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007fd0 tx=0x7fd3f400f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7f224e59c640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f225015dd10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f223800b580 tx=0x7f223800ba40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238010870 con 0x7f22500cf850 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe838005260 con 0x7fe8501600b0 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.467+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40053e0 con 0x7fd40414e840 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40415ed50 con 0x7fd40414e840 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40415f310 con 0x7fd40414e840 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22380109d0 con 0x7f22500cf850 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2238010d60 con 0x7f22500cf850 2023-11-28T17:39:43.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f225015faf0 con 0x7f22500cf850 2023-11-28T17:39:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe848013790 con 0x7fe8501600b0 2023-11-28T17:39:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7fe8467fc640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8340669d0 0x7fe834068e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe848084730 con 0x7fe8501600b0 2023-11-28T17:39:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f4007030 con 0x7fd40414e840 2023-11-28T17:39:43.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec005260 con 0x7fd40414e840 2023-11-28T17:39:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.471+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22501600b0 con 0x7f22500cf850 2023-11-28T17:39:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f225015aca0 con 0x7f22500cf850 2023-11-28T17:39:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7fe855b01640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8340669d0 0x7fe834068e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f223800f3c0 con 0x7f22500cf850 2023-11-28T17:39:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f40053e0 con 0x7fd40414e840 2023-11-28T17:39:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd3f40071a0 con 0x7fd40414e840 2023-11-28T17:39:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7f2246ffd640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2230066920 0x7f2230068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7fd3fa7fc640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3e8066930 0x7fd3e8068df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3f4083800 con 0x7fd40414e840 2023-11-28T17:39:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2238083810 con 0x7f22500cf850 2023-11-28T17:39:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.475+0000 7f224dd9b640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2230066920 0x7f2230068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.479+0000 7fe855b01640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8340669d0 0x7fe834068e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe84c01c3a0 tx=0x7fe84c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.479+0000 7f224dd9b640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2230066920 0x7f2230068de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22500d20d0 tx=0x7f2240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.479+0000 7fd4099b3640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3e8066930 0x7fd3e8068df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.479+0000 7fd4099b3640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3e8066930 0x7fd3e8068df0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c10 tx=0x7fd4000b3000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:43.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.479+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f22380b8280 con 0x7f22500cf850 2023-11-28T17:39:43.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.483+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8480519e0 con 0x7fe8501600b0 2023-11-28T17:39:43.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.491+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3f4050ae0 con 0x7fd40414e840 2023-11-28T17:39:43.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.659+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fdc6804e890 con 0x7fdc68159540 2023-11-28T17:39:43.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.667+0000 7fdc5e7fc640 1 -- 172.21.15.16:0/989420938 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdc600eedb0 con 0x7fdc68159540 2023-11-28T17:39:43.672 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2023-11-28T17:39:43.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc4c0668d0 msgr2=0x7fdc4c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc4c0668d0 0x7fdc4c068d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc64009d80 tx=0x7fdc64009190 comp rx=0 tx=0).stop 2023-11-28T17:39:43.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc68159540 msgr2=0x7fdc681599b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc68159540 0x7fdc681599b0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdc600af000 tx=0x7fdc6001b9e0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 shutdown_connections 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc68159540 0x7fdc681599b0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc680cbfb0 0x7fdc6815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc4c0668d0 0x7fdc4c068d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 --2- 172.21.15.16:0/989420938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc68072010 0x7fdc6814c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.671+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 >> 172.21.15.16:0/989420938 conn(0x7fdc6806a5a0 msgr2=0x7fdc6806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.675+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 shutdown_connections 2023-11-28T17:39:43.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.675+0000 7fdc70079640 1 -- 172.21.15.16:0/989420938 wait complete. 2023-11-28T17:39:43.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.707+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbb3c158660 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.707+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe2600cecd0 con 0x7fe26006d870 2023-11-28T17:39:43.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.707+0000 7fbb237fe640 1 -- 172.21.15.16:0/4125969175 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb34019020 con 0x7fbb3c0b2a10 2023-11-28T17:39:43.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.707+0000 7fe2477fe640 1 -- 172.21.15.16:0/3874328199 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe250054970 con 0x7fe26006d870 2023-11-28T17:39:43.711 INFO:teuthology.orchestra.run.smithi016.stdout:64424509446 2023-11-28T17:39:43.712 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2023-11-28T17:39:43.713 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.0 2023-11-28T17:39:43.713 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fbb280669d0 msgr2=0x7fbb28068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fbb280669d0 0x7fbb28068e90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c005890 tx=0x7fbb2c009040 comp rx=0 tx=0).stop 2023-11-28T17:39:43.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 msgr2=0x7fbb3c13b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 0x7fbb3c13b960 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400b9e0 tx=0x7fbb3400bea0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 shutdown_connections 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fbb3c1439e0 0x7fbb3c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fbb3c0b2a10 0x7fbb3c13b960 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fbb280669d0 0x7fbb28068e90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 --2- 172.21.15.16:0/4125969175 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbb3c06c630 0x7fbb3c157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 >> 172.21.15.16:0/4125969175 conn(0x7fbb3c06a5a0 msgr2=0x7fbb3c06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 shutdown_connections 2023-11-28T17:39:43.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fbb4178d640 1 -- 172.21.15.16:0/4125969175 wait complete. 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe24c0669a0 msgr2=0x7fe24c068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe24c0669a0 0x7fe24c068e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe26015cc90 tx=0x7fe254009240 comp rx=0 tx=0).stop 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 msgr2=0x7fe26014ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26014ba20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe25000b410 tx=0x7fe25000b8d0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 shutdown_connections 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe26015d6a0 0x7fe260154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe26006e870 0x7fe260202810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe24c0669a0 0x7fe24c068e60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 --2- 172.21.15.16:0/3874328199 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe26006d870 0x7fe26014ba20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 >> 172.21.15.16:0/3874328199 conn(0x7fe2600cefa0 msgr2=0x7fe2600aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 shutdown_connections 2023-11-28T17:39:43.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.711+0000 7fe26511d640 1 -- 172.21.15.16:0/3874328199 wait complete. 2023-11-28T17:39:43.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.2 2023-11-28T17:39:43.751 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.752 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509446 for osd.3 2023-11-28T17:39:43.752 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.759+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fd3ec005510 con 0x7fd40414e840 2023-11-28T17:39:43.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.759+0000 7fd3fa7fc640 1 -- 172.21.15.16:0/2268551633 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd3f4054100 con 0x7fd40414e840 2023-11-28T17:39:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:64424509448 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3e8066930 msgr2=0x7fd3e8068df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3e8066930 0x7fd3e8068df0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd400000c10 tx=0x7fd4000b3000 comp rx=0 tx=0).stop 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 msgr2=0x7fd40414e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 0x7fd40414e100 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007fd0 tx=0x7fd3f400f980 comp rx=0 tx=0).stop 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 shutdown_connections 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3e8066930 0x7fd3e8068df0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd40415f830 0x7fd404156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd40414e840 0x7fd40414e100 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007fd0 tx=0x7fd3f400f980 comp rx=0 tx=0).stop 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 --2- 172.21.15.16:0/2268551633 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3f00039a0 0x7fd4040b19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 >> 172.21.15.16:0/2268551633 conn(0x7fd40408ccf0 msgr2=0x7fd40415b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 shutdown_connections 2023-11-28T17:39:43.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.763+0000 7fd40bc17640 1 -- 172.21.15.16:0/2268551633 wait complete. 2023-11-28T17:39:43.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509448 for osd.5 2023-11-28T17:39:43.790 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa6dc163ed0 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6c37fe640 1 -- 172.21.15.16:0/895918949 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6cc054f90 con 0x7fa6dc0b2d80 2023-11-28T17:39:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2023-11-28T17:39:43.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa6c80669d0 msgr2=0x7fa6c8068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa6c80669d0 0x7fa6c8068e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc0b5350 tx=0x7fa6d0009190 comp rx=0 tx=0).stop 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 msgr2=0x7fa6dc1535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 0x7fa6dc1535d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc00ebe0 tx=0x7fa6cc00c520 comp rx=0 tx=0).stop 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 shutdown_connections 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa6c80669d0 0x7fa6c8068e90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6dc159150 0x7fa6dc15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6dc0b3aa0 0x7fa6dc14fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 --2- 172.21.15.16:0/895918949 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6dc0b2d80 0x7fa6dc1535d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 >> 172.21.15.16:0/895918949 conn(0x7fa6dc0b2260 msgr2=0x7fa6dc0b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 shutdown_connections 2023-11-28T17:39:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fa6e17b8640 1 -- 172.21.15.16:0/895918949 wait complete. 2023-11-28T17:39:43.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.791+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe838005510 con 0x7fe8501600b0 2023-11-28T17:39:43.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe8467fc640 1 -- 172.21.15.16:0/3372357879 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe848055000 con 0x7fe8501600b0 2023-11-28T17:39:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2023-11-28T17:39:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8340669d0 msgr2=0x7fe834068e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8340669d0 0x7fe834068e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe84c01c3a0 tx=0x7fe84c008040 comp rx=0 tx=0).stop 2023-11-28T17:39:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8501600b0 msgr2=0x7fe8500c74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8501600b0 0x7fe8500c74e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe8500d0e40 tx=0x7fe84800af40 comp rx=0 tx=0).stop 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 shutdown_connections 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8501600b0 0x7fe8500c74e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8500b5ea0 0x7fe85015fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8340669d0 0x7fe834068e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 --2- 172.21.15.16:0/3372357879 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe83c003980 0x7fe8501525a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 >> 172.21.15.16:0/3372357879 conn(0x7fe85008cd20 msgr2=0x7fe8500b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 shutdown_connections 2023-11-28T17:39:43.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.795+0000 7fe857d65640 1 -- 172.21.15.16:0/3372357879 wait complete. 2023-11-28T17:39:43.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.799+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff2d00713e0 con 0x7ff2d0161bf0 2023-11-28T17:39:43.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b7fff640 1 -- 172.21.15.16:0/3359814475 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff2c0053f80 con 0x7ff2d0161bf0 2023-11-28T17:39:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:64424509447 2023-11-28T17:39:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff2bc0668d0 msgr2=0x7ff2bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff2bc0668d0 0x7ff2bc068d90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8001570 tx=0x7ff2c8009040 comp rx=0 tx=0).stop 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d0161bf0 msgr2=0x7ff2d01fd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d0161bf0 0x7ff2d01fd980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000c3c0 tx=0x7ff2c000c880 comp rx=0 tx=0).stop 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 shutdown_connections 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff2bc0668d0 0x7ff2bc068d90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d0161bf0 0x7ff2d01fd980 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff2d015bcf0 0x7ff2d0153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 --2- 172.21.15.16:0/3359814475 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff2d0071d10 0x7ff2d0154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.803+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 >> 172.21.15.16:0/3359814475 conn(0x7ff2d006a5a0 msgr2=0x7ff2d006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.807+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 shutdown_connections 2023-11-28T17:39:43.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.807+0000 7ff2b5ffb640 1 -- 172.21.15.16:0/3359814475 wait complete. 2023-11-28T17:39:43.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.811+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2250067530 con 0x7f22500cf850 2023-11-28T17:39:43.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f2246ffd640 1 -- 172.21.15.16:0/571908159 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22380544e0 con 0x7f22500cf850 2023-11-28T17:39:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:60129542152 2023-11-28T17:39:43.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2230066920 msgr2=0x7f2230068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2230066920 0x7f2230068de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22500d20d0 tx=0x7f2240009040 comp rx=0 tx=0).stop 2023-11-28T17:39:43.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 msgr2=0x7f225015dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:43.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f225015dd10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f223800b580 tx=0x7f223800ba40 comp rx=0 tx=0).stop 2023-11-28T17:39:43.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 shutdown_connections 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f225015d880 0x7f2250150b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2230066920 0x7f2230068de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f225015d4a0 0x7f225015c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 --2- 172.21.15.16:0/571908159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22500cf850 0x7f225015dd10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 >> 172.21.15.16:0/571908159 conn(0x7f225008cd70 msgr2=0x7f2250156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 shutdown_connections 2023-11-28T17:39:43.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:43.815+0000 7f225492a640 1 -- 172.21.15.16:0/571908159 wait complete. 2023-11-28T17:39:43.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.4 2023-11-28T17:39:43.824 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.1 2023-11-28T17:39:43.825 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.835 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509447 for osd.6 2023-11-28T17:39:43.835 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.840 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2023-11-28T17:39:43.840 DEBUG:teuthology.parallel:result is None 2023-11-28T17:39:43.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T17:39:43.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:39:44.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 Processor -- start 2023-11-28T17:39:44.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 -- start start 2023-11-28T17:39:44.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac0d1f50 0x7f1fac0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1fac0d34c0 0x7f1fac0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0b32c0 con 0x7f1fac15d540 2023-11-28T17:39:44.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac0b30d0 con 0x7f1fac0d34c0 2023-11-28T17:39:44.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb47aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac15d920 con 0x7f1fac0d1f50 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb1d45640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac0d1f50 0x7f1fac0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2d47640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1fac0d34c0 0x7f1fac0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2546640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1fac15d540 0x7f1fac0b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56738/0 (socket says 172.21.15.16:56738) 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2546640 1 -- 172.21.15.16:0/1750726920 learned_addr learned my addr 172.21.15.16:0/1750726920 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb1544640 1 -- 172.21.15.16:0/1750726920 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238018484 0 0) 0x7f1fac0b32c0 con 0x7f1fac15d540 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2d47640 1 -- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac0d1f50 msgr2=0x7f1fac0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2d47640 1 --2- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac0d1f50 0x7f1fac0d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2d47640 1 -- 172.21.15.16:0/1750726920 >> v1:172.21.15.64:6789/0 conn(0x7f1fac15d540 legacy=0x7f1fac0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb2d47640 1 -- 172.21.15.16:0/1750726920 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0b35a0 con 0x7f1fac0d34c0 2023-11-28T17:39:44.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.027+0000 7f1fb1d45640 1 --2- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac0d1f50 0x7f1fac0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:44.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb2d47640 1 --2- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d34c0 0x7f1fac0cdde0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009dc0 tx=0x7f1fa401c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db88c7ac73d55c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb1544640 1 -- 172.21.15.16:0/1750726920 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40a59c0 con 0x7f1fac0d34c0 2023-11-28T17:39:44.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb1544640 1 -- 172.21.15.16:0/1750726920 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40a5b20 con 0x7f1fac0d34c0 2023-11-28T17:39:44.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb1544640 1 -- 172.21.15.16:0/1750726920 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40ad440 con 0x7f1fac0d34c0 2023-11-28T17:39:44.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb47aa640 1 -- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d34c0 msgr2=0x7f1fac0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d34c0 0x7f1fac0cdde0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009dc0 tx=0x7f1fa401c900 comp rx=0 tx=0).stop 2023-11-28T17:39:44.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb47aa640 1 -- 172.21.15.16:0/1750726920 shutdown_connections 2023-11-28T17:39:44.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d34c0 0x7f1fac0cdde0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/1750726920 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac0d1f50 0x7f1fac0d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.031+0000 7f1fb47aa640 1 -- 172.21.15.16:0/1750726920 >> 172.21.15.16:0/1750726920 conn(0x7f1fac08ccf0 msgr2=0x7f1fac09c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:44.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 -- 172.21.15.16:0/1750726920 shutdown_connections 2023-11-28T17:39:44.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 -- 172.21.15.16:0/1750726920 wait complete. 2023-11-28T17:39:44.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 Processor -- start 2023-11-28T17:39:44.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 -- start start 2023-11-28T17:39:44.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d1f50 0x7f1fac15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 0x7f1fac15e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac15d540 0x7f1fac1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac15f130 con 0x7f1fac0d34c0 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0cbac0 con 0x7f1fac0d1f50 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb47aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac15eb70 con 0x7f1fac15d540 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 0x7f1fac15e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 0x7f1fac15e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48864/0 (socket says 172.21.15.16:48864) 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 -- 172.21.15.16:0/4141392650 learned_addr learned my addr 172.21.15.16:0/4141392650 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb2546640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d1f50 0x7f1fac15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb2d47640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac15d540 0x7f1fac1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 -- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac15d540 msgr2=0x7f1fac1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac15d540 0x7f1fac1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 -- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d1f50 msgr2=0x7f1fac15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d1f50 0x7f1fac15ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 -- 172.21.15.16:0/4141392650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9c009420 con 0x7f1fac0d34c0 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb2546640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d1f50 0x7f1fac15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:44.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.035+0000 7f1fb1d45640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 0x7f1fac15e190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00ea00 tx=0x7f1f9c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c00ca60 con 0x7f1fac0d34c0 2023-11-28T17:39:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c00cbc0 con 0x7f1fac0d34c0 2023-11-28T17:39:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c013470 con 0x7f1fac0d34c0 2023-11-28T17:39:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa4009a70 con 0x7f1fac0d34c0 2023-11-28T17:39:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac0cb6e0 con 0x7f1fac0d34c0 2023-11-28T17:39:44.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac0cb540 con 0x7f1fac0d34c0 2023-11-28T17:39:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1f9c0135d0 con 0x7f1fac0d34c0 2023-11-28T17:39:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fa2ffd640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f900668d0 0x7f1f90068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f9c084420 con 0x7f1fac0d34c0 2023-11-28T17:39:44.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.039+0000 7f1fb2546640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f900668d0 0x7f1f90068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.043+0000 7f1fb2546640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f900668d0 0x7f1f90068d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f70 tx=0x7f1fa8007cd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.043+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fac0cb540 con 0x7f1fac0d34c0 2023-11-28T17:39:44.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.195+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1fac0d38f0 con 0x7f1f900668d0 2023-11-28T17:39:44.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.203+0000 7f1fa2ffd640 1 -- 172.21.15.16:0/4141392650 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7f1fa80073a0 con 0x7f1f900668d0 2023-11-28T17:39:44.210 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:44.212 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f900668d0 msgr2=0x7f1f90068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f900668d0 0x7f1f90068d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8000f70 tx=0x7f1fa8007cd0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 msgr2=0x7f1fac15e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 0x7f1fac15e190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00ea00 tx=0x7f1f9c00eec0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 shutdown_connections 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fac15d540 0x7f1fac1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fac0d34c0 0x7f1fac15e190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1f900668d0 0x7f1f90068d90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 --2- 172.21.15.16:0/4141392650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fac0d1f50 0x7f1fac15ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 >> 172.21.15.16:0/4141392650 conn(0x7f1fac08ccf0 msgr2=0x7f1fac0b4360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:44.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 shutdown_connections 2023-11-28T17:39:44.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.207+0000 7f1fb47aa640 1 -- 172.21.15.16:0/4141392650 wait complete. 2023-11-28T17:39:44.230 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-28T17:39:42.766886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231624,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743096,"statfs":{"total":773094113280,"available":772856930304,"internally_reserved":0,"allocated":3022848,"data_stored":1795572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450114+0000","last_change":"2023-11-28T17:39:35.076736+0000","last_active":"2023-11-28T17:39:36.450114+0000","last_peered":"2023-11-28T17:39:36.450114+0000","last_clean":"2023-11-28T17:39:36.450114+0000","last_became_active":"2023-11-28T17:39:35.076314+0000","last_became_peered":"2023-11-28T17:39:35.076314+0000","last_unstale":"2023-11-28T17:39:36.450114+0000","last_undegraded":"2023-11-28T17:39:36.450114+0000","last_fullsized":"2023-11-28T17:39:36.450114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050954+0000","last_change":"2023-11-28T17:39:35.074659+0000","last_active":"2023-11-28T17:39:36.050954+0000","last_peered":"2023-11-28T17:39:36.050954+0000","last_clean":"2023-11-28T17:39:36.050954+0000","last_became_active":"2023-11-28T17:39:35.074240+0000","last_became_peered":"2023-11-28T17:39:35.074240+0000","last_unstale":"2023-11-28T17:39:36.050954+0000","last_undegraded":"2023-11-28T17:39:36.050954+0000","last_fullsized":"2023-11-28T17:39:36.050954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050415+0000","last_change":"2023-11-28T17:39:35.072116+0000","last_active":"2023-11-28T17:39:36.050415+0000","last_peered":"2023-11-28T17:39:36.050415+0000","last_clean":"2023-11-28T17:39:36.050415+0000","last_became_active":"2023-11-28T17:39:35.071687+0000","last_became_peered":"2023-11-28T17:39:35.071687+0000","last_unstale":"2023-11-28T17:39:36.050415+0000","last_undegraded":"2023-11-28T17:39:36.050415+0000","last_fullsized":"2023-11-28T17:39:36.050415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.064075+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.063682+0000","last_became_peered":"2023-11-28T17:39:35.063682+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448696+0000","last_change":"2023-11-28T17:39:35.077549+0000","last_active":"2023-11-28T17:39:36.448696+0000","last_peered":"2023-11-28T17:39:36.448696+0000","last_clean":"2023-11-28T17:39:36.448696+0000","last_became_active":"2023-11-28T17:39:35.077185+0000","last_became_peered":"2023-11-28T17:39:35.077185+0000","last_unstale":"2023-11-28T17:39:36.448696+0000","last_undegraded":"2023-11-28T17:39:36.448696+0000","last_fullsized":"2023-11-28T17:39:36.448696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049692+0000","last_change":"2023-11-28T17:39:35.057293+0000","last_active":"2023-11-28T17:39:36.049692+0000","last_peered":"2023-11-28T17:39:36.049692+0000","last_clean":"2023-11-28T17:39:36.049692+0000","last_became_active":"2023-11-28T17:39:35.057018+0000","last_became_peered":"2023-11-28T17:39:35.057018+0000","last_unstale":"2023-11-28T17:39:36.049692+0000","last_undegraded":"2023-11-28T17:39:36.049692+0000","last_fullsized":"2023-11-28T17:39:36.049692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:49.748812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448373+0000","last_change":"2023-11-28T17:39:35.068482+0000","last_active":"2023-11-28T17:39:36.448373+0000","last_peered":"2023-11-28T17:39:36.448373+0000","last_clean":"2023-11-28T17:39:36.448373+0000","last_became_active":"2023-11-28T17:39:35.066863+0000","last_became_peered":"2023-11-28T17:39:35.066863+0000","last_unstale":"2023-11-28T17:39:36.448373+0000","last_undegraded":"2023-11-28T17:39:36.448373+0000","last_fullsized":"2023-11-28T17:39:36.448373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051099+0000","last_change":"2023-11-28T17:39:35.085078+0000","last_active":"2023-11-28T17:39:36.051099+0000","last_peered":"2023-11-28T17:39:36.051099+0000","last_clean":"2023-11-28T17:39:36.051099+0000","last_became_active":"2023-11-28T17:39:35.084745+0000","last_became_peered":"2023-11-28T17:39:35.084745+0000","last_unstale":"2023-11-28T17:39:36.051099+0000","last_undegraded":"2023-11-28T17:39:36.051099+0000","last_fullsized":"2023-11-28T17:39:36.051099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449706+0000","last_change":"2023-11-28T17:39:35.080106+0000","last_active":"2023-11-28T17:39:36.449706+0000","last_peered":"2023-11-28T17:39:36.449706+0000","last_clean":"2023-11-28T17:39:36.449706+0000","last_became_active":"2023-11-28T17:39:35.079816+0000","last_became_peered":"2023-11-28T17:39:35.079816+0000","last_unstale":"2023-11-28T17:39:36.449706+0000","last_undegraded":"2023-11-28T17:39:36.449706+0000","last_fullsized":"2023-11-28T17:39:36.449706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450080+0000","last_change":"2023-11-28T17:39:35.074439+0000","last_active":"2023-11-28T17:39:36.450080+0000","last_peered":"2023-11-28T17:39:36.450080+0000","last_clean":"2023-11-28T17:39:36.450080+0000","last_became_active":"2023-11-28T17:39:35.073858+0000","last_became_peered":"2023-11-28T17:39:35.073858+0000","last_unstale":"2023-11-28T17:39:36.450080+0000","last_undegraded":"2023-11-28T17:39:36.450080+0000","last_fullsized":"2023-11-28T17:39:36.450080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450026+0000","last_change":"2023-11-28T17:39:35.070060+0000","last_active":"2023-11-28T17:39:36.450026+0000","last_peered":"2023-11-28T17:39:36.450026+0000","last_clean":"2023-11-28T17:39:36.450026+0000","last_became_active":"2023-11-28T17:39:35.069384+0000","last_became_peered":"2023-11-28T17:39:35.069384+0000","last_unstale":"2023-11-28T17:39:36.450026+0000","last_undegraded":"2023-11-28T17:39:36.450026+0000","last_fullsized":"2023-11-28T17:39:36.450026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449873+0000","last_change":"2023-11-28T17:39:35.082371+0000","last_active":"2023-11-28T17:39:36.449873+0000","last_peered":"2023-11-28T17:39:36.449873+0000","last_clean":"2023-11-28T17:39:36.449873+0000","last_became_active":"2023-11-28T17:39:35.081668+0000","last_became_peered":"2023-11-28T17:39:35.081668+0000","last_unstale":"2023-11-28T17:39:36.449873+0000","last_undegraded":"2023-11-28T17:39:36.449873+0000","last_fullsized":"2023-11-28T17:39:36.449873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312169+0000","last_change":"2023-11-28T17:39:35.082173+0000","last_active":"2023-11-28T17:39:36.312169+0000","last_peered":"2023-11-28T17:39:36.312169+0000","last_clean":"2023-11-28T17:39:36.312169+0000","last_became_active":"2023-11-28T17:39:35.080696+0000","last_became_peered":"2023-11-28T17:39:35.080696+0000","last_unstale":"2023-11-28T17:39:36.312169+0000","last_undegraded":"2023-11-28T17:39:36.312169+0000","last_fullsized":"2023-11-28T17:39:36.312169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311941+0000","last_change":"2023-11-28T17:39:35.080498+0000","last_active":"2023-11-28T17:39:36.311941+0000","last_peered":"2023-11-28T17:39:36.311941+0000","last_clean":"2023-11-28T17:39:36.311941+0000","last_became_active":"2023-11-28T17:39:35.080163+0000","last_became_peered":"2023-11-28T17:39:35.080163+0000","last_unstale":"2023-11-28T17:39:36.311941+0000","last_undegraded":"2023-11-28T17:39:36.311941+0000","last_fullsized":"2023-11-28T17:39:36.311941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051297+0000","last_change":"2023-11-28T17:39:35.084970+0000","last_active":"2023-11-28T17:39:36.051297+0000","last_peered":"2023-11-28T17:39:36.051297+0000","last_clean":"2023-11-28T17:39:36.051297+0000","last_became_active":"2023-11-28T17:39:35.084639+0000","last_became_peered":"2023-11-28T17:39:35.084639+0000","last_unstale":"2023-11-28T17:39:36.051297+0000","last_undegraded":"2023-11-28T17:39:36.051297+0000","last_fullsized":"2023-11-28T17:39:36.051297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449523+0000","last_change":"2023-11-28T17:39:35.072393+0000","last_active":"2023-11-28T17:39:36.449523+0000","last_peered":"2023-11-28T17:39:36.449523+0000","last_clean":"2023-11-28T17:39:36.449523+0000","last_became_active":"2023-11-28T17:39:35.071917+0000","last_became_peered":"2023-11-28T17:39:35.071917+0000","last_unstale":"2023-11-28T17:39:36.449523+0000","last_undegraded":"2023-11-28T17:39:36.449523+0000","last_fullsized":"2023-11-28T17:39:36.449523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:09.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449618+0000","last_change":"2023-11-28T17:39:35.080914+0000","last_active":"2023-11-28T17:39:36.449618+0000","last_peered":"2023-11-28T17:39:36.449618+0000","last_clean":"2023-11-28T17:39:36.449618+0000","last_became_active":"2023-11-28T17:39:35.080586+0000","last_became_peered":"2023-11-28T17:39:35.080586+0000","last_unstale":"2023-11-28T17:39:36.449618+0000","last_undegraded":"2023-11-28T17:39:36.449618+0000","last_fullsized":"2023-11-28T17:39:36.449618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:14:15.208179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050843+0000","last_change":"2023-11-28T17:39:35.077623+0000","last_active":"2023-11-28T17:39:36.050843+0000","last_peered":"2023-11-28T17:39:36.050843+0000","last_clean":"2023-11-28T17:39:36.050843+0000","last_became_active":"2023-11-28T17:39:35.077222+0000","last_became_peered":"2023-11-28T17:39:35.077222+0000","last_unstale":"2023-11-28T17:39:36.050843+0000","last_undegraded":"2023-11-28T17:39:36.050843+0000","last_fullsized":"2023-11-28T17:39:36.050843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:09.304093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449521+0000","last_change":"2023-11-28T17:39:35.067332+0000","last_active":"2023-11-28T17:39:36.449521+0000","last_peered":"2023-11-28T17:39:36.449521+0000","last_clean":"2023-11-28T17:39:36.449521+0000","last_became_active":"2023-11-28T17:39:35.066983+0000","last_became_peered":"2023-11-28T17:39:35.066983+0000","last_unstale":"2023-11-28T17:39:36.449521+0000","last_undegraded":"2023-11-28T17:39:36.449521+0000","last_fullsized":"2023-11-28T17:39:36.449521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:25.743991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449930+0000","last_change":"2023-11-28T17:39:35.082580+0000","last_active":"2023-11-28T17:39:36.449930+0000","last_peered":"2023-11-28T17:39:36.449930+0000","last_clean":"2023-11-28T17:39:36.449930+0000","last_became_active":"2023-11-28T17:39:35.082091+0000","last_became_peered":"2023-11-28T17:39:35.082091+0000","last_unstale":"2023-11-28T17:39:36.449930+0000","last_undegraded":"2023-11-28T17:39:36.449930+0000","last_fullsized":"2023-11-28T17:39:36.449930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448106+0000","last_change":"2023-11-28T17:39:35.055626+0000","last_active":"2023-11-28T17:39:36.448106+0000","last_peered":"2023-11-28T17:39:36.448106+0000","last_clean":"2023-11-28T17:39:36.448106+0000","last_became_active":"2023-11-28T17:39:35.055320+0000","last_became_peered":"2023-11-28T17:39:35.055320+0000","last_unstale":"2023-11-28T17:39:36.448106+0000","last_undegraded":"2023-11-28T17:39:36.448106+0000","last_fullsized":"2023-11-28T17:39:36.448106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449446+0000","last_change":"2023-11-28T17:39:35.065869+0000","last_active":"2023-11-28T17:39:36.449446+0000","last_peered":"2023-11-28T17:39:36.449446+0000","last_clean":"2023-11-28T17:39:36.449446+0000","last_became_active":"2023-11-28T17:39:35.065570+0000","last_became_peered":"2023-11-28T17:39:35.065570+0000","last_unstale":"2023-11-28T17:39:36.449446+0000","last_undegraded":"2023-11-28T17:39:36.449446+0000","last_fullsized":"2023-11-28T17:39:36.449446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051520+0000","last_change":"2023-11-28T17:39:35.072179+0000","last_active":"2023-11-28T17:39:36.051520+0000","last_peered":"2023-11-28T17:39:36.051520+0000","last_clean":"2023-11-28T17:39:36.051520+0000","last_became_active":"2023-11-28T17:39:35.071851+0000","last_became_peered":"2023-11-28T17:39:35.071851+0000","last_unstale":"2023-11-28T17:39:36.051520+0000","last_undegraded":"2023-11-28T17:39:36.051520+0000","last_fullsized":"2023-11-28T17:39:36.051520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449666+0000","last_change":"2023-11-28T17:39:35.072638+0000","last_active":"2023-11-28T17:39:36.449666+0000","last_peered":"2023-11-28T17:39:36.449666+0000","last_clean":"2023-11-28T17:39:36.449666+0000","last_became_active":"2023-11-28T17:39:35.072144+0000","last_became_peered":"2023-11-28T17:39:35.072144+0000","last_unstale":"2023-11-28T17:39:36.449666+0000","last_undegraded":"2023-11-28T17:39:36.449666+0000","last_fullsized":"2023-11-28T17:39:36.449666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:58.098189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050465+0000","last_change":"2023-11-28T17:39:35.079771+0000","last_active":"2023-11-28T17:39:36.050465+0000","last_peered":"2023-11-28T17:39:36.050465+0000","last_clean":"2023-11-28T17:39:36.050465+0000","last_became_active":"2023-11-28T17:39:35.079423+0000","last_became_peered":"2023-11-28T17:39:35.079423+0000","last_unstale":"2023-11-28T17:39:36.050465+0000","last_undegraded":"2023-11-28T17:39:36.050465+0000","last_fullsized":"2023-11-28T17:39:36.050465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049922+0000","last_change":"2023-11-28T17:39:35.073441+0000","last_active":"2023-11-28T17:39:36.049922+0000","last_peered":"2023-11-28T17:39:36.049922+0000","last_clean":"2023-11-28T17:39:36.049922+0000","last_became_active":"2023-11-28T17:39:35.072851+0000","last_became_peered":"2023-11-28T17:39:35.072851+0000","last_unstale":"2023-11-28T17:39:36.049922+0000","last_undegraded":"2023-11-28T17:39:36.049922+0000","last_fullsized":"2023-11-28T17:39:36.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312430+0000","last_change":"2023-11-28T17:39:35.079706+0000","last_active":"2023-11-28T17:39:36.312430+0000","last_peered":"2023-11-28T17:39:36.312430+0000","last_clean":"2023-11-28T17:39:36.312430+0000","last_became_active":"2023-11-28T17:39:35.079231+0000","last_became_peered":"2023-11-28T17:39:35.079231+0000","last_unstale":"2023-11-28T17:39:36.312430+0000","last_undegraded":"2023-11-28T17:39:36.312430+0000","last_fullsized":"2023-11-28T17:39:36.312430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312261+0000","last_change":"2023-11-28T17:39:35.078579+0000","last_active":"2023-11-28T17:39:36.312261+0000","last_peered":"2023-11-28T17:39:36.312261+0000","last_clean":"2023-11-28T17:39:36.312261+0000","last_became_active":"2023-11-28T17:39:35.078259+0000","last_became_peered":"2023-11-28T17:39:35.078259+0000","last_unstale":"2023-11-28T17:39:36.312261+0000","last_undegraded":"2023-11-28T17:39:36.312261+0000","last_fullsized":"2023-11-28T17:39:36.312261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050907+0000","last_change":"2023-11-28T17:39:35.082408+0000","last_active":"2023-11-28T17:39:36.050907+0000","last_peered":"2023-11-28T17:39:36.050907+0000","last_clean":"2023-11-28T17:39:36.050907+0000","last_became_active":"2023-11-28T17:39:35.082098+0000","last_became_peered":"2023-11-28T17:39:35.082098+0000","last_unstale":"2023-11-28T17:39:36.050907+0000","last_undegraded":"2023-11-28T17:39:36.050907+0000","last_fullsized":"2023-11-28T17:39:36.050907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449034+0000","last_change":"2023-11-28T17:39:35.079528+0000","last_active":"2023-11-28T17:39:36.449034+0000","last_peered":"2023-11-28T17:39:36.449034+0000","last_clean":"2023-11-28T17:39:36.449034+0000","last_became_active":"2023-11-28T17:39:35.079243+0000","last_became_peered":"2023-11-28T17:39:35.079243+0000","last_unstale":"2023-11-28T17:39:36.449034+0000","last_undegraded":"2023-11-28T17:39:36.449034+0000","last_fullsized":"2023-11-28T17:39:36.449034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050194+0000","last_change":"2023-11-28T17:39:35.078211+0000","last_active":"2023-11-28T17:39:36.050194+0000","last_peered":"2023-11-28T17:39:36.050194+0000","last_clean":"2023-11-28T17:39:36.050194+0000","last_became_active":"2023-11-28T17:39:35.077631+0000","last_became_peered":"2023-11-28T17:39:35.077631+0000","last_unstale":"2023-11-28T17:39:36.050194+0000","last_undegraded":"2023-11-28T17:39:36.050194+0000","last_fullsized":"2023-11-28T17:39:36.050194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:13.015991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049377+0000","last_change":"2023-11-28T17:39:35.072541+0000","last_active":"2023-11-28T17:39:36.049377+0000","last_peered":"2023-11-28T17:39:36.049377+0000","last_clean":"2023-11-28T17:39:36.049377+0000","last_became_active":"2023-11-28T17:39:35.072263+0000","last_became_peered":"2023-11-28T17:39:35.072263+0000","last_unstale":"2023-11-28T17:39:36.049377+0000","last_undegraded":"2023-11-28T17:39:36.049377+0000","last_fullsized":"2023-11-28T17:39:36.049377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:06.392677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449588+0000","last_change":"2023-11-28T17:39:35.070782+0000","last_active":"2023-11-28T17:39:36.449588+0000","last_peered":"2023-11-28T17:39:36.449588+0000","last_clean":"2023-11-28T17:39:36.449588+0000","last_became_active":"2023-11-28T17:39:35.070466+0000","last_became_peered":"2023-11-28T17:39:35.070466+0000","last_unstale":"2023-11-28T17:39:36.449588+0000","last_undegraded":"2023-11-28T17:39:36.449588+0000","last_fullsized":"2023-11-28T17:39:36.449588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050871+0000","last_change":"2023-11-28T17:39:34.073844+0000","last_active":"2023-11-28T17:39:36.050871+0000","last_peered":"2023-11-28T17:39:36.050871+0000","last_clean":"2023-11-28T17:39:36.050871+0000","last_became_active":"2023-11-28T17:39:34.073439+0000","last_became_peered":"2023-11-28T17:39:34.073439+0000","last_unstale":"2023-11-28T17:39:36.050871+0000","last_undegraded":"2023-11-28T17:39:36.050871+0000","last_fullsized":"2023-11-28T17:39:36.050871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448062+0000","last_change":"2023-11-28T17:39:35.077086+0000","last_active":"2023-11-28T17:39:36.448062+0000","last_peered":"2023-11-28T17:39:36.448062+0000","last_clean":"2023-11-28T17:39:36.448062+0000","last_became_active":"2023-11-28T17:39:35.076725+0000","last_became_peered":"2023-11-28T17:39:35.076725+0000","last_unstale":"2023-11-28T17:39:36.448062+0000","last_undegraded":"2023-11-28T17:39:36.448062+0000","last_fullsized":"2023-11-28T17:39:36.448062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449252+0000","last_change":"2023-11-28T17:39:34.072648+0000","last_active":"2023-11-28T17:39:36.449252+0000","last_peered":"2023-11-28T17:39:36.449252+0000","last_clean":"2023-11-28T17:39:36.449252+0000","last_became_active":"2023-11-28T17:39:34.072323+0000","last_became_peered":"2023-11-28T17:39:34.072323+0000","last_unstale":"2023-11-28T17:39:36.449252+0000","last_undegraded":"2023-11-28T17:39:36.449252+0000","last_fullsized":"2023-11-28T17:39:36.449252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:54.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311863+0000","last_change":"2023-11-28T17:39:34.075937+0000","last_active":"2023-11-28T17:39:36.311863+0000","last_peered":"2023-11-28T17:39:36.311863+0000","last_clean":"2023-11-28T17:39:36.311863+0000","last_became_active":"2023-11-28T17:39:34.075701+0000","last_became_peered":"2023-11-28T17:39:34.075701+0000","last_unstale":"2023-11-28T17:39:36.311863+0000","last_undegraded":"2023-11-28T17:39:36.311863+0000","last_fullsized":"2023-11-28T17:39:36.311863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051241+0000","last_change":"2023-11-28T17:39:35.081382+0000","last_active":"2023-11-28T17:39:36.051241+0000","last_peered":"2023-11-28T17:39:36.051241+0000","last_clean":"2023-11-28T17:39:36.051241+0000","last_became_active":"2023-11-28T17:39:35.080860+0000","last_became_peered":"2023-11-28T17:39:35.080860+0000","last_unstale":"2023-11-28T17:39:36.051241+0000","last_undegraded":"2023-11-28T17:39:36.051241+0000","last_fullsized":"2023-11-28T17:39:36.051241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449747+0000","last_change":"2023-11-28T17:39:34.069183+0000","last_active":"2023-11-28T17:39:36.449747+0000","last_peered":"2023-11-28T17:39:36.449747+0000","last_clean":"2023-11-28T17:39:36.449747+0000","last_became_active":"2023-11-28T17:39:34.068877+0000","last_became_peered":"2023-11-28T17:39:34.068877+0000","last_unstale":"2023-11-28T17:39:36.449747+0000","last_undegraded":"2023-11-28T17:39:36.449747+0000","last_fullsized":"2023-11-28T17:39:36.449747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448060+0000","last_change":"2023-11-28T17:39:35.068002+0000","last_active":"2023-11-28T17:39:36.448060+0000","last_peered":"2023-11-28T17:39:36.448060+0000","last_clean":"2023-11-28T17:39:36.448060+0000","last_became_active":"2023-11-28T17:39:35.067573+0000","last_became_peered":"2023-11-28T17:39:35.067573+0000","last_unstale":"2023-11-28T17:39:36.448060+0000","last_undegraded":"2023-11-28T17:39:36.448060+0000","last_fullsized":"2023-11-28T17:39:36.448060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449790+0000","last_change":"2023-11-28T17:39:34.071729+0000","last_active":"2023-11-28T17:39:36.449790+0000","last_peered":"2023-11-28T17:39:36.449790+0000","last_clean":"2023-11-28T17:39:36.449790+0000","last_became_active":"2023-11-28T17:39:34.070600+0000","last_became_peered":"2023-11-28T17:39:34.070600+0000","last_unstale":"2023-11-28T17:39:36.449790+0000","last_undegraded":"2023-11-28T17:39:36.449790+0000","last_fullsized":"2023-11-28T17:39:36.449790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.073594+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.073073+0000","last_became_peered":"2023-11-28T17:39:35.073073+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450176+0000","last_change":"2023-11-28T17:39:34.074904+0000","last_active":"2023-11-28T17:39:36.450176+0000","last_peered":"2023-11-28T17:39:36.450176+0000","last_clean":"2023-11-28T17:39:36.450176+0000","last_became_active":"2023-11-28T17:39:34.074606+0000","last_became_peered":"2023-11-28T17:39:34.074606+0000","last_unstale":"2023-11-28T17:39:36.450176+0000","last_undegraded":"2023-11-28T17:39:36.450176+0000","last_fullsized":"2023-11-28T17:39:36.450176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:32.724833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051559+0000","last_change":"2023-11-28T17:39:35.070120+0000","last_active":"2023-11-28T17:39:36.051559+0000","last_peered":"2023-11-28T17:39:36.051559+0000","last_clean":"2023-11-28T17:39:36.051559+0000","last_became_active":"2023-11-28T17:39:35.069783+0000","last_became_peered":"2023-11-28T17:39:35.069783+0000","last_unstale":"2023-11-28T17:39:36.051559+0000","last_undegraded":"2023-11-28T17:39:36.051559+0000","last_fullsized":"2023-11-28T17:39:36.051559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.783727+0000","last_change":"2023-11-28T17:39:34.067851+0000","last_active":"2023-11-28T17:39:35.783727+0000","last_peered":"2023-11-28T17:39:35.783727+0000","last_clean":"2023-11-28T17:39:35.783727+0000","last_became_active":"2023-11-28T17:39:34.067453+0000","last_became_peered":"2023-11-28T17:39:34.067453+0000","last_unstale":"2023-11-28T17:39:35.783727+0000","last_undegraded":"2023-11-28T17:39:35.783727+0000","last_fullsized":"2023-11-28T17:39:35.783727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:16.353473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448952+0000","last_change":"2023-11-28T17:39:35.062689+0000","last_active":"2023-11-28T17:39:36.448952+0000","last_peered":"2023-11-28T17:39:36.448952+0000","last_clean":"2023-11-28T17:39:36.448952+0000","last_became_active":"2023-11-28T17:39:35.062421+0000","last_became_peered":"2023-11-28T17:39:35.062421+0000","last_unstale":"2023-11-28T17:39:36.448952+0000","last_undegraded":"2023-11-28T17:39:36.448952+0000","last_fullsized":"2023-11-28T17:39:36.448952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049994+0000","last_change":"2023-11-28T17:39:34.058487+0000","last_active":"2023-11-28T17:39:36.049994+0000","last_peered":"2023-11-28T17:39:36.049994+0000","last_clean":"2023-11-28T17:39:36.049994+0000","last_became_active":"2023-11-28T17:39:34.058159+0000","last_became_peered":"2023-11-28T17:39:34.058159+0000","last_unstale":"2023-11-28T17:39:36.049994+0000","last_undegraded":"2023-11-28T17:39:36.049994+0000","last_fullsized":"2023-11-28T17:39:36.049994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:25.039707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450178+0000","last_change":"2023-11-28T17:39:35.076401+0000","last_active":"2023-11-28T17:39:36.450178+0000","last_peered":"2023-11-28T17:39:36.450178+0000","last_clean":"2023-11-28T17:39:36.450178+0000","last_became_active":"2023-11-28T17:39:35.076015+0000","last_became_peered":"2023-11-28T17:39:35.076015+0000","last_unstale":"2023-11-28T17:39:36.450178+0000","last_undegraded":"2023-11-28T17:39:36.450178+0000","last_fullsized":"2023-11-28T17:39:36.450178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.783711+0000","last_change":"2023-11-28T17:39:34.068303+0000","last_active":"2023-11-28T17:39:35.783711+0000","last_peered":"2023-11-28T17:39:35.783711+0000","last_clean":"2023-11-28T17:39:35.783711+0000","last_became_active":"2023-11-28T17:39:34.066648+0000","last_became_peered":"2023-11-28T17:39:34.066648+0000","last_unstale":"2023-11-28T17:39:35.783711+0000","last_undegraded":"2023-11-28T17:39:35.783711+0000","last_fullsized":"2023-11-28T17:39:35.783711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:39.488626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311919+0000","last_change":"2023-11-28T17:39:35.067106+0000","last_active":"2023-11-28T17:39:36.311919+0000","last_peered":"2023-11-28T17:39:36.311919+0000","last_clean":"2023-11-28T17:39:36.311919+0000","last_became_active":"2023-11-28T17:39:35.066673+0000","last_became_peered":"2023-11-28T17:39:35.066673+0000","last_unstale":"2023-11-28T17:39:36.311919+0000","last_undegraded":"2023-11-28T17:39:36.311919+0000","last_fullsized":"2023-11-28T17:39:36.311919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449337+0000","last_change":"2023-11-28T17:39:34.073519+0000","last_active":"2023-11-28T17:39:36.449337+0000","last_peered":"2023-11-28T17:39:36.449337+0000","last_clean":"2023-11-28T17:39:36.449337+0000","last_became_active":"2023-11-28T17:39:34.073200+0000","last_became_peered":"2023-11-28T17:39:34.073200+0000","last_unstale":"2023-11-28T17:39:36.449337+0000","last_undegraded":"2023-11-28T17:39:36.449337+0000","last_fullsized":"2023-11-28T17:39:36.449337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449088+0000","last_change":"2023-11-28T17:39:35.080909+0000","last_active":"2023-11-28T17:39:36.449088+0000","last_peered":"2023-11-28T17:39:36.449088+0000","last_clean":"2023-11-28T17:39:36.449088+0000","last_became_active":"2023-11-28T17:39:35.080072+0000","last_became_peered":"2023-11-28T17:39:35.080072+0000","last_unstale":"2023-11-28T17:39:36.449088+0000","last_undegraded":"2023-11-28T17:39:36.449088+0000","last_fullsized":"2023-11-28T17:39:36.449088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448347+0000","last_change":"2023-11-28T17:39:34.069169+0000","last_active":"2023-11-28T17:39:36.448347+0000","last_peered":"2023-11-28T17:39:36.448347+0000","last_clean":"2023-11-28T17:39:36.448347+0000","last_became_active":"2023-11-28T17:39:34.067860+0000","last_became_peered":"2023-11-28T17:39:34.067860+0000","last_unstale":"2023-11-28T17:39:36.448347+0000","last_undegraded":"2023-11-28T17:39:36.448347+0000","last_fullsized":"2023-11-28T17:39:36.448347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:18.869334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448881+0000","last_change":"2023-11-28T17:39:35.071533+0000","last_active":"2023-11-28T17:39:36.448881+0000","last_peered":"2023-11-28T17:39:36.448881+0000","last_clean":"2023-11-28T17:39:36.448881+0000","last_became_active":"2023-11-28T17:39:35.071284+0000","last_became_peered":"2023-11-28T17:39:35.071284+0000","last_unstale":"2023-11-28T17:39:36.448881+0000","last_undegraded":"2023-11-28T17:39:36.448881+0000","last_fullsized":"2023-11-28T17:39:36.448881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447799+0000","last_change":"2023-11-28T17:39:34.060653+0000","last_active":"2023-11-28T17:39:36.447799+0000","last_peered":"2023-11-28T17:39:36.447799+0000","last_clean":"2023-11-28T17:39:36.447799+0000","last_became_active":"2023-11-28T17:39:34.060015+0000","last_became_peered":"2023-11-28T17:39:34.060015+0000","last_unstale":"2023-11-28T17:39:36.447799+0000","last_undegraded":"2023-11-28T17:39:36.447799+0000","last_fullsized":"2023-11-28T17:39:36.447799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:05.390132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448738+0000","last_change":"2023-11-28T17:39:35.065169+0000","last_active":"2023-11-28T17:39:36.448738+0000","last_peered":"2023-11-28T17:39:36.448738+0000","last_clean":"2023-11-28T17:39:36.448738+0000","last_became_active":"2023-11-28T17:39:35.064318+0000","last_became_peered":"2023-11-28T17:39:35.064318+0000","last_unstale":"2023-11-28T17:39:36.448738+0000","last_undegraded":"2023-11-28T17:39:36.448738+0000","last_fullsized":"2023-11-28T17:39:36.448738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450204+0000","last_change":"2023-11-28T17:39:34.062100+0000","last_active":"2023-11-28T17:39:36.450204+0000","last_peered":"2023-11-28T17:39:36.450204+0000","last_clean":"2023-11-28T17:39:36.450204+0000","last_became_active":"2023-11-28T17:39:34.061747+0000","last_became_peered":"2023-11-28T17:39:34.061747+0000","last_unstale":"2023-11-28T17:39:36.450204+0000","last_undegraded":"2023-11-28T17:39:36.450204+0000","last_fullsized":"2023-11-28T17:39:36.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050050+0000","last_change":"2023-11-28T17:39:35.065690+0000","last_active":"2023-11-28T17:39:36.050050+0000","last_peered":"2023-11-28T17:39:36.050050+0000","last_clean":"2023-11-28T17:39:36.050050+0000","last_became_active":"2023-11-28T17:39:35.065320+0000","last_became_peered":"2023-11-28T17:39:35.065320+0000","last_unstale":"2023-11-28T17:39:36.050050+0000","last_undegraded":"2023-11-28T17:39:36.050050+0000","last_fullsized":"2023-11-28T17:39:36.050050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448234+0000","last_change":"2023-11-28T17:39:34.061533+0000","last_active":"2023-11-28T17:39:36.448234+0000","last_peered":"2023-11-28T17:39:36.448234+0000","last_clean":"2023-11-28T17:39:36.448234+0000","last_became_active":"2023-11-28T17:39:34.061186+0000","last_became_peered":"2023-11-28T17:39:34.061186+0000","last_unstale":"2023-11-28T17:39:36.448234+0000","last_undegraded":"2023-11-28T17:39:36.448234+0000","last_fullsized":"2023-11-28T17:39:36.448234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450173+0000","last_change":"2023-11-28T17:39:35.087511+0000","last_active":"2023-11-28T17:39:36.450173+0000","last_peered":"2023-11-28T17:39:36.450173+0000","last_clean":"2023-11-28T17:39:36.450173+0000","last_became_active":"2023-11-28T17:39:35.086912+0000","last_became_peered":"2023-11-28T17:39:35.086912+0000","last_unstale":"2023-11-28T17:39:36.450173+0000","last_undegraded":"2023-11-28T17:39:36.450173+0000","last_fullsized":"2023-11-28T17:39:36.450173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050536+0000","last_change":"2023-11-28T17:39:34.071865+0000","last_active":"2023-11-28T17:39:36.050536+0000","last_peered":"2023-11-28T17:39:36.050536+0000","last_clean":"2023-11-28T17:39:36.050536+0000","last_became_active":"2023-11-28T17:39:34.071567+0000","last_became_peered":"2023-11-28T17:39:34.071567+0000","last_unstale":"2023-11-28T17:39:36.050536+0000","last_undegraded":"2023-11-28T17:39:36.050536+0000","last_fullsized":"2023-11-28T17:39:36.050536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450019+0000","last_change":"2023-11-28T17:39:35.082650+0000","last_active":"2023-11-28T17:39:36.450019+0000","last_peered":"2023-11-28T17:39:36.450019+0000","last_clean":"2023-11-28T17:39:36.450019+0000","last_became_active":"2023-11-28T17:39:35.082382+0000","last_became_peered":"2023-11-28T17:39:35.082382+0000","last_unstale":"2023-11-28T17:39:36.450019+0000","last_undegraded":"2023-11-28T17:39:36.450019+0000","last_fullsized":"2023-11-28T17:39:36.450019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312376+0000","last_change":"2023-11-28T17:39:34.078625+0000","last_active":"2023-11-28T17:39:36.312376+0000","last_peered":"2023-11-28T17:39:36.312376+0000","last_clean":"2023-11-28T17:39:36.312376+0000","last_became_active":"2023-11-28T17:39:34.078378+0000","last_became_peered":"2023-11-28T17:39:34.078378+0000","last_unstale":"2023-11-28T17:39:36.312376+0000","last_undegraded":"2023-11-28T17:39:36.312376+0000","last_fullsized":"2023-11-28T17:39:36.312376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449383+0000","last_change":"2023-11-28T17:39:35.084148+0000","last_active":"2023-11-28T17:39:36.449383+0000","last_peered":"2023-11-28T17:39:36.449383+0000","last_clean":"2023-11-28T17:39:36.449383+0000","last_became_active":"2023-11-28T17:39:35.083942+0000","last_became_peered":"2023-11-28T17:39:35.083942+0000","last_unstale":"2023-11-28T17:39:36.449383+0000","last_undegraded":"2023-11-28T17:39:36.449383+0000","last_fullsized":"2023-11-28T17:39:36.449383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:03.153508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.054275+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:39:35.054275+0000","last_peered":"2023-11-28T17:39:35.054275+0000","last_clean":"2023-11-28T17:39:35.054275+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:39:35.054275+0000","last_undegraded":"2023-11-28T17:39:35.054275+0000","last_fullsized":"2023-11-28T17:39:35.054275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449258+0000","last_change":"2023-11-28T17:39:34.067867+0000","last_active":"2023-11-28T17:39:36.449258+0000","last_peered":"2023-11-28T17:39:36.449258+0000","last_clean":"2023-11-28T17:39:36.449258+0000","last_became_active":"2023-11-28T17:39:34.067560+0000","last_became_peered":"2023-11-28T17:39:34.067560+0000","last_unstale":"2023-11-28T17:39:36.449258+0000","last_undegraded":"2023-11-28T17:39:36.449258+0000","last_fullsized":"2023-11-28T17:39:36.449258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448035+0000","last_change":"2023-11-28T17:39:35.064367+0000","last_active":"2023-11-28T17:39:36.448035+0000","last_peered":"2023-11-28T17:39:36.448035+0000","last_clean":"2023-11-28T17:39:36.448035+0000","last_became_active":"2023-11-28T17:39:35.064054+0000","last_became_peered":"2023-11-28T17:39:35.064054+0000","last_unstale":"2023-11-28T17:39:36.448035+0000","last_undegraded":"2023-11-28T17:39:36.448035+0000","last_fullsized":"2023-11-28T17:39:36.448035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449837+0000","last_change":"2023-11-28T17:39:34.068641+0000","last_active":"2023-11-28T17:39:36.449837+0000","last_peered":"2023-11-28T17:39:36.449837+0000","last_clean":"2023-11-28T17:39:36.449837+0000","last_became_active":"2023-11-28T17:39:34.068347+0000","last_became_peered":"2023-11-28T17:39:34.068347+0000","last_unstale":"2023-11-28T17:39:36.449837+0000","last_undegraded":"2023-11-28T17:39:36.449837+0000","last_fullsized":"2023-11-28T17:39:36.449837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:28.994690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311948+0000","last_change":"2023-11-28T17:39:35.070669+0000","last_active":"2023-11-28T17:39:36.311948+0000","last_peered":"2023-11-28T17:39:36.311948+0000","last_clean":"2023-11-28T17:39:36.311948+0000","last_became_active":"2023-11-28T17:39:35.070353+0000","last_became_peered":"2023-11-28T17:39:35.070353+0000","last_unstale":"2023-11-28T17:39:36.311948+0000","last_undegraded":"2023-11-28T17:39:36.311948+0000","last_fullsized":"2023-11-28T17:39:36.311948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:25.524344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.783690+0000","last_change":"2023-11-28T17:39:34.067405+0000","last_active":"2023-11-28T17:39:35.783690+0000","last_peered":"2023-11-28T17:39:35.783690+0000","last_clean":"2023-11-28T17:39:35.783690+0000","last_became_active":"2023-11-28T17:39:34.067099+0000","last_became_peered":"2023-11-28T17:39:34.067099+0000","last_unstale":"2023-11-28T17:39:35.783690+0000","last_undegraded":"2023-11-28T17:39:35.783690+0000","last_fullsized":"2023-11-28T17:39:35.783690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:42.607678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051234+0000","last_change":"2023-11-28T17:39:35.078142+0000","last_active":"2023-11-28T17:39:36.051234+0000","last_peered":"2023-11-28T17:39:36.051234+0000","last_clean":"2023-11-28T17:39:36.051234+0000","last_became_active":"2023-11-28T17:39:35.077867+0000","last_became_peered":"2023-11-28T17:39:35.077867+0000","last_unstale":"2023-11-28T17:39:36.051234+0000","last_undegraded":"2023-11-28T17:39:36.051234+0000","last_fullsized":"2023-11-28T17:39:36.051234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449415+0000","last_change":"2023-11-28T17:39:34.076158+0000","last_active":"2023-11-28T17:39:36.449415+0000","last_peered":"2023-11-28T17:39:36.449415+0000","last_clean":"2023-11-28T17:39:36.449415+0000","last_became_active":"2023-11-28T17:39:34.075800+0000","last_became_peered":"2023-11-28T17:39:34.075800+0000","last_unstale":"2023-11-28T17:39:36.449415+0000","last_undegraded":"2023-11-28T17:39:36.449415+0000","last_fullsized":"2023-11-28T17:39:36.449415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448789+0000","last_change":"2023-11-28T17:39:35.078574+0000","last_active":"2023-11-28T17:39:36.448789+0000","last_peered":"2023-11-28T17:39:36.448789+0000","last_clean":"2023-11-28T17:39:36.448789+0000","last_became_active":"2023-11-28T17:39:35.078265+0000","last_became_peered":"2023-11-28T17:39:35.078265+0000","last_unstale":"2023-11-28T17:39:36.448789+0000","last_undegraded":"2023-11-28T17:39:36.448789+0000","last_fullsized":"2023-11-28T17:39:36.448789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050497+0000","last_change":"2023-11-28T17:39:34.078063+0000","last_active":"2023-11-28T17:39:36.050497+0000","last_peered":"2023-11-28T17:39:36.050497+0000","last_clean":"2023-11-28T17:39:36.050497+0000","last_became_active":"2023-11-28T17:39:34.077766+0000","last_became_peered":"2023-11-28T17:39:34.077766+0000","last_unstale":"2023-11-28T17:39:36.050497+0000","last_undegraded":"2023-11-28T17:39:36.050497+0000","last_fullsized":"2023-11-28T17:39:36.050497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049860+0000","last_change":"2023-11-28T17:39:35.069368+0000","last_active":"2023-11-28T17:39:36.049860+0000","last_peered":"2023-11-28T17:39:36.049860+0000","last_clean":"2023-11-28T17:39:36.049860+0000","last_became_active":"2023-11-28T17:39:35.068994+0000","last_became_peered":"2023-11-28T17:39:35.068994+0000","last_unstale":"2023-11-28T17:39:36.049860+0000","last_undegraded":"2023-11-28T17:39:36.049860+0000","last_fullsized":"2023-11-28T17:39:36.049860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449620+0000","last_change":"2023-11-28T17:39:34.070446+0000","last_active":"2023-11-28T17:39:36.449620+0000","last_peered":"2023-11-28T17:39:36.449620+0000","last_clean":"2023-11-28T17:39:36.449620+0000","last_became_active":"2023-11-28T17:39:34.070015+0000","last_became_peered":"2023-11-28T17:39:34.070015+0000","last_unstale":"2023-11-28T17:39:36.449620+0000","last_undegraded":"2023-11-28T17:39:36.449620+0000","last_fullsized":"2023-11-28T17:39:36.449620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:07.175612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312232+0000","last_change":"2023-11-28T17:39:35.070405+0000","last_active":"2023-11-28T17:39:36.312232+0000","last_peered":"2023-11-28T17:39:36.312232+0000","last_clean":"2023-11-28T17:39:36.312232+0000","last_became_active":"2023-11-28T17:39:35.069566+0000","last_became_peered":"2023-11-28T17:39:35.069566+0000","last_unstale":"2023-11-28T17:39:36.312232+0000","last_undegraded":"2023-11-28T17:39:36.312232+0000","last_fullsized":"2023-11-28T17:39:36.312232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.786985+0000","last_change":"2023-11-28T17:39:34.061411+0000","last_active":"2023-11-28T17:39:36.786985+0000","last_peered":"2023-11-28T17:39:36.786985+0000","last_clean":"2023-11-28T17:39:36.786985+0000","last_became_active":"2023-11-28T17:39:34.061056+0000","last_became_peered":"2023-11-28T17:39:34.061056+0000","last_unstale":"2023-11-28T17:39:36.786985+0000","last_undegraded":"2023-11-28T17:39:36.786985+0000","last_fullsized":"2023-11-28T17:39:36.786985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:24.521800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448331+0000","last_change":"2023-11-28T17:39:35.067279+0000","last_active":"2023-11-28T17:39:36.448331+0000","last_peered":"2023-11-28T17:39:36.448331+0000","last_clean":"2023-11-28T17:39:36.448331+0000","last_became_active":"2023-11-28T17:39:35.066864+0000","last_became_peered":"2023-11-28T17:39:35.066864+0000","last_unstale":"2023-11-28T17:39:36.448331+0000","last_undegraded":"2023-11-28T17:39:36.448331+0000","last_fullsized":"2023-11-28T17:39:36.448331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449713+0000","last_change":"2023-11-28T17:39:34.079838+0000","last_active":"2023-11-28T17:39:36.449713+0000","last_peered":"2023-11-28T17:39:36.449713+0000","last_clean":"2023-11-28T17:39:36.449713+0000","last_became_active":"2023-11-28T17:39:34.075803+0000","last_became_peered":"2023-11-28T17:39:34.075803+0000","last_unstale":"2023-11-28T17:39:36.449713+0000","last_undegraded":"2023-11-28T17:39:36.449713+0000","last_fullsized":"2023-11-28T17:39:36.449713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:22.239588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448255+0000","last_change":"2023-11-28T17:39:35.070761+0000","last_active":"2023-11-28T17:39:36.448255+0000","last_peered":"2023-11-28T17:39:36.448255+0000","last_clean":"2023-11-28T17:39:36.448255+0000","last_became_active":"2023-11-28T17:39:35.070419+0000","last_became_peered":"2023-11-28T17:39:35.070419+0000","last_unstale":"2023-11-28T17:39:36.448255+0000","last_undegraded":"2023-11-28T17:39:36.448255+0000","last_fullsized":"2023-11-28T17:39:36.448255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448136+0000","last_change":"2023-11-28T17:39:34.060701+0000","last_active":"2023-11-28T17:39:36.448136+0000","last_peered":"2023-11-28T17:39:36.448136+0000","last_clean":"2023-11-28T17:39:36.448136+0000","last_became_active":"2023-11-28T17:39:34.060371+0000","last_became_peered":"2023-11-28T17:39:34.060371+0000","last_unstale":"2023-11-28T17:39:36.448136+0000","last_undegraded":"2023-11-28T17:39:36.448136+0000","last_fullsized":"2023-11-28T17:39:36.448136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448864+0000","last_change":"2023-11-28T17:39:35.064644+0000","last_active":"2023-11-28T17:39:36.448864+0000","last_peered":"2023-11-28T17:39:36.448864+0000","last_clean":"2023-11-28T17:39:36.448864+0000","last_became_active":"2023-11-28T17:39:35.063958+0000","last_became_peered":"2023-11-28T17:39:35.063958+0000","last_unstale":"2023-11-28T17:39:36.448864+0000","last_undegraded":"2023-11-28T17:39:36.448864+0000","last_fullsized":"2023-11-28T17:39:36.448864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447972+0000","last_change":"2023-11-28T17:39:34.060063+0000","last_active":"2023-11-28T17:39:36.447972+0000","last_peered":"2023-11-28T17:39:36.447972+0000","last_clean":"2023-11-28T17:39:36.447972+0000","last_became_active":"2023-11-28T17:39:34.059667+0000","last_became_peered":"2023-11-28T17:39:34.059667+0000","last_unstale":"2023-11-28T17:39:36.447972+0000","last_undegraded":"2023-11-28T17:39:36.447972+0000","last_fullsized":"2023-11-28T17:39:36.447972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447864+0000","last_change":"2023-11-28T17:39:35.069085+0000","last_active":"2023-11-28T17:39:36.447864+0000","last_peered":"2023-11-28T17:39:36.447864+0000","last_clean":"2023-11-28T17:39:36.447864+0000","last_became_active":"2023-11-28T17:39:35.068282+0000","last_became_peered":"2023-11-28T17:39:35.068282+0000","last_unstale":"2023-11-28T17:39:36.447864+0000","last_undegraded":"2023-11-28T17:39:36.447864+0000","last_fullsized":"2023-11-28T17:39:36.447864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312049+0000","last_change":"2023-11-28T17:39:34.071879+0000","last_active":"2023-11-28T17:39:36.312049+0000","last_peered":"2023-11-28T17:39:36.312049+0000","last_clean":"2023-11-28T17:39:36.312049+0000","last_became_active":"2023-11-28T17:39:34.071374+0000","last_became_peered":"2023-11-28T17:39:34.071374+0000","last_unstale":"2023-11-28T17:39:36.312049+0000","last_undegraded":"2023-11-28T17:39:36.312049+0000","last_fullsized":"2023-11-28T17:39:36.312049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:28.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050789+0000","last_change":"2023-11-28T17:39:35.076243+0000","last_active":"2023-11-28T17:39:36.050789+0000","last_peered":"2023-11-28T17:39:36.050789+0000","last_clean":"2023-11-28T17:39:36.050789+0000","last_became_active":"2023-11-28T17:39:35.075878+0000","last_became_peered":"2023-11-28T17:39:35.075878+0000","last_unstale":"2023-11-28T17:39:36.050789+0000","last_undegraded":"2023-11-28T17:39:36.050789+0000","last_fullsized":"2023-11-28T17:39:36.050789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:21.690790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449173+0000","last_change":"2023-11-28T17:39:34.080217+0000","last_active":"2023-11-28T17:39:36.449173+0000","last_peered":"2023-11-28T17:39:36.449173+0000","last_clean":"2023-11-28T17:39:36.449173+0000","last_became_active":"2023-11-28T17:39:34.079885+0000","last_became_peered":"2023-11-28T17:39:34.079885+0000","last_unstale":"2023-11-28T17:39:36.449173+0000","last_undegraded":"2023-11-28T17:39:36.449173+0000","last_fullsized":"2023-11-28T17:39:36.449173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449154+0000","last_change":"2023-11-28T17:39:35.081899+0000","last_active":"2023-11-28T17:39:36.449154+0000","last_peered":"2023-11-28T17:39:36.449154+0000","last_clean":"2023-11-28T17:39:36.449154+0000","last_became_active":"2023-11-28T17:39:35.081239+0000","last_became_peered":"2023-11-28T17:39:35.081239+0000","last_unstale":"2023-11-28T17:39:36.449154+0000","last_undegraded":"2023-11-28T17:39:36.449154+0000","last_fullsized":"2023-11-28T17:39:36.449154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:36.478729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449756+0000","last_change":"2023-11-28T17:39:35.072258+0000","last_active":"2023-11-28T17:39:36.449756+0000","last_peered":"2023-11-28T17:39:36.449756+0000","last_clean":"2023-11-28T17:39:36.449756+0000","last_became_active":"2023-11-28T17:39:35.071820+0000","last_became_peered":"2023-11-28T17:39:35.071820+0000","last_unstale":"2023-11-28T17:39:36.449756+0000","last_undegraded":"2023-11-28T17:39:36.449756+0000","last_fullsized":"2023-11-28T17:39:36.449756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:25.703521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450044+0000","last_change":"2023-11-28T17:39:34.071815+0000","last_active":"2023-11-28T17:39:36.450044+0000","last_peered":"2023-11-28T17:39:36.450044+0000","last_clean":"2023-11-28T17:39:36.450044+0000","last_became_active":"2023-11-28T17:39:34.070404+0000","last_became_peered":"2023-11-28T17:39:34.070404+0000","last_unstale":"2023-11-28T17:39:36.450044+0000","last_undegraded":"2023-11-28T17:39:36.450044+0000","last_fullsized":"2023-11-28T17:39:36.450044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449165+0000","last_change":"2023-11-28T17:39:35.078177+0000","last_active":"2023-11-28T17:39:36.449165+0000","last_peered":"2023-11-28T17:39:36.449165+0000","last_clean":"2023-11-28T17:39:36.449165+0000","last_became_active":"2023-11-28T17:39:35.077903+0000","last_became_peered":"2023-11-28T17:39:35.077903+0000","last_unstale":"2023-11-28T17:39:36.449165+0000","last_undegraded":"2023-11-28T17:39:36.449165+0000","last_fullsized":"2023-11-28T17:39:36.449165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450137+0000","last_change":"2023-11-28T17:39:34.074770+0000","last_active":"2023-11-28T17:39:36.450137+0000","last_peered":"2023-11-28T17:39:36.450137+0000","last_clean":"2023-11-28T17:39:36.450137+0000","last_became_active":"2023-11-28T17:39:34.074470+0000","last_became_peered":"2023-11-28T17:39:34.074470+0000","last_unstale":"2023-11-28T17:39:36.450137+0000","last_undegraded":"2023-11-28T17:39:36.450137+0000","last_fullsized":"2023-11-28T17:39:36.450137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050609+0000","last_change":"2023-11-28T17:39:35.079538+0000","last_active":"2023-11-28T17:39:36.050609+0000","last_peered":"2023-11-28T17:39:36.050609+0000","last_clean":"2023-11-28T17:39:36.050609+0000","last_became_active":"2023-11-28T17:39:35.079236+0000","last_became_peered":"2023-11-28T17:39:35.079236+0000","last_unstale":"2023-11-28T17:39:36.050609+0000","last_undegraded":"2023-11-28T17:39:36.050609+0000","last_fullsized":"2023-11-28T17:39:36.050609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051095+0000","last_change":"2023-11-28T17:39:34.066171+0000","last_active":"2023-11-28T17:39:36.051095+0000","last_peered":"2023-11-28T17:39:36.051095+0000","last_clean":"2023-11-28T17:39:36.051095+0000","last_became_active":"2023-11-28T17:39:34.065133+0000","last_became_peered":"2023-11-28T17:39:34.065133+0000","last_unstale":"2023-11-28T17:39:36.051095+0000","last_undegraded":"2023-11-28T17:39:36.051095+0000","last_fullsized":"2023-11-28T17:39:36.051095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051059+0000","last_change":"2023-11-28T17:39:35.069328+0000","last_active":"2023-11-28T17:39:36.051059+0000","last_peered":"2023-11-28T17:39:36.051059+0000","last_clean":"2023-11-28T17:39:36.051059+0000","last_became_active":"2023-11-28T17:39:35.066256+0000","last_became_peered":"2023-11-28T17:39:35.066256+0000","last_unstale":"2023-11-28T17:39:36.051059+0000","last_undegraded":"2023-11-28T17:39:36.051059+0000","last_fullsized":"2023-11-28T17:39:36.051059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448353+0000","last_change":"2023-11-28T17:39:34.067861+0000","last_active":"2023-11-28T17:39:36.448353+0000","last_peered":"2023-11-28T17:39:36.448353+0000","last_clean":"2023-11-28T17:39:36.448353+0000","last_became_active":"2023-11-28T17:39:34.067203+0000","last_became_peered":"2023-11-28T17:39:34.067203+0000","last_unstale":"2023-11-28T17:39:36.448353+0000","last_undegraded":"2023-11-28T17:39:36.448353+0000","last_fullsized":"2023-11-28T17:39:36.448353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5459999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.585}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.609}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.423}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5170000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.3780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1719999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2809999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3149999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":76308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:39:44.235 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:39:44.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.411+0000 7f86916ea640 1 Processor -- start 2023-11-28T17:39:44.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.411+0000 7f86916ea640 1 -- start start 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f86916ea640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f868c144c80 0x7f868c0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f86916ea640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c0ce4f0 con 0x7f868c0cf640 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f86916ea640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c0ce7d0 con 0x7f868c0cdf00 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f86916ea640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0709b0 con 0x7f868c144c80 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f868c144c80 0x7f868c0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f868c144c80 0x7f868c0cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48868/0 (socket says 172.21.15.16:48868) 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 -- 172.21.15.16:0/2290949838 learned_addr learned my addr 172.21.15.16:0/2290949838 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:44.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868b7fe640 1 --1- 172.21.15.16:0/2290949838 >> v1:172.21.15.16:6789/0 conn(0x7f868c0cf640 0x7f868c070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50482/0 (socket says 172.21.15.16:50482) 2023-11-28T17:39:44.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 -- 172.21.15.16:0/2290949838 >> v1:172.21.15.64:6789/0 conn(0x7f868c0cdf00 legacy=0x7f868c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 -- 172.21.15.16:0/2290949838 >> v1:172.21.15.16:6789/0 conn(0x7f868c0cf640 legacy=0x7f868c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 -- 172.21.15.16:0/2290949838 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c0ceab0 con 0x7f868c144c80 2023-11-28T17:39:44.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.415+0000 7f868affd640 1 --2- 172.21.15.16:0/2290949838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c144c80 0x7f868c0cd9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f867c009870 tx=0x7f867c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3ee18ba399ee2c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f868a7fc640 1 -- 172.21.15.16:0/2290949838 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0ab650 con 0x7f868c144c80 2023-11-28T17:39:44.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f868a7fc640 1 -- 172.21.15.16:0/2290949838 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0ab7b0 con 0x7f868c144c80 2023-11-28T17:39:44.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f868a7fc640 1 -- 172.21.15.16:0/2290949838 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0abb40 con 0x7f868c144c80 2023-11-28T17:39:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- 172.21.15.16:0/2290949838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c144c80 msgr2=0x7f868c0cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 --2- 172.21.15.16:0/2290949838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c144c80 0x7f868c0cd9c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f867c009870 tx=0x7f867c01c540 comp rx=0 tx=0).stop 2023-11-28T17:39:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- 172.21.15.16:0/2290949838 shutdown_connections 2023-11-28T17:39:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 --2- 172.21.15.16:0/2290949838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c144c80 0x7f868c0cd9c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- 172.21.15.16:0/2290949838 >> 172.21.15.16:0/2290949838 conn(0x7f868c06a5a0 msgr2=0x7f868c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- 172.21.15.16:0/2290949838 shutdown_connections 2023-11-28T17:39:44.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- 172.21.15.16:0/2290949838 wait complete. 2023-11-28T17:39:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 Processor -- start 2023-11-28T17:39:44.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- start start 2023-11-28T17:39:44.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f868c0cdf00 0x7f868c13b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 0x7f868c158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f868c144c80 0x7f868c0b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c13ce00 con 0x7f868c0cf640 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c159090 con 0x7f868c144c80 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f86916ea640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c15e750 con 0x7f868c0cdf00 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.419+0000 7f8683fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 0x7f868c158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 0x7f868c158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48880/0 (socket says 172.21.15.16:48880) 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 -- 172.21.15.16:0/2449354016 learned_addr learned my addr 172.21.15.16:0/2449354016 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f868affd640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f868c0cdf00 0x7f868c13b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f868b7fe640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f868c144c80 0x7f868c0b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 -- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f868c0cdf00 msgr2=0x7f868c13b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f868c0cdf00 0x7f868c13b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 -- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f868c144c80 msgr2=0x7f868c0b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f868c144c80 0x7f868c0b2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 -- 172.21.15.16:0/2449354016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0094d0 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f8683fff640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 0x7f868c158b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f867400c3f0 tx=0x7f867400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86740052d0 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8674005430 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674003840 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c15df10 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c142c30 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c142dc0 con 0x7f868c0cf640 2023-11-28T17:39:44.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.423+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f86740039a0 con 0x7f868c0cf640 2023-11-28T17:39:44.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.427+0000 7f86837fe640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f866c0668d0 0x7f866c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.427+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8674083910 con 0x7f868c0cf640 2023-11-28T17:39:44.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.427+0000 7f868affd640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f866c0668d0 0x7f866c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.427+0000 7f868affd640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f866c0668d0 0x7f866c068d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f867c0af000 tx=0x7f867c0b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.431+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8674050bf0 con 0x7f868c0cf640 2023-11-28T17:39:44.588 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.583+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f868c071fc0 con 0x7f866c0668d0 2023-11-28T17:39:44.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.591+0000 7f86837fe640 1 -- 172.21.15.16:0/2449354016 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264510 (secure 0 0 0) 0x7f867c0ab9a0 con 0x7f866c0668d0 2023-11-28T17:39:44.598 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:44.600 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f866c0668d0 msgr2=0x7f866c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f866c0668d0 0x7f866c068d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f867c0af000 tx=0x7f867c0b6040 comp rx=0 tx=0).stop 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 msgr2=0x7f868c158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 0x7f868c158b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f867400c3f0 tx=0x7f867400c8b0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 shutdown_connections 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f866c0668d0 0x7f866c068d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f868c144c80 0x7f868c0b2110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f868c0cf640 0x7f868c158b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 --2- 172.21.15.16:0/2449354016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f868c0cdf00 0x7f868c13b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 >> 172.21.15.16:0/2449354016 conn(0x7f868c06a5a0 msgr2=0x7f868c159520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 shutdown_connections 2023-11-28T17:39:44.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.595+0000 7f86916ea640 1 -- 172.21.15.16:0/2449354016 wait complete. 2023-11-28T17:39:44.618 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-11-28T17:39:42.766886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231624,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754743096,"statfs":{"total":773094113280,"available":772856930304,"internally_reserved":0,"allocated":3022848,"data_stored":1795572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001889"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450114+0000","last_change":"2023-11-28T17:39:35.076736+0000","last_active":"2023-11-28T17:39:36.450114+0000","last_peered":"2023-11-28T17:39:36.450114+0000","last_clean":"2023-11-28T17:39:36.450114+0000","last_became_active":"2023-11-28T17:39:35.076314+0000","last_became_peered":"2023-11-28T17:39:35.076314+0000","last_unstale":"2023-11-28T17:39:36.450114+0000","last_undegraded":"2023-11-28T17:39:36.450114+0000","last_fullsized":"2023-11-28T17:39:36.450114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050954+0000","last_change":"2023-11-28T17:39:35.074659+0000","last_active":"2023-11-28T17:39:36.050954+0000","last_peered":"2023-11-28T17:39:36.050954+0000","last_clean":"2023-11-28T17:39:36.050954+0000","last_became_active":"2023-11-28T17:39:35.074240+0000","last_became_peered":"2023-11-28T17:39:35.074240+0000","last_unstale":"2023-11-28T17:39:36.050954+0000","last_undegraded":"2023-11-28T17:39:36.050954+0000","last_fullsized":"2023-11-28T17:39:36.050954+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050415+0000","last_change":"2023-11-28T17:39:35.072116+0000","last_active":"2023-11-28T17:39:36.050415+0000","last_peered":"2023-11-28T17:39:36.050415+0000","last_clean":"2023-11-28T17:39:36.050415+0000","last_became_active":"2023-11-28T17:39:35.071687+0000","last_became_peered":"2023-11-28T17:39:35.071687+0000","last_unstale":"2023-11-28T17:39:36.050415+0000","last_undegraded":"2023-11-28T17:39:36.050415+0000","last_fullsized":"2023-11-28T17:39:36.050415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.064075+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.063682+0000","last_became_peered":"2023-11-28T17:39:35.063682+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448696+0000","last_change":"2023-11-28T17:39:35.077549+0000","last_active":"2023-11-28T17:39:36.448696+0000","last_peered":"2023-11-28T17:39:36.448696+0000","last_clean":"2023-11-28T17:39:36.448696+0000","last_became_active":"2023-11-28T17:39:35.077185+0000","last_became_peered":"2023-11-28T17:39:35.077185+0000","last_unstale":"2023-11-28T17:39:36.448696+0000","last_undegraded":"2023-11-28T17:39:36.448696+0000","last_fullsized":"2023-11-28T17:39:36.448696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:44:08.883432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049692+0000","last_change":"2023-11-28T17:39:35.057293+0000","last_active":"2023-11-28T17:39:36.049692+0000","last_peered":"2023-11-28T17:39:36.049692+0000","last_clean":"2023-11-28T17:39:36.049692+0000","last_became_active":"2023-11-28T17:39:35.057018+0000","last_became_peered":"2023-11-28T17:39:35.057018+0000","last_unstale":"2023-11-28T17:39:36.049692+0000","last_undegraded":"2023-11-28T17:39:36.049692+0000","last_fullsized":"2023-11-28T17:39:36.049692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:49.748812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448373+0000","last_change":"2023-11-28T17:39:35.068482+0000","last_active":"2023-11-28T17:39:36.448373+0000","last_peered":"2023-11-28T17:39:36.448373+0000","last_clean":"2023-11-28T17:39:36.448373+0000","last_became_active":"2023-11-28T17:39:35.066863+0000","last_became_peered":"2023-11-28T17:39:35.066863+0000","last_unstale":"2023-11-28T17:39:36.448373+0000","last_undegraded":"2023-11-28T17:39:36.448373+0000","last_fullsized":"2023-11-28T17:39:36.448373+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051099+0000","last_change":"2023-11-28T17:39:35.085078+0000","last_active":"2023-11-28T17:39:36.051099+0000","last_peered":"2023-11-28T17:39:36.051099+0000","last_clean":"2023-11-28T17:39:36.051099+0000","last_became_active":"2023-11-28T17:39:35.084745+0000","last_became_peered":"2023-11-28T17:39:35.084745+0000","last_unstale":"2023-11-28T17:39:36.051099+0000","last_undegraded":"2023-11-28T17:39:36.051099+0000","last_fullsized":"2023-11-28T17:39:36.051099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449706+0000","last_change":"2023-11-28T17:39:35.080106+0000","last_active":"2023-11-28T17:39:36.449706+0000","last_peered":"2023-11-28T17:39:36.449706+0000","last_clean":"2023-11-28T17:39:36.449706+0000","last_became_active":"2023-11-28T17:39:35.079816+0000","last_became_peered":"2023-11-28T17:39:35.079816+0000","last_unstale":"2023-11-28T17:39:36.449706+0000","last_undegraded":"2023-11-28T17:39:36.449706+0000","last_fullsized":"2023-11-28T17:39:36.449706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450080+0000","last_change":"2023-11-28T17:39:35.074439+0000","last_active":"2023-11-28T17:39:36.450080+0000","last_peered":"2023-11-28T17:39:36.450080+0000","last_clean":"2023-11-28T17:39:36.450080+0000","last_became_active":"2023-11-28T17:39:35.073858+0000","last_became_peered":"2023-11-28T17:39:35.073858+0000","last_unstale":"2023-11-28T17:39:36.450080+0000","last_undegraded":"2023-11-28T17:39:36.450080+0000","last_fullsized":"2023-11-28T17:39:36.450080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450026+0000","last_change":"2023-11-28T17:39:35.070060+0000","last_active":"2023-11-28T17:39:36.450026+0000","last_peered":"2023-11-28T17:39:36.450026+0000","last_clean":"2023-11-28T17:39:36.450026+0000","last_became_active":"2023-11-28T17:39:35.069384+0000","last_became_peered":"2023-11-28T17:39:35.069384+0000","last_unstale":"2023-11-28T17:39:36.450026+0000","last_undegraded":"2023-11-28T17:39:36.450026+0000","last_fullsized":"2023-11-28T17:39:36.450026+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449873+0000","last_change":"2023-11-28T17:39:35.082371+0000","last_active":"2023-11-28T17:39:36.449873+0000","last_peered":"2023-11-28T17:39:36.449873+0000","last_clean":"2023-11-28T17:39:36.449873+0000","last_became_active":"2023-11-28T17:39:35.081668+0000","last_became_peered":"2023-11-28T17:39:35.081668+0000","last_unstale":"2023-11-28T17:39:36.449873+0000","last_undegraded":"2023-11-28T17:39:36.449873+0000","last_fullsized":"2023-11-28T17:39:36.449873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:29.997234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312169+0000","last_change":"2023-11-28T17:39:35.082173+0000","last_active":"2023-11-28T17:39:36.312169+0000","last_peered":"2023-11-28T17:39:36.312169+0000","last_clean":"2023-11-28T17:39:36.312169+0000","last_became_active":"2023-11-28T17:39:35.080696+0000","last_became_peered":"2023-11-28T17:39:35.080696+0000","last_unstale":"2023-11-28T17:39:36.312169+0000","last_undegraded":"2023-11-28T17:39:36.312169+0000","last_fullsized":"2023-11-28T17:39:36.312169+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311941+0000","last_change":"2023-11-28T17:39:35.080498+0000","last_active":"2023-11-28T17:39:36.311941+0000","last_peered":"2023-11-28T17:39:36.311941+0000","last_clean":"2023-11-28T17:39:36.311941+0000","last_became_active":"2023-11-28T17:39:35.080163+0000","last_became_peered":"2023-11-28T17:39:35.080163+0000","last_unstale":"2023-11-28T17:39:36.311941+0000","last_undegraded":"2023-11-28T17:39:36.311941+0000","last_fullsized":"2023-11-28T17:39:36.311941+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051297+0000","last_change":"2023-11-28T17:39:35.084970+0000","last_active":"2023-11-28T17:39:36.051297+0000","last_peered":"2023-11-28T17:39:36.051297+0000","last_clean":"2023-11-28T17:39:36.051297+0000","last_became_active":"2023-11-28T17:39:35.084639+0000","last_became_peered":"2023-11-28T17:39:35.084639+0000","last_unstale":"2023-11-28T17:39:36.051297+0000","last_undegraded":"2023-11-28T17:39:36.051297+0000","last_fullsized":"2023-11-28T17:39:36.051297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449523+0000","last_change":"2023-11-28T17:39:35.072393+0000","last_active":"2023-11-28T17:39:36.449523+0000","last_peered":"2023-11-28T17:39:36.449523+0000","last_clean":"2023-11-28T17:39:36.449523+0000","last_became_active":"2023-11-28T17:39:35.071917+0000","last_became_peered":"2023-11-28T17:39:35.071917+0000","last_unstale":"2023-11-28T17:39:36.449523+0000","last_undegraded":"2023-11-28T17:39:36.449523+0000","last_fullsized":"2023-11-28T17:39:36.449523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:18:09.993168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449618+0000","last_change":"2023-11-28T17:39:35.080914+0000","last_active":"2023-11-28T17:39:36.449618+0000","last_peered":"2023-11-28T17:39:36.449618+0000","last_clean":"2023-11-28T17:39:36.449618+0000","last_became_active":"2023-11-28T17:39:35.080586+0000","last_became_peered":"2023-11-28T17:39:35.080586+0000","last_unstale":"2023-11-28T17:39:36.449618+0000","last_undegraded":"2023-11-28T17:39:36.449618+0000","last_fullsized":"2023-11-28T17:39:36.449618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:14:15.208179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050843+0000","last_change":"2023-11-28T17:39:35.077623+0000","last_active":"2023-11-28T17:39:36.050843+0000","last_peered":"2023-11-28T17:39:36.050843+0000","last_clean":"2023-11-28T17:39:36.050843+0000","last_became_active":"2023-11-28T17:39:35.077222+0000","last_became_peered":"2023-11-28T17:39:35.077222+0000","last_unstale":"2023-11-28T17:39:36.050843+0000","last_undegraded":"2023-11-28T17:39:36.050843+0000","last_fullsized":"2023-11-28T17:39:36.050843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:25:09.304093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449521+0000","last_change":"2023-11-28T17:39:35.067332+0000","last_active":"2023-11-28T17:39:36.449521+0000","last_peered":"2023-11-28T17:39:36.449521+0000","last_clean":"2023-11-28T17:39:36.449521+0000","last_became_active":"2023-11-28T17:39:35.066983+0000","last_became_peered":"2023-11-28T17:39:35.066983+0000","last_unstale":"2023-11-28T17:39:36.449521+0000","last_undegraded":"2023-11-28T17:39:36.449521+0000","last_fullsized":"2023-11-28T17:39:36.449521+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:10:25.743991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449930+0000","last_change":"2023-11-28T17:39:35.082580+0000","last_active":"2023-11-28T17:39:36.449930+0000","last_peered":"2023-11-28T17:39:36.449930+0000","last_clean":"2023-11-28T17:39:36.449930+0000","last_became_active":"2023-11-28T17:39:35.082091+0000","last_became_peered":"2023-11-28T17:39:35.082091+0000","last_unstale":"2023-11-28T17:39:36.449930+0000","last_undegraded":"2023-11-28T17:39:36.449930+0000","last_fullsized":"2023-11-28T17:39:36.449930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448106+0000","last_change":"2023-11-28T17:39:35.055626+0000","last_active":"2023-11-28T17:39:36.448106+0000","last_peered":"2023-11-28T17:39:36.448106+0000","last_clean":"2023-11-28T17:39:36.448106+0000","last_became_active":"2023-11-28T17:39:35.055320+0000","last_became_peered":"2023-11-28T17:39:35.055320+0000","last_unstale":"2023-11-28T17:39:36.448106+0000","last_undegraded":"2023-11-28T17:39:36.448106+0000","last_fullsized":"2023-11-28T17:39:36.448106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449446+0000","last_change":"2023-11-28T17:39:35.065869+0000","last_active":"2023-11-28T17:39:36.449446+0000","last_peered":"2023-11-28T17:39:36.449446+0000","last_clean":"2023-11-28T17:39:36.449446+0000","last_became_active":"2023-11-28T17:39:35.065570+0000","last_became_peered":"2023-11-28T17:39:35.065570+0000","last_unstale":"2023-11-28T17:39:36.449446+0000","last_undegraded":"2023-11-28T17:39:36.449446+0000","last_fullsized":"2023-11-28T17:39:36.449446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051520+0000","last_change":"2023-11-28T17:39:35.072179+0000","last_active":"2023-11-28T17:39:36.051520+0000","last_peered":"2023-11-28T17:39:36.051520+0000","last_clean":"2023-11-28T17:39:36.051520+0000","last_became_active":"2023-11-28T17:39:35.071851+0000","last_became_peered":"2023-11-28T17:39:35.071851+0000","last_unstale":"2023-11-28T17:39:36.051520+0000","last_undegraded":"2023-11-28T17:39:36.051520+0000","last_fullsized":"2023-11-28T17:39:36.051520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449666+0000","last_change":"2023-11-28T17:39:35.072638+0000","last_active":"2023-11-28T17:39:36.449666+0000","last_peered":"2023-11-28T17:39:36.449666+0000","last_clean":"2023-11-28T17:39:36.449666+0000","last_became_active":"2023-11-28T17:39:35.072144+0000","last_became_peered":"2023-11-28T17:39:35.072144+0000","last_unstale":"2023-11-28T17:39:36.449666+0000","last_undegraded":"2023-11-28T17:39:36.449666+0000","last_fullsized":"2023-11-28T17:39:36.449666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:42:58.098189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050465+0000","last_change":"2023-11-28T17:39:35.079771+0000","last_active":"2023-11-28T17:39:36.050465+0000","last_peered":"2023-11-28T17:39:36.050465+0000","last_clean":"2023-11-28T17:39:36.050465+0000","last_became_active":"2023-11-28T17:39:35.079423+0000","last_became_peered":"2023-11-28T17:39:35.079423+0000","last_unstale":"2023-11-28T17:39:36.050465+0000","last_undegraded":"2023-11-28T17:39:36.050465+0000","last_fullsized":"2023-11-28T17:39:36.050465+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:36.818905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049922+0000","last_change":"2023-11-28T17:39:35.073441+0000","last_active":"2023-11-28T17:39:36.049922+0000","last_peered":"2023-11-28T17:39:36.049922+0000","last_clean":"2023-11-28T17:39:36.049922+0000","last_became_active":"2023-11-28T17:39:35.072851+0000","last_became_peered":"2023-11-28T17:39:35.072851+0000","last_unstale":"2023-11-28T17:39:36.049922+0000","last_undegraded":"2023-11-28T17:39:36.049922+0000","last_fullsized":"2023-11-28T17:39:36.049922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312430+0000","last_change":"2023-11-28T17:39:35.079706+0000","last_active":"2023-11-28T17:39:36.312430+0000","last_peered":"2023-11-28T17:39:36.312430+0000","last_clean":"2023-11-28T17:39:36.312430+0000","last_became_active":"2023-11-28T17:39:35.079231+0000","last_became_peered":"2023-11-28T17:39:35.079231+0000","last_unstale":"2023-11-28T17:39:36.312430+0000","last_undegraded":"2023-11-28T17:39:36.312430+0000","last_fullsized":"2023-11-28T17:39:36.312430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312261+0000","last_change":"2023-11-28T17:39:35.078579+0000","last_active":"2023-11-28T17:39:36.312261+0000","last_peered":"2023-11-28T17:39:36.312261+0000","last_clean":"2023-11-28T17:39:36.312261+0000","last_became_active":"2023-11-28T17:39:35.078259+0000","last_became_peered":"2023-11-28T17:39:35.078259+0000","last_unstale":"2023-11-28T17:39:36.312261+0000","last_undegraded":"2023-11-28T17:39:36.312261+0000","last_fullsized":"2023-11-28T17:39:36.312261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050907+0000","last_change":"2023-11-28T17:39:35.082408+0000","last_active":"2023-11-28T17:39:36.050907+0000","last_peered":"2023-11-28T17:39:36.050907+0000","last_clean":"2023-11-28T17:39:36.050907+0000","last_became_active":"2023-11-28T17:39:35.082098+0000","last_became_peered":"2023-11-28T17:39:35.082098+0000","last_unstale":"2023-11-28T17:39:36.050907+0000","last_undegraded":"2023-11-28T17:39:36.050907+0000","last_fullsized":"2023-11-28T17:39:36.050907+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:41:40.890748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449034+0000","last_change":"2023-11-28T17:39:35.079528+0000","last_active":"2023-11-28T17:39:36.449034+0000","last_peered":"2023-11-28T17:39:36.449034+0000","last_clean":"2023-11-28T17:39:36.449034+0000","last_became_active":"2023-11-28T17:39:35.079243+0000","last_became_peered":"2023-11-28T17:39:35.079243+0000","last_unstale":"2023-11-28T17:39:36.449034+0000","last_undegraded":"2023-11-28T17:39:36.449034+0000","last_fullsized":"2023-11-28T17:39:36.449034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050194+0000","last_change":"2023-11-28T17:39:35.078211+0000","last_active":"2023-11-28T17:39:36.050194+0000","last_peered":"2023-11-28T17:39:36.050194+0000","last_clean":"2023-11-28T17:39:36.050194+0000","last_became_active":"2023-11-28T17:39:35.077631+0000","last_became_peered":"2023-11-28T17:39:35.077631+0000","last_unstale":"2023-11-28T17:39:36.050194+0000","last_undegraded":"2023-11-28T17:39:36.050194+0000","last_fullsized":"2023-11-28T17:39:36.050194+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:33:13.015991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049377+0000","last_change":"2023-11-28T17:39:35.072541+0000","last_active":"2023-11-28T17:39:36.049377+0000","last_peered":"2023-11-28T17:39:36.049377+0000","last_clean":"2023-11-28T17:39:36.049377+0000","last_became_active":"2023-11-28T17:39:35.072263+0000","last_became_peered":"2023-11-28T17:39:35.072263+0000","last_unstale":"2023-11-28T17:39:36.049377+0000","last_undegraded":"2023-11-28T17:39:36.049377+0000","last_fullsized":"2023-11-28T17:39:36.049377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:06.392677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449588+0000","last_change":"2023-11-28T17:39:35.070782+0000","last_active":"2023-11-28T17:39:36.449588+0000","last_peered":"2023-11-28T17:39:36.449588+0000","last_clean":"2023-11-28T17:39:36.449588+0000","last_became_active":"2023-11-28T17:39:35.070466+0000","last_became_peered":"2023-11-28T17:39:35.070466+0000","last_unstale":"2023-11-28T17:39:36.449588+0000","last_undegraded":"2023-11-28T17:39:36.449588+0000","last_fullsized":"2023-11-28T17:39:36.449588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050871+0000","last_change":"2023-11-28T17:39:34.073844+0000","last_active":"2023-11-28T17:39:36.050871+0000","last_peered":"2023-11-28T17:39:36.050871+0000","last_clean":"2023-11-28T17:39:36.050871+0000","last_became_active":"2023-11-28T17:39:34.073439+0000","last_became_peered":"2023-11-28T17:39:34.073439+0000","last_unstale":"2023-11-28T17:39:36.050871+0000","last_undegraded":"2023-11-28T17:39:36.050871+0000","last_fullsized":"2023-11-28T17:39:36.050871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448062+0000","last_change":"2023-11-28T17:39:35.077086+0000","last_active":"2023-11-28T17:39:36.448062+0000","last_peered":"2023-11-28T17:39:36.448062+0000","last_clean":"2023-11-28T17:39:36.448062+0000","last_became_active":"2023-11-28T17:39:35.076725+0000","last_became_peered":"2023-11-28T17:39:35.076725+0000","last_unstale":"2023-11-28T17:39:36.448062+0000","last_undegraded":"2023-11-28T17:39:36.448062+0000","last_fullsized":"2023-11-28T17:39:36.448062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:59.651986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449252+0000","last_change":"2023-11-28T17:39:34.072648+0000","last_active":"2023-11-28T17:39:36.449252+0000","last_peered":"2023-11-28T17:39:36.449252+0000","last_clean":"2023-11-28T17:39:36.449252+0000","last_became_active":"2023-11-28T17:39:34.072323+0000","last_became_peered":"2023-11-28T17:39:34.072323+0000","last_unstale":"2023-11-28T17:39:36.449252+0000","last_undegraded":"2023-11-28T17:39:36.449252+0000","last_fullsized":"2023-11-28T17:39:36.449252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:54.473940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311863+0000","last_change":"2023-11-28T17:39:34.075937+0000","last_active":"2023-11-28T17:39:36.311863+0000","last_peered":"2023-11-28T17:39:36.311863+0000","last_clean":"2023-11-28T17:39:36.311863+0000","last_became_active":"2023-11-28T17:39:34.075701+0000","last_became_peered":"2023-11-28T17:39:34.075701+0000","last_unstale":"2023-11-28T17:39:36.311863+0000","last_undegraded":"2023-11-28T17:39:36.311863+0000","last_fullsized":"2023-11-28T17:39:36.311863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051241+0000","last_change":"2023-11-28T17:39:35.081382+0000","last_active":"2023-11-28T17:39:36.051241+0000","last_peered":"2023-11-28T17:39:36.051241+0000","last_clean":"2023-11-28T17:39:36.051241+0000","last_became_active":"2023-11-28T17:39:35.080860+0000","last_became_peered":"2023-11-28T17:39:35.080860+0000","last_unstale":"2023-11-28T17:39:36.051241+0000","last_undegraded":"2023-11-28T17:39:36.051241+0000","last_fullsized":"2023-11-28T17:39:36.051241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449747+0000","last_change":"2023-11-28T17:39:34.069183+0000","last_active":"2023-11-28T17:39:36.449747+0000","last_peered":"2023-11-28T17:39:36.449747+0000","last_clean":"2023-11-28T17:39:36.449747+0000","last_became_active":"2023-11-28T17:39:34.068877+0000","last_became_peered":"2023-11-28T17:39:34.068877+0000","last_unstale":"2023-11-28T17:39:36.449747+0000","last_undegraded":"2023-11-28T17:39:36.449747+0000","last_fullsized":"2023-11-28T17:39:36.449747+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:10.897489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448060+0000","last_change":"2023-11-28T17:39:35.068002+0000","last_active":"2023-11-28T17:39:36.448060+0000","last_peered":"2023-11-28T17:39:36.448060+0000","last_clean":"2023-11-28T17:39:36.448060+0000","last_became_active":"2023-11-28T17:39:35.067573+0000","last_became_peered":"2023-11-28T17:39:35.067573+0000","last_unstale":"2023-11-28T17:39:36.448060+0000","last_undegraded":"2023-11-28T17:39:36.448060+0000","last_fullsized":"2023-11-28T17:39:36.448060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:05.125015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449790+0000","last_change":"2023-11-28T17:39:34.071729+0000","last_active":"2023-11-28T17:39:36.449790+0000","last_peered":"2023-11-28T17:39:36.449790+0000","last_clean":"2023-11-28T17:39:36.449790+0000","last_became_active":"2023-11-28T17:39:34.070600+0000","last_became_peered":"2023-11-28T17:39:34.070600+0000","last_unstale":"2023-11-28T17:39:36.449790+0000","last_undegraded":"2023-11-28T17:39:36.449790+0000","last_fullsized":"2023-11-28T17:39:36.449790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:48.746267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049956+0000","last_change":"2023-11-28T17:39:35.073594+0000","last_active":"2023-11-28T17:39:36.049956+0000","last_peered":"2023-11-28T17:39:36.049956+0000","last_clean":"2023-11-28T17:39:36.049956+0000","last_became_active":"2023-11-28T17:39:35.073073+0000","last_became_peered":"2023-11-28T17:39:35.073073+0000","last_unstale":"2023-11-28T17:39:36.049956+0000","last_undegraded":"2023-11-28T17:39:36.049956+0000","last_fullsized":"2023-11-28T17:39:36.049956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:42.553587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450176+0000","last_change":"2023-11-28T17:39:34.074904+0000","last_active":"2023-11-28T17:39:36.450176+0000","last_peered":"2023-11-28T17:39:36.450176+0000","last_clean":"2023-11-28T17:39:36.450176+0000","last_became_active":"2023-11-28T17:39:34.074606+0000","last_became_peered":"2023-11-28T17:39:34.074606+0000","last_unstale":"2023-11-28T17:39:36.450176+0000","last_undegraded":"2023-11-28T17:39:36.450176+0000","last_fullsized":"2023-11-28T17:39:36.450176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:32.724833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051559+0000","last_change":"2023-11-28T17:39:35.070120+0000","last_active":"2023-11-28T17:39:36.051559+0000","last_peered":"2023-11-28T17:39:36.051559+0000","last_clean":"2023-11-28T17:39:36.051559+0000","last_became_active":"2023-11-28T17:39:35.069783+0000","last_became_peered":"2023-11-28T17:39:35.069783+0000","last_unstale":"2023-11-28T17:39:36.051559+0000","last_undegraded":"2023-11-28T17:39:36.051559+0000","last_fullsized":"2023-11-28T17:39:36.051559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.783727+0000","last_change":"2023-11-28T17:39:34.067851+0000","last_active":"2023-11-28T17:39:35.783727+0000","last_peered":"2023-11-28T17:39:35.783727+0000","last_clean":"2023-11-28T17:39:35.783727+0000","last_became_active":"2023-11-28T17:39:34.067453+0000","last_became_peered":"2023-11-28T17:39:34.067453+0000","last_unstale":"2023-11-28T17:39:35.783727+0000","last_undegraded":"2023-11-28T17:39:35.783727+0000","last_fullsized":"2023-11-28T17:39:35.783727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:51:16.353473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448952+0000","last_change":"2023-11-28T17:39:35.062689+0000","last_active":"2023-11-28T17:39:36.448952+0000","last_peered":"2023-11-28T17:39:36.448952+0000","last_clean":"2023-11-28T17:39:36.448952+0000","last_became_active":"2023-11-28T17:39:35.062421+0000","last_became_peered":"2023-11-28T17:39:35.062421+0000","last_unstale":"2023-11-28T17:39:36.448952+0000","last_undegraded":"2023-11-28T17:39:36.448952+0000","last_fullsized":"2023-11-28T17:39:36.448952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:42:06.795396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049994+0000","last_change":"2023-11-28T17:39:34.058487+0000","last_active":"2023-11-28T17:39:36.049994+0000","last_peered":"2023-11-28T17:39:36.049994+0000","last_clean":"2023-11-28T17:39:36.049994+0000","last_became_active":"2023-11-28T17:39:34.058159+0000","last_became_peered":"2023-11-28T17:39:34.058159+0000","last_unstale":"2023-11-28T17:39:36.049994+0000","last_undegraded":"2023-11-28T17:39:36.049994+0000","last_fullsized":"2023-11-28T17:39:36.049994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:20:25.039707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450178+0000","last_change":"2023-11-28T17:39:35.076401+0000","last_active":"2023-11-28T17:39:36.450178+0000","last_peered":"2023-11-28T17:39:36.450178+0000","last_clean":"2023-11-28T17:39:36.450178+0000","last_became_active":"2023-11-28T17:39:35.076015+0000","last_became_peered":"2023-11-28T17:39:35.076015+0000","last_unstale":"2023-11-28T17:39:36.450178+0000","last_undegraded":"2023-11-28T17:39:36.450178+0000","last_fullsized":"2023-11-28T17:39:36.450178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.783711+0000","last_change":"2023-11-28T17:39:34.068303+0000","last_active":"2023-11-28T17:39:35.783711+0000","last_peered":"2023-11-28T17:39:35.783711+0000","last_clean":"2023-11-28T17:39:35.783711+0000","last_became_active":"2023-11-28T17:39:34.066648+0000","last_became_peered":"2023-11-28T17:39:34.066648+0000","last_unstale":"2023-11-28T17:39:35.783711+0000","last_undegraded":"2023-11-28T17:39:35.783711+0000","last_fullsized":"2023-11-28T17:39:35.783711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:24:39.488626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311919+0000","last_change":"2023-11-28T17:39:35.067106+0000","last_active":"2023-11-28T17:39:36.311919+0000","last_peered":"2023-11-28T17:39:36.311919+0000","last_clean":"2023-11-28T17:39:36.311919+0000","last_became_active":"2023-11-28T17:39:35.066673+0000","last_became_peered":"2023-11-28T17:39:35.066673+0000","last_unstale":"2023-11-28T17:39:36.311919+0000","last_undegraded":"2023-11-28T17:39:36.311919+0000","last_fullsized":"2023-11-28T17:39:36.311919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:19.871879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449337+0000","last_change":"2023-11-28T17:39:34.073519+0000","last_active":"2023-11-28T17:39:36.449337+0000","last_peered":"2023-11-28T17:39:36.449337+0000","last_clean":"2023-11-28T17:39:36.449337+0000","last_became_active":"2023-11-28T17:39:34.073200+0000","last_became_peered":"2023-11-28T17:39:34.073200+0000","last_unstale":"2023-11-28T17:39:36.449337+0000","last_undegraded":"2023-11-28T17:39:36.449337+0000","last_fullsized":"2023-11-28T17:39:36.449337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449088+0000","last_change":"2023-11-28T17:39:35.080909+0000","last_active":"2023-11-28T17:39:36.449088+0000","last_peered":"2023-11-28T17:39:36.449088+0000","last_clean":"2023-11-28T17:39:36.449088+0000","last_became_active":"2023-11-28T17:39:35.080072+0000","last_became_peered":"2023-11-28T17:39:35.080072+0000","last_unstale":"2023-11-28T17:39:36.449088+0000","last_undegraded":"2023-11-28T17:39:36.449088+0000","last_fullsized":"2023-11-28T17:39:36.449088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:24:29.464609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448347+0000","last_change":"2023-11-28T17:39:34.069169+0000","last_active":"2023-11-28T17:39:36.448347+0000","last_peered":"2023-11-28T17:39:36.448347+0000","last_clean":"2023-11-28T17:39:36.448347+0000","last_became_active":"2023-11-28T17:39:34.067860+0000","last_became_peered":"2023-11-28T17:39:34.067860+0000","last_unstale":"2023-11-28T17:39:36.448347+0000","last_undegraded":"2023-11-28T17:39:36.448347+0000","last_fullsized":"2023-11-28T17:39:36.448347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:19:18.869334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448881+0000","last_change":"2023-11-28T17:39:35.071533+0000","last_active":"2023-11-28T17:39:36.448881+0000","last_peered":"2023-11-28T17:39:36.448881+0000","last_clean":"2023-11-28T17:39:36.448881+0000","last_became_active":"2023-11-28T17:39:35.071284+0000","last_became_peered":"2023-11-28T17:39:35.071284+0000","last_unstale":"2023-11-28T17:39:36.448881+0000","last_undegraded":"2023-11-28T17:39:36.448881+0000","last_fullsized":"2023-11-28T17:39:36.448881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447799+0000","last_change":"2023-11-28T17:39:34.060653+0000","last_active":"2023-11-28T17:39:36.447799+0000","last_peered":"2023-11-28T17:39:36.447799+0000","last_clean":"2023-11-28T17:39:36.447799+0000","last_became_active":"2023-11-28T17:39:34.060015+0000","last_became_peered":"2023-11-28T17:39:34.060015+0000","last_unstale":"2023-11-28T17:39:36.447799+0000","last_undegraded":"2023-11-28T17:39:36.447799+0000","last_fullsized":"2023-11-28T17:39:36.447799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:12:05.390132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448738+0000","last_change":"2023-11-28T17:39:35.065169+0000","last_active":"2023-11-28T17:39:36.448738+0000","last_peered":"2023-11-28T17:39:36.448738+0000","last_clean":"2023-11-28T17:39:36.448738+0000","last_became_active":"2023-11-28T17:39:35.064318+0000","last_became_peered":"2023-11-28T17:39:35.064318+0000","last_unstale":"2023-11-28T17:39:36.448738+0000","last_undegraded":"2023-11-28T17:39:36.448738+0000","last_fullsized":"2023-11-28T17:39:36.448738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:01:38.878245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450204+0000","last_change":"2023-11-28T17:39:34.062100+0000","last_active":"2023-11-28T17:39:36.450204+0000","last_peered":"2023-11-28T17:39:36.450204+0000","last_clean":"2023-11-28T17:39:36.450204+0000","last_became_active":"2023-11-28T17:39:34.061747+0000","last_became_peered":"2023-11-28T17:39:34.061747+0000","last_unstale":"2023-11-28T17:39:36.450204+0000","last_undegraded":"2023-11-28T17:39:36.450204+0000","last_fullsized":"2023-11-28T17:39:36.450204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050050+0000","last_change":"2023-11-28T17:39:35.065690+0000","last_active":"2023-11-28T17:39:36.050050+0000","last_peered":"2023-11-28T17:39:36.050050+0000","last_clean":"2023-11-28T17:39:36.050050+0000","last_became_active":"2023-11-28T17:39:35.065320+0000","last_became_peered":"2023-11-28T17:39:35.065320+0000","last_unstale":"2023-11-28T17:39:36.050050+0000","last_undegraded":"2023-11-28T17:39:36.050050+0000","last_fullsized":"2023-11-28T17:39:36.050050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:13.847637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448234+0000","last_change":"2023-11-28T17:39:34.061533+0000","last_active":"2023-11-28T17:39:36.448234+0000","last_peered":"2023-11-28T17:39:36.448234+0000","last_clean":"2023-11-28T17:39:36.448234+0000","last_became_active":"2023-11-28T17:39:34.061186+0000","last_became_peered":"2023-11-28T17:39:34.061186+0000","last_unstale":"2023-11-28T17:39:36.448234+0000","last_undegraded":"2023-11-28T17:39:36.448234+0000","last_fullsized":"2023-11-28T17:39:36.448234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:50:12.845092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450173+0000","last_change":"2023-11-28T17:39:35.087511+0000","last_active":"2023-11-28T17:39:36.450173+0000","last_peered":"2023-11-28T17:39:36.450173+0000","last_clean":"2023-11-28T17:39:36.450173+0000","last_became_active":"2023-11-28T17:39:35.086912+0000","last_became_peered":"2023-11-28T17:39:35.086912+0000","last_unstale":"2023-11-28T17:39:36.450173+0000","last_undegraded":"2023-11-28T17:39:36.450173+0000","last_fullsized":"2023-11-28T17:39:36.450173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:46:11.149734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050536+0000","last_change":"2023-11-28T17:39:34.071865+0000","last_active":"2023-11-28T17:39:36.050536+0000","last_peered":"2023-11-28T17:39:36.050536+0000","last_clean":"2023-11-28T17:39:36.050536+0000","last_became_active":"2023-11-28T17:39:34.071567+0000","last_became_peered":"2023-11-28T17:39:34.071567+0000","last_unstale":"2023-11-28T17:39:36.050536+0000","last_undegraded":"2023-11-28T17:39:36.050536+0000","last_fullsized":"2023-11-28T17:39:36.050536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450019+0000","last_change":"2023-11-28T17:39:35.082650+0000","last_active":"2023-11-28T17:39:36.450019+0000","last_peered":"2023-11-28T17:39:36.450019+0000","last_clean":"2023-11-28T17:39:36.450019+0000","last_became_active":"2023-11-28T17:39:35.082382+0000","last_became_peered":"2023-11-28T17:39:35.082382+0000","last_unstale":"2023-11-28T17:39:36.450019+0000","last_undegraded":"2023-11-28T17:39:36.450019+0000","last_fullsized":"2023-11-28T17:39:36.450019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:08.178157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312376+0000","last_change":"2023-11-28T17:39:34.078625+0000","last_active":"2023-11-28T17:39:36.312376+0000","last_peered":"2023-11-28T17:39:36.312376+0000","last_clean":"2023-11-28T17:39:36.312376+0000","last_became_active":"2023-11-28T17:39:34.078378+0000","last_became_peered":"2023-11-28T17:39:34.078378+0000","last_unstale":"2023-11-28T17:39:36.312376+0000","last_undegraded":"2023-11-28T17:39:36.312376+0000","last_fullsized":"2023-11-28T17:39:36.312376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449383+0000","last_change":"2023-11-28T17:39:35.084148+0000","last_active":"2023-11-28T17:39:36.449383+0000","last_peered":"2023-11-28T17:39:36.449383+0000","last_clean":"2023-11-28T17:39:36.449383+0000","last_became_active":"2023-11-28T17:39:35.083942+0000","last_became_peered":"2023-11-28T17:39:35.083942+0000","last_unstale":"2023-11-28T17:39:36.449383+0000","last_undegraded":"2023-11-28T17:39:36.449383+0000","last_fullsized":"2023-11-28T17:39:36.449383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:27:03.153508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":165,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.054275+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:39:35.054275+0000","last_peered":"2023-11-28T17:39:35.054275+0000","last_clean":"2023-11-28T17:39:35.054275+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:39:35.054275+0000","last_undegraded":"2023-11-28T17:39:35.054275+0000","last_fullsized":"2023-11-28T17:39:35.054275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449258+0000","last_change":"2023-11-28T17:39:34.067867+0000","last_active":"2023-11-28T17:39:36.449258+0000","last_peered":"2023-11-28T17:39:36.449258+0000","last_clean":"2023-11-28T17:39:36.449258+0000","last_became_active":"2023-11-28T17:39:34.067560+0000","last_became_peered":"2023-11-28T17:39:34.067560+0000","last_unstale":"2023-11-28T17:39:36.449258+0000","last_undegraded":"2023-11-28T17:39:36.449258+0000","last_fullsized":"2023-11-28T17:39:36.449258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448035+0000","last_change":"2023-11-28T17:39:35.064367+0000","last_active":"2023-11-28T17:39:36.448035+0000","last_peered":"2023-11-28T17:39:36.448035+0000","last_clean":"2023-11-28T17:39:36.448035+0000","last_became_active":"2023-11-28T17:39:35.064054+0000","last_became_peered":"2023-11-28T17:39:35.064054+0000","last_unstale":"2023-11-28T17:39:36.448035+0000","last_undegraded":"2023-11-28T17:39:36.448035+0000","last_fullsized":"2023-11-28T17:39:36.448035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449837+0000","last_change":"2023-11-28T17:39:34.068641+0000","last_active":"2023-11-28T17:39:36.449837+0000","last_peered":"2023-11-28T17:39:36.449837+0000","last_clean":"2023-11-28T17:39:36.449837+0000","last_became_active":"2023-11-28T17:39:34.068347+0000","last_became_peered":"2023-11-28T17:39:34.068347+0000","last_unstale":"2023-11-28T17:39:36.449837+0000","last_undegraded":"2023-11-28T17:39:36.449837+0000","last_fullsized":"2023-11-28T17:39:36.449837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:13:28.994690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.311948+0000","last_change":"2023-11-28T17:39:35.070669+0000","last_active":"2023-11-28T17:39:36.311948+0000","last_peered":"2023-11-28T17:39:36.311948+0000","last_clean":"2023-11-28T17:39:36.311948+0000","last_became_active":"2023-11-28T17:39:35.070353+0000","last_became_peered":"2023-11-28T17:39:35.070353+0000","last_unstale":"2023-11-28T17:39:36.311948+0000","last_undegraded":"2023-11-28T17:39:36.311948+0000","last_fullsized":"2023-11-28T17:39:36.311948+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:25.524344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T17:39:35.783690+0000","last_change":"2023-11-28T17:39:34.067405+0000","last_active":"2023-11-28T17:39:35.783690+0000","last_peered":"2023-11-28T17:39:35.783690+0000","last_clean":"2023-11-28T17:39:35.783690+0000","last_became_active":"2023-11-28T17:39:34.067099+0000","last_became_peered":"2023-11-28T17:39:34.067099+0000","last_unstale":"2023-11-28T17:39:35.783690+0000","last_undegraded":"2023-11-28T17:39:35.783690+0000","last_fullsized":"2023-11-28T17:39:35.783690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:57:42.607678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051234+0000","last_change":"2023-11-28T17:39:35.078142+0000","last_active":"2023-11-28T17:39:36.051234+0000","last_peered":"2023-11-28T17:39:36.051234+0000","last_clean":"2023-11-28T17:39:36.051234+0000","last_became_active":"2023-11-28T17:39:35.077867+0000","last_became_peered":"2023-11-28T17:39:35.077867+0000","last_unstale":"2023-11-28T17:39:36.051234+0000","last_undegraded":"2023-11-28T17:39:36.051234+0000","last_fullsized":"2023-11-28T17:39:36.051234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:15:03.337111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449415+0000","last_change":"2023-11-28T17:39:34.076158+0000","last_active":"2023-11-28T17:39:36.449415+0000","last_peered":"2023-11-28T17:39:36.449415+0000","last_clean":"2023-11-28T17:39:36.449415+0000","last_became_active":"2023-11-28T17:39:34.075800+0000","last_became_peered":"2023-11-28T17:39:34.075800+0000","last_unstale":"2023-11-28T17:39:36.449415+0000","last_undegraded":"2023-11-28T17:39:36.449415+0000","last_fullsized":"2023-11-28T17:39:36.449415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:35.816360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448789+0000","last_change":"2023-11-28T17:39:35.078574+0000","last_active":"2023-11-28T17:39:36.448789+0000","last_peered":"2023-11-28T17:39:36.448789+0000","last_clean":"2023-11-28T17:39:36.448789+0000","last_became_active":"2023-11-28T17:39:35.078265+0000","last_became_peered":"2023-11-28T17:39:35.078265+0000","last_unstale":"2023-11-28T17:39:36.448789+0000","last_undegraded":"2023-11-28T17:39:36.448789+0000","last_fullsized":"2023-11-28T17:39:36.448789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050497+0000","last_change":"2023-11-28T17:39:34.078063+0000","last_active":"2023-11-28T17:39:36.050497+0000","last_peered":"2023-11-28T17:39:36.050497+0000","last_clean":"2023-11-28T17:39:36.050497+0000","last_became_active":"2023-11-28T17:39:34.077766+0000","last_became_peered":"2023-11-28T17:39:34.077766+0000","last_unstale":"2023-11-28T17:39:36.050497+0000","last_undegraded":"2023-11-28T17:39:36.050497+0000","last_fullsized":"2023-11-28T17:39:36.050497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.049860+0000","last_change":"2023-11-28T17:39:35.069368+0000","last_active":"2023-11-28T17:39:36.049860+0000","last_peered":"2023-11-28T17:39:36.049860+0000","last_clean":"2023-11-28T17:39:36.049860+0000","last_became_active":"2023-11-28T17:39:35.068994+0000","last_became_peered":"2023-11-28T17:39:35.068994+0000","last_unstale":"2023-11-28T17:39:36.049860+0000","last_undegraded":"2023-11-28T17:39:36.049860+0000","last_fullsized":"2023-11-28T17:39:36.049860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:29.425851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449620+0000","last_change":"2023-11-28T17:39:34.070446+0000","last_active":"2023-11-28T17:39:36.449620+0000","last_peered":"2023-11-28T17:39:36.449620+0000","last_clean":"2023-11-28T17:39:36.449620+0000","last_became_active":"2023-11-28T17:39:34.070015+0000","last_became_peered":"2023-11-28T17:39:34.070015+0000","last_unstale":"2023-11-28T17:39:36.449620+0000","last_undegraded":"2023-11-28T17:39:36.449620+0000","last_fullsized":"2023-11-28T17:39:36.449620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:36:07.175612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312232+0000","last_change":"2023-11-28T17:39:35.070405+0000","last_active":"2023-11-28T17:39:36.312232+0000","last_peered":"2023-11-28T17:39:36.312232+0000","last_clean":"2023-11-28T17:39:36.312232+0000","last_became_active":"2023-11-28T17:39:35.069566+0000","last_became_peered":"2023-11-28T17:39:35.069566+0000","last_unstale":"2023-11-28T17:39:36.312232+0000","last_undegraded":"2023-11-28T17:39:36.312232+0000","last_fullsized":"2023-11-28T17:39:36.312232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:14:55.476485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.786985+0000","last_change":"2023-11-28T17:39:34.061411+0000","last_active":"2023-11-28T17:39:36.786985+0000","last_peered":"2023-11-28T17:39:36.786985+0000","last_clean":"2023-11-28T17:39:36.786985+0000","last_became_active":"2023-11-28T17:39:34.061056+0000","last_became_peered":"2023-11-28T17:39:34.061056+0000","last_unstale":"2023-11-28T17:39:36.786985+0000","last_undegraded":"2023-11-28T17:39:36.786985+0000","last_fullsized":"2023-11-28T17:39:36.786985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:24.521800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448331+0000","last_change":"2023-11-28T17:39:35.067279+0000","last_active":"2023-11-28T17:39:36.448331+0000","last_peered":"2023-11-28T17:39:36.448331+0000","last_clean":"2023-11-28T17:39:36.448331+0000","last_became_active":"2023-11-28T17:39:35.066864+0000","last_became_peered":"2023-11-28T17:39:35.066864+0000","last_unstale":"2023-11-28T17:39:36.448331+0000","last_undegraded":"2023-11-28T17:39:36.448331+0000","last_fullsized":"2023-11-28T17:39:36.448331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:23.242133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449713+0000","last_change":"2023-11-28T17:39:34.079838+0000","last_active":"2023-11-28T17:39:36.449713+0000","last_peered":"2023-11-28T17:39:36.449713+0000","last_clean":"2023-11-28T17:39:36.449713+0000","last_became_active":"2023-11-28T17:39:34.075803+0000","last_became_peered":"2023-11-28T17:39:34.075803+0000","last_unstale":"2023-11-28T17:39:36.449713+0000","last_undegraded":"2023-11-28T17:39:36.449713+0000","last_fullsized":"2023-11-28T17:39:36.449713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:04:22.239588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448255+0000","last_change":"2023-11-28T17:39:35.070761+0000","last_active":"2023-11-28T17:39:36.448255+0000","last_peered":"2023-11-28T17:39:36.448255+0000","last_clean":"2023-11-28T17:39:36.448255+0000","last_became_active":"2023-11-28T17:39:35.070419+0000","last_became_peered":"2023-11-28T17:39:35.070419+0000","last_unstale":"2023-11-28T17:39:36.448255+0000","last_undegraded":"2023-11-28T17:39:36.448255+0000","last_fullsized":"2023-11-28T17:39:36.448255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448136+0000","last_change":"2023-11-28T17:39:34.060701+0000","last_active":"2023-11-28T17:39:36.448136+0000","last_peered":"2023-11-28T17:39:36.448136+0000","last_clean":"2023-11-28T17:39:36.448136+0000","last_became_active":"2023-11-28T17:39:34.060371+0000","last_became_peered":"2023-11-28T17:39:34.060371+0000","last_unstale":"2023-11-28T17:39:36.448136+0000","last_undegraded":"2023-11-28T17:39:36.448136+0000","last_fullsized":"2023-11-28T17:39:36.448136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448864+0000","last_change":"2023-11-28T17:39:35.064644+0000","last_active":"2023-11-28T17:39:36.448864+0000","last_peered":"2023-11-28T17:39:36.448864+0000","last_clean":"2023-11-28T17:39:36.448864+0000","last_became_active":"2023-11-28T17:39:35.063958+0000","last_became_peered":"2023-11-28T17:39:35.063958+0000","last_unstale":"2023-11-28T17:39:36.448864+0000","last_undegraded":"2023-11-28T17:39:36.448864+0000","last_fullsized":"2023-11-28T17:39:36.448864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:36:07.460143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447972+0000","last_change":"2023-11-28T17:39:34.060063+0000","last_active":"2023-11-28T17:39:36.447972+0000","last_peered":"2023-11-28T17:39:36.447972+0000","last_clean":"2023-11-28T17:39:36.447972+0000","last_became_active":"2023-11-28T17:39:34.059667+0000","last_became_peered":"2023-11-28T17:39:34.059667+0000","last_unstale":"2023-11-28T17:39:36.447972+0000","last_undegraded":"2023-11-28T17:39:36.447972+0000","last_fullsized":"2023-11-28T17:39:36.447972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:44.504010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.447864+0000","last_change":"2023-11-28T17:39:35.069085+0000","last_active":"2023-11-28T17:39:36.447864+0000","last_peered":"2023-11-28T17:39:36.447864+0000","last_clean":"2023-11-28T17:39:36.447864+0000","last_became_active":"2023-11-28T17:39:35.068282+0000","last_became_peered":"2023-11-28T17:39:35.068282+0000","last_unstale":"2023-11-28T17:39:36.447864+0000","last_undegraded":"2023-11-28T17:39:36.447864+0000","last_fullsized":"2023-11-28T17:39:36.447864+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:29.271642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.312049+0000","last_change":"2023-11-28T17:39:34.071879+0000","last_active":"2023-11-28T17:39:36.312049+0000","last_peered":"2023-11-28T17:39:36.312049+0000","last_clean":"2023-11-28T17:39:36.312049+0000","last_became_active":"2023-11-28T17:39:34.071374+0000","last_became_peered":"2023-11-28T17:39:34.071374+0000","last_unstale":"2023-11-28T17:39:36.312049+0000","last_undegraded":"2023-11-28T17:39:36.312049+0000","last_fullsized":"2023-11-28T17:39:36.312049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:28.423307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050789+0000","last_change":"2023-11-28T17:39:35.076243+0000","last_active":"2023-11-28T17:39:36.050789+0000","last_peered":"2023-11-28T17:39:36.050789+0000","last_clean":"2023-11-28T17:39:36.050789+0000","last_became_active":"2023-11-28T17:39:35.075878+0000","last_became_peered":"2023-11-28T17:39:35.075878+0000","last_unstale":"2023-11-28T17:39:36.050789+0000","last_undegraded":"2023-11-28T17:39:36.050789+0000","last_fullsized":"2023-11-28T17:39:36.050789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:55:21.690790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449173+0000","last_change":"2023-11-28T17:39:34.080217+0000","last_active":"2023-11-28T17:39:36.449173+0000","last_peered":"2023-11-28T17:39:36.449173+0000","last_clean":"2023-11-28T17:39:36.449173+0000","last_became_active":"2023-11-28T17:39:34.079885+0000","last_became_peered":"2023-11-28T17:39:34.079885+0000","last_unstale":"2023-11-28T17:39:36.449173+0000","last_undegraded":"2023-11-28T17:39:36.449173+0000","last_fullsized":"2023-11-28T17:39:36.449173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:20:28.269097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449154+0000","last_change":"2023-11-28T17:39:35.081899+0000","last_active":"2023-11-28T17:39:36.449154+0000","last_peered":"2023-11-28T17:39:36.449154+0000","last_clean":"2023-11-28T17:39:36.449154+0000","last_became_active":"2023-11-28T17:39:35.081239+0000","last_became_peered":"2023-11-28T17:39:35.081239+0000","last_unstale":"2023-11-28T17:39:36.449154+0000","last_undegraded":"2023-11-28T17:39:36.449154+0000","last_fullsized":"2023-11-28T17:39:36.449154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:29:36.478729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449756+0000","last_change":"2023-11-28T17:39:35.072258+0000","last_active":"2023-11-28T17:39:36.449756+0000","last_peered":"2023-11-28T17:39:36.449756+0000","last_clean":"2023-11-28T17:39:36.449756+0000","last_became_active":"2023-11-28T17:39:35.071820+0000","last_became_peered":"2023-11-28T17:39:35.071820+0000","last_unstale":"2023-11-28T17:39:36.449756+0000","last_undegraded":"2023-11-28T17:39:36.449756+0000","last_fullsized":"2023-11-28T17:39:36.449756+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:20:25.703521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450044+0000","last_change":"2023-11-28T17:39:34.071815+0000","last_active":"2023-11-28T17:39:36.450044+0000","last_peered":"2023-11-28T17:39:36.450044+0000","last_clean":"2023-11-28T17:39:36.450044+0000","last_became_active":"2023-11-28T17:39:34.070404+0000","last_became_peered":"2023-11-28T17:39:34.070404+0000","last_unstale":"2023-11-28T17:39:36.450044+0000","last_undegraded":"2023-11-28T17:39:36.450044+0000","last_fullsized":"2023-11-28T17:39:36.450044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:35:58.649441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.449165+0000","last_change":"2023-11-28T17:39:35.078177+0000","last_active":"2023-11-28T17:39:36.449165+0000","last_peered":"2023-11-28T17:39:36.449165+0000","last_clean":"2023-11-28T17:39:36.449165+0000","last_became_active":"2023-11-28T17:39:35.077903+0000","last_became_peered":"2023-11-28T17:39:35.077903+0000","last_unstale":"2023-11-28T17:39:36.449165+0000","last_undegraded":"2023-11-28T17:39:36.449165+0000","last_fullsized":"2023-11-28T17:39:36.449165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:03:45.506555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.450137+0000","last_change":"2023-11-28T17:39:34.074770+0000","last_active":"2023-11-28T17:39:36.450137+0000","last_peered":"2023-11-28T17:39:36.450137+0000","last_clean":"2023-11-28T17:39:36.450137+0000","last_became_active":"2023-11-28T17:39:34.074470+0000","last_became_peered":"2023-11-28T17:39:34.074470+0000","last_unstale":"2023-11-28T17:39:36.450137+0000","last_undegraded":"2023-11-28T17:39:36.450137+0000","last_fullsized":"2023-11-28T17:39:36.450137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.050609+0000","last_change":"2023-11-28T17:39:35.079538+0000","last_active":"2023-11-28T17:39:36.050609+0000","last_peered":"2023-11-28T17:39:36.050609+0000","last_clean":"2023-11-28T17:39:36.050609+0000","last_became_active":"2023-11-28T17:39:35.079236+0000","last_became_peered":"2023-11-28T17:39:35.079236+0000","last_unstale":"2023-11-28T17:39:36.050609+0000","last_undegraded":"2023-11-28T17:39:36.050609+0000","last_fullsized":"2023-11-28T17:39:36.050609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:46:33.727378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051095+0000","last_change":"2023-11-28T17:39:34.066171+0000","last_active":"2023-11-28T17:39:36.051095+0000","last_peered":"2023-11-28T17:39:36.051095+0000","last_clean":"2023-11-28T17:39:36.051095+0000","last_became_active":"2023-11-28T17:39:34.065133+0000","last_became_peered":"2023-11-28T17:39:34.065133+0000","last_unstale":"2023-11-28T17:39:36.051095+0000","last_undegraded":"2023-11-28T17:39:36.051095+0000","last_fullsized":"2023-11-28T17:39:36.051095+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:36:04.122470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.051059+0000","last_change":"2023-11-28T17:39:35.069328+0000","last_active":"2023-11-28T17:39:36.051059+0000","last_peered":"2023-11-28T17:39:36.051059+0000","last_clean":"2023-11-28T17:39:36.051059+0000","last_became_active":"2023-11-28T17:39:35.066256+0000","last_became_peered":"2023-11-28T17:39:35.066256+0000","last_unstale":"2023-11-28T17:39:36.051059+0000","last_undegraded":"2023-11-28T17:39:36.051059+0000","last_fullsized":"2023-11-28T17:39:36.051059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:34.038458+0000","last_clean_scrub_stamp":"2023-11-28T17:39:34.038458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:00:11.900034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-11-28T17:39:36.448353+0000","last_change":"2023-11-28T17:39:34.067861+0000","last_active":"2023-11-28T17:39:36.448353+0000","last_peered":"2023-11-28T17:39:36.448353+0000","last_clean":"2023-11-28T17:39:36.448353+0000","last_became_active":"2023-11-28T17:39:34.067203+0000","last_became_peered":"2023-11-28T17:39:34.067203+0000","last_unstale":"2023-11-28T17:39:36.448353+0000","last_undegraded":"2023-11-28T17:39:36.448353+0000","last_fullsized":"2023-11-28T17:39:36.448353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:33.035913+0000","last_clean_scrub_stamp":"2023-11-28T17:39:33.035913+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:41.551043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":76252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5459999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.585}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.609}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.423}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27828,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344012,"statfs":{"total":96636764160,"available":96608268288,"internally_reserved":0,"allocated":823296,"data_stored":666712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.5170000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.341}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":241664,"data_stored":78536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0269999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]}]},{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":225280,"data_stored":76834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.3780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.242}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.1719999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2809999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.3149999999999995}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":77864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":819200,"data_stored":666690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":229376,"data_stored":76308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":76376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:39:44.623 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T17:39:44.623 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T17:39:44.623 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T17:39:44.623 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T17:39:44.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 Processor -- start 2023-11-28T17:39:44.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 -- start start 2023-11-28T17:39:44.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9e340d1f50 0x7f9e340d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e340cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e340d3930 con 0x7f9e3415d540 2023-11-28T17:39:44.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e340b30d0 con 0x7f9e340d1f50 2023-11-28T17:39:44.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e3abf8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3415d920 con 0x7f9e340d34c0 2023-11-28T17:39:44.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e39195640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e340cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e38994640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f9e3415d540 0x7f9e340b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:56756/0 (socket says 172.21.15.16:56756) 2023-11-28T17:39:44.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e33fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9e340d1f50 0x7f9e340d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e38994640 1 -- 172.21.15.16:0/3173308233 learned_addr learned my addr 172.21.15.16:0/3173308233 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:44.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e39195640 1 -- 172.21.15.16:0/3173308233 >> v2:172.21.15.64:3300/0 conn(0x7f9e340d1f50 msgr2=0x7f9e340d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:44.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e39195640 1 --2- 172.21.15.16:0/3173308233 >> v2:172.21.15.64:3300/0 conn(0x7f9e340d1f50 0x7f9e340d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e39195640 1 -- 172.21.15.16:0/3173308233 >> v1:172.21.15.64:6789/0 conn(0x7f9e3415d540 legacy=0x7f9e340b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.799+0000 7f9e39195640 1 -- 172.21.15.16:0/3173308233 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340b32c0 con 0x7f9e340d34c0 2023-11-28T17:39:44.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e39195640 1 --2- 172.21.15.16:0/3173308233 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e340cdde0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009d90 tx=0x7f9e2c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba520af5d76956c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e337fe640 1 -- 172.21.15.16:0/3173308233 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0a59e0 con 0x7f9e340d34c0 2023-11-28T17:39:44.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e337fe640 1 -- 172.21.15.16:0/3173308233 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0a5b40 con 0x7f9e340d34c0 2023-11-28T17:39:44.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e337fe640 1 -- 172.21.15.16:0/3173308233 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0ad440 con 0x7f9e340d34c0 2023-11-28T17:39:44.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3173308233 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 msgr2=0x7f9e340cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3173308233 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e340cdde0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009d90 tx=0x7f9e2c01c920 comp rx=0 tx=0).stop 2023-11-28T17:39:44.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3173308233 shutdown_connections 2023-11-28T17:39:44.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3173308233 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e340cdde0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3173308233 >> v2:172.21.15.64:3300/0 conn(0x7f9e340d1f50 0x7f9e340d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3173308233 >> 172.21.15.16:0/3173308233 conn(0x7f9e3408ccf0 msgr2=0x7f9e3409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:44.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3173308233 shutdown_connections 2023-11-28T17:39:44.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.803+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3173308233 wait complete. 2023-11-28T17:39:44.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 Processor -- start 2023-11-28T17:39:44.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 -- start start 2023-11-28T17:39:44.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 0x7f9e341587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e3415aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e3415d540 0x7f9e340cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340cc520 con 0x7f9e340d1f50 2023-11-28T17:39:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e34160920 con 0x7f9e3415d540 2023-11-28T17:39:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340b2a00 con 0x7f9e340d34c0 2023-11-28T17:39:44.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 0x7f9e341587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 0x7f9e341587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48882/0 (socket says 172.21.15.16:48882) 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 -- 172.21.15.16:0/3239388950 learned_addr learned my addr 172.21.15.16:0/3239388950 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e33fff640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e3415aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e39195640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e3415d540 0x7f9e340cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 -- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 msgr2=0x7f9e3415aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e3415aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 -- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e3415d540 msgr2=0x7f9e340cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e3415d540 0x7f9e340cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 -- 172.21.15.16:0/3239388950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009a70 con 0x7f9e340d1f50 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e38994640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 0x7f9e341587c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c370 tx=0x7f9e2800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28005cf0 con 0x7f9e340d1f50 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28005e50 con 0x7f9e340d1f50 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e34153670 con 0x7f9e340d1f50 2023-11-28T17:39:44.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e280072f0 con 0x7f9e340d1f50 2023-11-28T17:39:44.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.807+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e340b2690 con 0x7f9e340d1f50 2023-11-28T17:39:44.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.811+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e34153860 con 0x7f9e340d1f50 2023-11-28T17:39:44.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.811+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9e28007450 con 0x7f9e340d1f50 2023-11-28T17:39:44.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.811+0000 7f9e317fa640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9e180668d0 0x7f9e18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:44.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.811+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e280839b0 con 0x7f9e340d1f50 2023-11-28T17:39:44.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.811+0000 7f9e33fff640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9e180668d0 0x7f9e18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:44.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.811+0000 7f9e33fff640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9e180668d0 0x7f9e18068d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e3406c520 tx=0x7f9e20009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:44.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:44.815+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e28050c00 con 0x7f9e340d1f50 2023-11-28T17:39:45.009 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9e34068860 con 0x7f9e340d1f50 2023-11-28T17:39:45.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e317fa640 1 -- 172.21.15.16:0/3239388950 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9e28017080 con 0x7f9e340d1f50 2023-11-28T17:39:45.010 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:45.010 INFO:teuthology.orchestra.run.smithi016.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T17:39:45.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9e180668d0 msgr2=0x7f9e18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9e180668d0 0x7f9e18068d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9e3406c520 tx=0x7f9e20009190 comp rx=0 tx=0).stop 2023-11-28T17:39:45.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 msgr2=0x7f9e341587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 0x7f9e341587c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e2800c370 tx=0x7f9e2800c830 comp rx=0 tx=0).stop 2023-11-28T17:39:45.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 shutdown_connections 2023-11-28T17:39:45.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9e180668d0 0x7f9e18068d90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9e3415d540 0x7f9e340cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9e340d34c0 0x7f9e3415aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 --2- 172.21.15.16:0/3239388950 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9e340d1f50 0x7f9e341587c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 >> 172.21.15.16:0/3239388950 conn(0x7f9e3408ccf0 msgr2=0x7f9e340cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:45.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 shutdown_connections 2023-11-28T17:39:45.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.007+0000 7f9e3abf8640 1 -- 172.21.15.16:0/3239388950 wait complete. 2023-11-28T17:39:45.031 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T17:39:45.031 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:45.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 Processor -- start 2023-11-28T17:39:45.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 -- start start 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f97f815b3d0 0x7f97f80cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f97f815f860 0x7f97f80b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f80b4570 con 0x7f97f806e880 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f815fcc0 con 0x7f97f815b3d0 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97ffadd640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f80ceaf0 con 0x7f97f815f860 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f97f815b3d0 0x7f97f80cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f97f815b3d0 0x7f97f80cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48894/0 (socket says 172.21.15.16:48894) 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fe07a640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f97f806e880 0x7f97f80d1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50486/0 (socket says 172.21.15.16:50486) 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 -- 172.21.15.16:0/2520187956 learned_addr learned my addr 172.21.15.16:0/2520187956 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd078640 1 --2- 172.21.15.16:0/2520187956 >> v2:172.21.15.64:3300/0 conn(0x7f97f815f860 0x7f97f80b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 -- 172.21.15.16:0/2520187956 >> v2:172.21.15.64:3300/0 conn(0x7f97f815f860 msgr2=0x7f97f80b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 --2- 172.21.15.16:0/2520187956 >> v2:172.21.15.64:3300/0 conn(0x7f97f815f860 0x7f97f80b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 -- 172.21.15.16:0/2520187956 >> v1:172.21.15.16:6789/0 conn(0x7f97f806e880 legacy=0x7f97f80d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd879640 1 -- 172.21.15.16:0/2520187956 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80d0ba0 con 0x7f97f815b3d0 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fd078640 1 --2- 172.21.15.16:0/2520187956 >> v2:172.21.15.64:3300/0 conn(0x7f97f815f860 0x7f97f80b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:45.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.171+0000 7f97fc877640 1 -- 172.21.15.16:0/2520187956 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735564907 0 0) 0x7f97f80b4570 con 0x7f97f806e880 2023-11-28T17:39:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97fd879640 1 --2- 172.21.15.16:0/2520187956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80cd2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f97f80d21e0 tx=0x7f97f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2492caeeb0475d41 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97fc877640 1 -- 172.21.15.16:0/2520187956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40aa660 con 0x7f97f815b3d0 2023-11-28T17:39:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97fc877640 1 -- 172.21.15.16:0/2520187956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f40aa7c0 con 0x7f97f815b3d0 2023-11-28T17:39:45.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97fc877640 1 -- 172.21.15.16:0/2520187956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f40aab50 con 0x7f97f815b3d0 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 -- 172.21.15.16:0/2520187956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 msgr2=0x7f97f80cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 --2- 172.21.15.16:0/2520187956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80cd2f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f97f80d21e0 tx=0x7f97f401c500 comp rx=0 tx=0).stop 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 -- 172.21.15.16:0/2520187956 shutdown_connections 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 --2- 172.21.15.16:0/2520187956 >> v2:172.21.15.64:3300/0 conn(0x7f97f815f860 0x7f97f80b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 --2- 172.21.15.16:0/2520187956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80cd2f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 -- 172.21.15.16:0/2520187956 >> 172.21.15.16:0/2520187956 conn(0x7f97f806a5a0 msgr2=0x7f97f806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 -- 172.21.15.16:0/2520187956 shutdown_connections 2023-11-28T17:39:45.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.175+0000 7f97ffadd640 1 -- 172.21.15.16:0/2520187956 wait complete. 2023-11-28T17:39:45.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 Processor -- start 2023-11-28T17:39:45.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 -- start start 2023-11-28T17:39:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97f806e880 0x7f97f8165b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97f815f860 0x7f97f80ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80ca090 con 0x7f97f815b3d0 2023-11-28T17:39:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c9480 con 0x7f97f806e880 2023-11-28T17:39:45.184 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f80c9760 con 0x7f97f815f860 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48902/0 (socket says 172.21.15.16:48902) 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 -- 172.21.15.16:0/421304021 learned_addr learned my addr 172.21.15.16:0/421304021 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fe07a640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97f815f860 0x7f97f80ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd879640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97f806e880 0x7f97f8165b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 -- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97f815f860 msgr2=0x7f97f80ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97f815f860 0x7f97f80ca820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 -- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97f806e880 msgr2=0x7f97f8165b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97f806e880 0x7f97f8165b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 -- 172.21.15.16:0/421304021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f40094d0 con 0x7f97f815b3d0 2023-11-28T17:39:45.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd879640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97f806e880 0x7f97f8165b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fe07a640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97f815f860 0x7f97f80ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97fd078640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80c8aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f97e800e810 tx=0x7f97e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800c8d0 con 0x7f97f815b3d0 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e800ca30 con 0x7f97f815b3d0 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f80c9a40 con 0x7f97f815b3d0 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e800cdc0 con 0x7f97f815b3d0 2023-11-28T17:39:45.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.179+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f815da80 con 0x7f97f815b3d0 2023-11-28T17:39:45.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.183+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f80ca240 con 0x7f97f815b3d0 2023-11-28T17:39:45.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.183+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f97e8013410 con 0x7f97f815b3d0 2023-11-28T17:39:45.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.183+0000 7f97ee7fc640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f97dc066900 0x7f97dc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.183+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97e8084240 con 0x7f97f815b3d0 2023-11-28T17:39:45.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.183+0000 7f97fd879640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f97dc066900 0x7f97dc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.183+0000 7f97fd879640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f97dc066900 0x7f97dc068dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ae000 tx=0x7f97f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.187+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97f80ca240 con 0x7f97f815b3d0 2023-11-28T17:39:45.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.347+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97f8068860 con 0x7f97f815b3d0 2023-11-28T17:39:45.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.347+0000 7f97ee7fc640 1 -- 172.21.15.16:0/421304021 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f97e8051480 con 0x7f97f815b3d0 2023-11-28T17:39:45.352 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:45.352 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:45.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f97dc066900 msgr2=0x7f97dc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f97dc066900 0x7f97dc068dc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97f40ae000 tx=0x7f97f4008040 comp rx=0 tx=0).stop 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 msgr2=0x7f97f80c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80c8aa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f97e800e810 tx=0x7f97e800ecd0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 shutdown_connections 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f97f815f860 0x7f97f80ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f97f815b3d0 0x7f97f80c8aa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f97dc066900 0x7f97dc068dc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 --2- 172.21.15.16:0/421304021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f97f806e880 0x7f97f8165b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 >> 172.21.15.16:0/421304021 conn(0x7f97f806a5a0 msgr2=0x7f97f80cfb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:45.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 shutdown_connections 2023-11-28T17:39:45.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.351+0000 7f97ffadd640 1 -- 172.21.15.16:0/421304021 wait complete. 2023-11-28T17:39:45.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:39:45.373 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:39:45.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.515+0000 7fa27ec09640 1 Processor -- start 2023-11-28T17:39:45.520 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.515+0000 7fa27ec09640 1 -- start start 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27ec09640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa278072090 0x7fa2780cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27ec09640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa27815b350 0x7fa2780cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27ec09640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa27815a8b0 con 0x7fa2781548e0 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27ec09640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2780ce860 con 0x7fa27815b350 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27ec09640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27815a6a0 con 0x7fa278072090 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27c9a5640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa2781548e0 0x7fa2780ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50492/0 (socket says 172.21.15.16:50492) 2023-11-28T17:39:45.521 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27c9a5640 1 -- 172.21.15.16:0/1596444188 learned_addr learned my addr 172.21.15.16:0/1596444188 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27d1a6640 1 --2- 172.21.15.16:0/1596444188 >> v2:172.21.15.64:3300/0 conn(0x7fa27815b350 0x7fa2780cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa277fff640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa278072090 0x7fa2780cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa2777fe640 1 -- 172.21.15.16:0/1596444188 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960622290 0 0) 0x7fa27815a8b0 con 0x7fa2781548e0 2023-11-28T17:39:45.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa2777fe640 1 -- 172.21.15.16:0/1596444188 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa268003530 con 0x7fa2781548e0 2023-11-28T17:39:45.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa2777fe640 1 -- 172.21.15.16:0/1596444188 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3531964647 0 0) 0x7fa268003530 con 0x7fa2781548e0 2023-11-28T17:39:45.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27d1a6640 1 -- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa278072090 msgr2=0x7fa2780cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:45.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27d1a6640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa278072090 0x7fa2780cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27d1a6640 1 -- 172.21.15.16:0/1596444188 >> v1:172.21.15.16:6789/0 conn(0x7fa2781548e0 legacy=0x7fa2780ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa27d1a6640 1 -- 172.21.15.16:0/1596444188 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2780cea50 con 0x7fa27815b350 2023-11-28T17:39:45.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.519+0000 7fa277fff640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa278072090 0x7fa2780cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:45.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27d1a6640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa27815b350 0x7fa2780cf470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa27000bfa0 tx=0x7fa27001ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=519228f1df350639 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa2777fe640 1 -- 172.21.15.16:0/1596444188 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26c001680 con 0x7fa27815b350 2023-11-28T17:39:45.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa2777fe640 1 -- 172.21.15.16:0/1596444188 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27000b0d0 con 0x7fa27815b350 2023-11-28T17:39:45.525 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa2777fe640 1 -- 172.21.15.16:0/1596444188 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2700a7670 con 0x7fa27815b350 2023-11-28T17:39:45.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 -- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa27815b350 msgr2=0x7fa2780cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa27815b350 0x7fa2780cf470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa27000bfa0 tx=0x7fa27001ea70 comp rx=0 tx=0).stop 2023-11-28T17:39:45.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 -- 172.21.15.16:0/1596444188 shutdown_connections 2023-11-28T17:39:45.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa27815b350 0x7fa2780cf470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1596444188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa278072090 0x7fa2780cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.526 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 -- 172.21.15.16:0/1596444188 >> 172.21.15.16:0/1596444188 conn(0x7fa27806a5a0 msgr2=0x7fa27806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:45.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 -- 172.21.15.16:0/1596444188 shutdown_connections 2023-11-28T17:39:45.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 -- 172.21.15.16:0/1596444188 wait complete. 2023-11-28T17:39:45.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 Processor -- start 2023-11-28T17:39:45.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.523+0000 7fa27ec09640 1 -- start start 2023-11-28T17:39:45.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa278072090 0x7fa278142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 0x7fa27814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa27815b350 0x7fa27815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814fcf0 con 0x7fa2781548e0 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27814a780 con 0x7fa278072090 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa278149e50 con 0x7fa27815b350 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 0x7fa27814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 0x7fa27814f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48914/0 (socket says 172.21.15.16:48914) 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 -- 172.21.15.16:0/1087692461 learned_addr learned my addr 172.21.15.16:0/1087692461 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27c9a5640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa278072090 0x7fa278142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27d1a6640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa27815b350 0x7fa27815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 -- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa27815b350 msgr2=0x7fa27815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa27815b350 0x7fa27815b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 -- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa278072090 msgr2=0x7fa278142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa278072090 0x7fa278142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 -- 172.21.15.16:0/1087692461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa264009420 con 0x7fa2781548e0 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa277fff640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 0x7fa27814f3e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa26400e9b0 tx=0x7fa26400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa26400c9a0 con 0x7fa2781548e0 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400cb00 con 0x7fa2781548e0 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa27000bc80 con 0x7fa2781548e0 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa264013470 con 0x7fa2781548e0 2023-11-28T17:39:45.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa27814a410 con 0x7fa2781548e0 2023-11-28T17:39:45.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.527+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa27814a5d0 con 0x7fa2781548e0 2023-11-28T17:39:45.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.531+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa2640135d0 con 0x7fa2781548e0 2023-11-28T17:39:45.533 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.531+0000 7fa2757fa640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa25c0668d0 0x7fa25c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.531+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa264084410 con 0x7fa2781548e0 2023-11-28T17:39:45.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.531+0000 7fa27c9a5640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa25c0668d0 0x7fa25c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.531+0000 7fa27c9a5640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa25c0668d0 0x7fa25c068d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa26c001b00 tx=0x7fa26c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.535+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa264051530 con 0x7fa2781548e0 2023-11-28T17:39:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.695+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa27814a8f0 con 0x7fa2781548e0 2023-11-28T17:39:45.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.695+0000 7fa2757fa640 1 -- 172.21.15.16:0/1087692461 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa264054b50 con 0x7fa2781548e0 2023-11-28T17:39:45.700 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa25c0668d0 msgr2=0x7fa25c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa25c0668d0 0x7fa25c068d90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa26c001b00 tx=0x7fa26c009040 comp rx=0 tx=0).stop 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 msgr2=0x7fa27814f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 0x7fa27814f3e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa26400e9b0 tx=0x7fa26400ee70 comp rx=0 tx=0).stop 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 shutdown_connections 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa27815b350 0x7fa27815b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2781548e0 0x7fa27814f3e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa25c0668d0 0x7fa25c068d90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 --2- 172.21.15.16:0/1087692461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa278072090 0x7fa278142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 >> 172.21.15.16:0/1087692461 conn(0x7fa27806a5a0 msgr2=0x7fa278150940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:45.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 shutdown_connections 2023-11-28T17:39:45.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.699+0000 7fa27ec09640 1 -- 172.21.15.16:0/1087692461 wait complete. 2023-11-28T17:39:45.721 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:39:45.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc82ea640 1 Processor -- start 2023-11-28T17:39:45.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc82ea640 1 -- start start 2023-11-28T17:39:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc82ea640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9dc0144c80 0x7f9dc00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc82ea640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00ce4f0 con 0x7f9dc00cf640 2023-11-28T17:39:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc82ea640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00ce7d0 con 0x7f9dc00cdf00 2023-11-28T17:39:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc82ea640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00709b0 con 0x7f9dc0144c80 2023-11-28T17:39:45.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc6887640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9dc00cf640 0x7f9dc0070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50504/0 (socket says 172.21.15.16:50504) 2023-11-28T17:39:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc6887640 1 -- 172.21.15.16:0/4290107130 learned_addr learned my addr 172.21.15.16:0/4290107130 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc6086640 1 --2- 172.21.15.16:0/4290107130 >> v2:172.21.15.64:3300/0 conn(0x7f9dc0144c80 0x7f9dc00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737083426 0 0) 0x7f9dc00ce4f0 con 0x7f9dc00cf640 2023-11-28T17:39:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.863+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dac003530 con 0x7f9dc00cf640 2023-11-28T17:39:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541875244 0 0) 0x7f9dc00ce7d0 con 0x7f9dc00cdf00 2023-11-28T17:39:45.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dc00ce4f0 con 0x7f9dc00cdf00 2023-11-28T17:39:45.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49552846 0 0) 0x7f9dac003530 con 0x7f9dc00cf640 2023-11-28T17:39:45.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc6086640 1 -- 172.21.15.16:0/4290107130 >> v1:172.21.15.64:6789/0 conn(0x7f9dc00cdf00 legacy=0x7f9dc00cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc6086640 1 -- 172.21.15.16:0/4290107130 >> v1:172.21.15.16:6789/0 conn(0x7f9dc00cf640 legacy=0x7f9dc0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc6086640 1 -- 172.21.15.16:0/4290107130 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00ceab0 con 0x7f9dc0144c80 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc6086640 1 --2- 172.21.15.16:0/4290107130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc0144c80 0x7f9dc00cd9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097c0 tx=0x7f9dbc01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768ca1f53b893350 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db8001a00 con 0x7f9dc0144c80 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc0a7050 con 0x7f9dc0144c80 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc5084640 1 -- 172.21.15.16:0/4290107130 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc0ab620 con 0x7f9dc0144c80 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4290107130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc0144c80 msgr2=0x7f9dc00cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.867+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4290107130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc0144c80 0x7f9dc00cd9c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097c0 tx=0x7f9dbc01c3a0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4290107130 shutdown_connections 2023-11-28T17:39:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4290107130 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc0144c80 0x7f9dc00cd9c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4290107130 >> 172.21.15.16:0/4290107130 conn(0x7f9dc006a5a0 msgr2=0x7f9dc006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4290107130 shutdown_connections 2023-11-28T17:39:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4290107130 wait complete. 2023-11-28T17:39:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 Processor -- start 2023-11-28T17:39:45.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- start start 2023-11-28T17:39:45.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 0x7f9dc0158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc00cf640 0x7f9dc0140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9dc0144c80 0x7f9dc013aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00ae990 con 0x7f9dc00cdf00 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0141180 con 0x7f9dc00cf640 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc82ea640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0141460 con 0x7f9dc0144c80 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 0x7f9dc0158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 0x7f9dc0158400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48918/0 (socket says 172.21.15.16:48918) 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 -- 172.21.15.16:0/4135241851 learned_addr learned my addr 172.21.15.16:0/4135241851 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc5885640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc00cf640 0x7f9dc0140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6887640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9dc0144c80 0x7f9dc013aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 -- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9dc0144c80 msgr2=0x7f9dc013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9dc0144c80 0x7f9dc013aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 -- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc00cf640 msgr2=0x7f9dc0140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:45.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc00cf640 0x7f9dc0140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:45.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 -- 172.21.15.16:0/4135241851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009420 con 0x7f9dc00cdf00 2023-11-28T17:39:45.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc5885640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc00cf640 0x7f9dc0140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:45.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.871+0000 7f9dc6086640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 0x7f9dc0158400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097c0 tx=0x7f9dbc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc004020 con 0x7f9dc00cdf00 2023-11-28T17:39:45.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc004180 con 0x7f9dc00cdf00 2023-11-28T17:39:45.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc003620 con 0x7f9dc00cdf00 2023-11-28T17:39:45.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc0141740 con 0x7f9dc00cdf00 2023-11-28T17:39:45.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc0158b00 con 0x7f9dc00cdf00 2023-11-28T17:39:45.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc0068860 con 0x7f9dc00cdf00 2023-11-28T17:39:45.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9dbc003780 con 0x7f9dc00cdf00 2023-11-28T17:39:45.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9db6ffd640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9da40668d0 0x7f9da4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:45.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9dbc11e790 con 0x7f9dc00cdf00 2023-11-28T17:39:45.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.875+0000 7f9dc5885640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9da40668d0 0x7f9da4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:45.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.879+0000 7f9dc5885640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9da40668d0 0x7f9da4068d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9dc01583b0 tx=0x7f9db0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:45.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:45.879+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9dbc0eb9c0 con 0x7f9dc00cdf00 2023-11-28T17:39:46.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.035+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9dc015b2e0 con 0x7f9dc00cdf00 2023-11-28T17:39:46.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.035+0000 7f9db6ffd640 1 -- 172.21.15.16:0/4135241851 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9dbc0eefe0 con 0x7f9dc00cdf00 2023-11-28T17:39:46.039 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9da40668d0 msgr2=0x7f9da4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9da40668d0 0x7f9da4068d90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9dc01583b0 tx=0x7f9db0009040 comp rx=0 tx=0).stop 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 msgr2=0x7f9dc0158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 0x7f9dc0158400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0097c0 tx=0x7f9dbc01abe0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 shutdown_connections 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9dc0144c80 0x7f9dc013aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9da40668d0 0x7f9da4068d90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9dc00cf640 0x7f9dc0140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 --2- 172.21.15.16:0/4135241851 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9dc00cdf00 0x7f9dc0158400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 >> 172.21.15.16:0/4135241851 conn(0x7f9dc006a5a0 msgr2=0x7f9dc0138630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:46.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 shutdown_connections 2023-11-28T17:39:46.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.039+0000 7f9dc82ea640 1 -- 172.21.15.16:0/4135241851 wait complete. 2023-11-28T17:39:46.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:39:46.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 Processor -- start 2023-11-28T17:39:46.207 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 -- start start 2023-11-28T17:39:46.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb5e015d620 0x7fb5e00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e00cbcd0 con 0x7fb5e006d300 2023-11-28T17:39:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e006f250 con 0x7fb5e015d620 2023-11-28T17:39:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e750f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00cee20 con 0x7fb5e006e880 2023-11-28T17:39:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e52ab640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb5e015d620 0x7fb5e00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e52ab640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb5e015d620 0x7fb5e00cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48922/0 (socket says 172.21.15.16:48922) 2023-11-28T17:39:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e52ab640 1 -- 172.21.15.16:0/432219911 learned_addr learned my addr 172.21.15.16:0/432219911 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e4aaa640 1 --1- 172.21.15.16:0/432219911 >> v1:172.21.15.16:6789/0 conn(0x7fb5e006d300 0x7fb5e0161a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:50510/0 (socket says 172.21.15.16:50510) 2023-11-28T17:39:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.203+0000 7fb5e5aac640 1 --2- 172.21.15.16:0/432219911 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e52ab640 1 -- 172.21.15.16:0/432219911 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 msgr2=0x7fb5e006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e52ab640 1 --2- 172.21.15.16:0/432219911 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e006ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e52ab640 1 -- 172.21.15.16:0/432219911 >> v1:172.21.15.16:6789/0 conn(0x7fb5e006d300 legacy=0x7fb5e0161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e52ab640 1 -- 172.21.15.16:0/432219911 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e00cf100 con 0x7fb5e015d620 2023-11-28T17:39:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e52ab640 1 --2- 172.21.15.16:0/432219911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00cb790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0098a0 tx=0x7fb5dc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff79dcf1358531e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5d7fff640 1 -- 172.21.15.16:0/432219911 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0aa650 con 0x7fb5e015d620 2023-11-28T17:39:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5d7fff640 1 -- 172.21.15.16:0/432219911 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc0aa7b0 con 0x7fb5e015d620 2023-11-28T17:39:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5d7fff640 1 -- 172.21.15.16:0/432219911 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0aab40 con 0x7fb5e015d620 2023-11-28T17:39:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e750f640 1 -- 172.21.15.16:0/432219911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 msgr2=0x7fb5e00cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e750f640 1 --2- 172.21.15.16:0/432219911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00cb790 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0098a0 tx=0x7fb5dc01c4f0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e750f640 1 -- 172.21.15.16:0/432219911 shutdown_connections 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e750f640 1 --2- 172.21.15.16:0/432219911 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e750f640 1 --2- 172.21.15.16:0/432219911 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00cb790 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.207+0000 7fb5e750f640 1 -- 172.21.15.16:0/432219911 >> 172.21.15.16:0/432219911 conn(0x7fb5e006a5a0 msgr2=0x7fb5e006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- 172.21.15.16:0/432219911 shutdown_connections 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- 172.21.15.16:0/432219911 wait complete. 2023-11-28T17:39:46.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 Processor -- start 2023-11-28T17:39:46.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- start start 2023-11-28T17:39:46.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5e006d300 0x7fb5e0160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e00b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0160bc0 con 0x7fb5e015d620 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e015dea0 con 0x7fb5e006d300 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e00addb0 con 0x7fb5e006e880 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48934/0 (socket says 172.21.15.16:48934) 2023-11-28T17:39:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 -- 172.21.15.16:0/2909106480 learned_addr learned my addr 172.21.15.16:0/2909106480 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e4aaa640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e00b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e52ab640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5e006d300 0x7fb5e0160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 -- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 msgr2=0x7fb5e00b0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e00b0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 -- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5e006d300 msgr2=0x7fb5e0160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5e006d300 0x7fb5e0160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 -- 172.21.15.16:0/2909106480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0094d0 con 0x7fb5e015d620 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e52ab640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5e006d300 0x7fb5e0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e4aaa640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e00b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e5aac640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00ad6b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8007e40 tx=0x7fb5d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8014620 con 0x7fb5e015d620 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d800ee90 con 0x7fb5e015d620 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e00ae090 con 0x7fb5e015d620 2023-11-28T17:39:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.211+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d80149e0 con 0x7fb5e015d620 2023-11-28T17:39:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.215+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e00ae370 con 0x7fb5e015d620 2023-11-28T17:39:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.215+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e015e050 con 0x7fb5e015d620 2023-11-28T17:39:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.215+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb5d8014b40 con 0x7fb5e015d620 2023-11-28T17:39:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.215+0000 7fb5d5ffb640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5c4066900 0x7fb5c4068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.215+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb5d8084d80 con 0x7fb5e015d620 2023-11-28T17:39:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.215+0000 7fb5e52ab640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5c4066900 0x7fb5c4068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.219+0000 7fb5e52ab640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5c4066900 0x7fb5c4068dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0ae000 tx=0x7fb5dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.219+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5e015e050 con 0x7fb5e015d620 2023-11-28T17:39:46.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.379+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5e015e010 con 0x7fb5e015d620 2023-11-28T17:39:46.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.379+0000 7fb5d5ffb640 1 -- 172.21.15.16:0/2909106480 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb5d8051fb0 con 0x7fb5e015d620 2023-11-28T17:39:46.384 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:39:46.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5c4066900 msgr2=0x7fb5c4068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5c4066900 0x7fb5c4068dc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0ae000 tx=0x7fb5dc008040 comp rx=0 tx=0).stop 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 msgr2=0x7fb5e00ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00ad6b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8007e40 tx=0x7fb5d800e4b0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 shutdown_connections 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb5e015d620 0x7fb5e00ad6b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb5e006e880 0x7fb5e00b0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5c4066900 0x7fb5c4068dc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 --2- 172.21.15.16:0/2909106480 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5e006d300 0x7fb5e0160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 >> 172.21.15.16:0/2909106480 conn(0x7fb5e006a5a0 msgr2=0x7fb5e00b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:46.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 shutdown_connections 2023-11-28T17:39:46.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.383+0000 7fb5e750f640 1 -- 172.21.15.16:0/2909106480 wait complete. 2023-11-28T17:39:46.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:39:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.543+0000 7f54b23f8640 1 Processor -- start 2023-11-28T17:39:46.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.543+0000 7f54b23f8640 1 -- start start 2023-11-28T17:39:46.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b23f8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f54ac15d2c0 0x7f54ac0d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b23f8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f54ac0d1d00 0x7f54ac0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b23f8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54ac0afdb0 con 0x7f54ac15d6a0 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b23f8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0b34b0 con 0x7f54ac0d1d00 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b23f8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54ac0b2b80 con 0x7f54ac15d2c0 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f54ac0d1d00 0x7f54ac0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f54ac0d1d00 0x7f54ac0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48938/0 (socket says 172.21.15.16:48938) 2023-11-28T17:39:46.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 -- 172.21.15.16:0/321045483 learned_addr learned my addr 172.21.15.16:0/321045483 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b13f6640 1 --2- 172.21.15.16:0/321045483 >> v2:172.21.15.64:3300/0 conn(0x7f54ac15d2c0 0x7f54ac0d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 -- 172.21.15.16:0/321045483 >> v2:172.21.15.64:3300/0 conn(0x7f54ac15d2c0 msgr2=0x7f54ac0d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 --2- 172.21.15.16:0/321045483 >> v2:172.21.15.64:3300/0 conn(0x7f54ac15d2c0 0x7f54ac0d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 -- 172.21.15.16:0/321045483 >> v1:172.21.15.64:6789/0 conn(0x7f54ac15d6a0 legacy=0x7f54ac0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b0bf5640 1 -- 172.21.15.16:0/321045483 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ac0b2e60 con 0x7f54ac0d1d00 2023-11-28T17:39:46.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.547+0000 7f54b13f6640 1 --2- 172.21.15.16:0/321045483 >> v2:172.21.15.64:3300/0 conn(0x7f54ac15d2c0 0x7f54ac0d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:46.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b0bf5640 1 --2- 172.21.15.16:0/321045483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac0d1d00 0x7f54ac0cfbf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0b5d40 tx=0x7f549c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a38c61701c960f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54a3fff640 1 -- 172.21.15.16:0/321045483 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0ac600 con 0x7f54ac0d1d00 2023-11-28T17:39:46.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54a3fff640 1 -- 172.21.15.16:0/321045483 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0a8050 con 0x7f54ac0d1d00 2023-11-28T17:39:46.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54a3fff640 1 -- 172.21.15.16:0/321045483 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0ac980 con 0x7f54ac0d1d00 2023-11-28T17:39:46.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 -- 172.21.15.16:0/321045483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac0d1d00 msgr2=0x7f54ac0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 --2- 172.21.15.16:0/321045483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac0d1d00 0x7f54ac0cfbf0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f54ac0b5d40 tx=0x7f549c01c490 comp rx=0 tx=0).stop 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 -- 172.21.15.16:0/321045483 shutdown_connections 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 --2- 172.21.15.16:0/321045483 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac0d1d00 0x7f54ac0cfbf0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 --2- 172.21.15.16:0/321045483 >> v2:172.21.15.64:3300/0 conn(0x7f54ac15d2c0 0x7f54ac0d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 -- 172.21.15.16:0/321045483 >> 172.21.15.16:0/321045483 conn(0x7f54ac09c550 msgr2=0x7f54ac0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 -- 172.21.15.16:0/321045483 shutdown_connections 2023-11-28T17:39:46.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 -- 172.21.15.16:0/321045483 wait complete. 2023-11-28T17:39:46.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 Processor -- start 2023-11-28T17:39:46.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.551+0000 7f54b23f8640 1 -- start start 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54ac0d1d00 0x7f54ac1532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 0x7f54ac06b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15d6a0 0x7f54ac15efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac06b770 con 0x7f54ac15d2c0 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac06b980 con 0x7f54ac15d6a0 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54ac06bc60 con 0x7f54ac0d1d00 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 0x7f54ac06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 0x7f54ac06b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48944/0 (socket says 172.21.15.16:48944) 2023-11-28T17:39:46.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 -- 172.21.15.16:0/188641689 learned_addr learned my addr 172.21.15.16:0/188641689 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b13f6640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54ac0d1d00 0x7f54ac1532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 -- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54ac0d1d00 msgr2=0x7f54ac1532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b1bf7640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15d6a0 0x7f54ac15efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54ac0d1d00 0x7f54ac1532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 -- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15d6a0 msgr2=0x7f54ac15efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15d6a0 0x7f54ac15efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 -- 172.21.15.16:0/188641689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0094d0 con 0x7f54ac15d2c0 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b13f6640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54ac0d1d00 0x7f54ac1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b1bf7640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15d6a0 0x7f54ac15efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b0bf5640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 0x7f54ac06b230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f549c01ab40 tx=0x7f549c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0bc070 con 0x7f54ac15d2c0 2023-11-28T17:39:46.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0b7450 con 0x7f54ac15d2c0 2023-11-28T17:39:46.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac06bf40 con 0x7f54ac15d2c0 2023-11-28T17:39:46.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c0b7800 con 0x7f54ac15d2c0 2023-11-28T17:39:46.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54ac06c500 con 0x7f54ac15d2c0 2023-11-28T17:39:46.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.555+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54ac160ad0 con 0x7f54ac15d2c0 2023-11-28T17:39:46.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.559+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f549c0b3070 con 0x7f54ac15d2c0 2023-11-28T17:39:46.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.559+0000 7f54a1ffb640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f54900668d0 0x7f5490068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.559+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f549c11deb0 con 0x7f54ac15d2c0 2023-11-28T17:39:46.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.559+0000 7f54b13f6640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f54900668d0 0x7f5490068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.559+0000 7f54b13f6640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f54900668d0 0x7f5490068d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54ac1f9860 tx=0x7f54a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.563+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f549c0eb050 con 0x7f54ac15d2c0 2023-11-28T17:39:46.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.751+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54ac06c6f0 con 0x7f54ac15d2c0 2023-11-28T17:39:46.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.751+0000 7f54a1ffb640 1 -- 172.21.15.16:0/188641689 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f549c0ee670 con 0x7f54ac15d2c0 2023-11-28T17:39:46.755 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:46.755 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:39:46.756 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:39:46.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f54900668d0 msgr2=0x7f5490068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f54900668d0 0x7f5490068d90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f54ac1f9860 tx=0x7f54a8008040 comp rx=0 tx=0).stop 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 msgr2=0x7f54ac06b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 0x7f54ac06b230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f549c01ab40 tx=0x7f549c01acd0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 shutdown_connections 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f54900668d0 0x7f5490068d90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54ac15d6a0 0x7f54ac15efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f54ac15d2c0 0x7f54ac06b230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 --2- 172.21.15.16:0/188641689 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f54ac0d1d00 0x7f54ac1532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 >> 172.21.15.16:0/188641689 conn(0x7f54ac09c550 msgr2=0x7f54ac1567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 shutdown_connections 2023-11-28T17:39:46.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.755+0000 7f54b23f8640 1 -- 172.21.15.16:0/188641689 wait complete. 2023-11-28T17:39:46.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:46.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.919+0000 7f399e1d1640 1 Processor -- start 2023-11-28T17:39:46.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.919+0000 7f399e1d1640 1 -- start start 2023-11-28T17:39:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f399e1d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f399815f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f399e1d1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f399806e880 0x7f399806ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f399e1d1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f399806f220 con 0x7f399815b3d0 2023-11-28T17:39:46.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f399e1d1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39980cd750 con 0x7f399806e880 2023-11-28T17:39:46.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f399e1d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39980ceaf0 con 0x7f39980cd2f0 2023-11-28T17:39:46.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f39977fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f399815b3d0 0x7f39980b4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39628/0 (socket says 172.21.15.16:39628) 2023-11-28T17:39:46.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f39977fe640 1 -- 172.21.15.16:0/3870912996 learned_addr learned my addr 172.21.15.16:0/3870912996 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3997fff640 1 --2- 172.21.15.16:0/3870912996 >> v2:172.21.15.64:3300/0 conn(0x7f399806e880 0x7f399806ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3996ffd640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f399815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f39967fc640 1 -- 172.21.15.16:0/3870912996 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409553232 0 0) 0x7f399806f220 con 0x7f399815b3d0 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f39967fc640 1 -- 172.21.15.16:0/3870912996 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3980003530 con 0x7f399815b3d0 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3997fff640 1 -- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 msgr2=0x7f399815f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3997fff640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f399815f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3997fff640 1 -- 172.21.15.16:0/3870912996 >> v1:172.21.15.16:6789/0 conn(0x7f399815b3d0 legacy=0x7f39980b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3997fff640 1 -- 172.21.15.16:0/3870912996 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39980d0ba0 con 0x7f399806e880 2023-11-28T17:39:46.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.923+0000 7f3996ffd640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f399815f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f3997fff640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f399806ece0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3990009d90 tx=0x7f399001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b31aa1aa66a1c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f39967fc640 1 -- 172.21.15.16:0/3870912996 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900a5a10 con 0x7f399806e880 2023-11-28T17:39:46.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f39967fc640 1 -- 172.21.15.16:0/3870912996 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900a5b70 con 0x7f399806e880 2023-11-28T17:39:46.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f39967fc640 1 -- 172.21.15.16:0/3870912996 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900ad440 con 0x7f399806e880 2023-11-28T17:39:46.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 -- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 msgr2=0x7f399806ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f399806ece0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3990009d90 tx=0x7f399001c950 comp rx=0 tx=0).stop 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 -- 172.21.15.16:0/3870912996 shutdown_connections 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f399806ece0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 --2- 172.21.15.16:0/3870912996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f399815f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 -- 172.21.15.16:0/3870912996 >> 172.21.15.16:0/3870912996 conn(0x7f399806a5a0 msgr2=0x7f399806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 -- 172.21.15.16:0/3870912996 shutdown_connections 2023-11-28T17:39:46.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 -- 172.21.15.16:0/3870912996 wait complete. 2023-11-28T17:39:46.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 Processor -- start 2023-11-28T17:39:46.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 -- start start 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.927+0000 7f399e1d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f39981494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f39980ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 0x7f39980ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998149a20 con 0x7f399815b3d0 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3998165110 con 0x7f399806e880 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39981653f0 con 0x7f39980cd2f0 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 0x7f39980ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 0x7f39980ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48790/0 (socket says 172.21.15.16:48790) 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 -- 172.21.15.16:0/4036507652 learned_addr learned my addr 172.21.15.16:0/4036507652 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:46.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f39977fe640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f39981494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3996ffd640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f39980ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 -- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 msgr2=0x7f39980ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f39980ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 -- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 msgr2=0x7f39981494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f39981494e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 -- 172.21.15.16:0/4036507652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c009420 con 0x7f399815b3d0 2023-11-28T17:39:46.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f39977fe640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f39981494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:46.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f3997fff640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 0x7f39980ca600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f399001a580 tx=0x7f39900196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900aed30 con 0x7f399815b3d0 2023-11-28T17:39:46.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39900aee90 con 0x7f399815b3d0 2023-11-28T17:39:46.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3990009a70 con 0x7f399815b3d0 2023-11-28T17:39:46.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39900b7610 con 0x7f399815b3d0 2023-11-28T17:39:46.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39981659b0 con 0x7f399815b3d0 2023-11-28T17:39:46.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3998068860 con 0x7f399815b3d0 2023-11-28T17:39:46.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.931+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f39900b4050 con 0x7f399815b3d0 2023-11-28T17:39:46.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.935+0000 7f397ffff640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f39840668d0 0x7f3984068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:46.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.935+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f399011f640 con 0x7f399815b3d0 2023-11-28T17:39:46.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.935+0000 7f39977fe640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f39840668d0 0x7f3984068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:46.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.935+0000 7f39977fe640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f39840668d0 0x7f3984068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3988005890 tx=0x7f3988009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:46.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:46.939+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39900ec7f0 con 0x7f399815b3d0 2023-11-28T17:39:47.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.099+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39980ce390 con 0x7f399815b3d0 2023-11-28T17:39:47.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.099+0000 7f397ffff640 1 -- 172.21.15.16:0/4036507652 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f3990009450 con 0x7f399815b3d0 2023-11-28T17:39:47.103 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:47.103 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f39840668d0 msgr2=0x7f3984068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f39840668d0 0x7f3984068d90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3988005890 tx=0x7f3988009040 comp rx=0 tx=0).stop 2023-11-28T17:39:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 msgr2=0x7f39980ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 0x7f39980ca600 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f399001a580 tx=0x7f39900196f0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 shutdown_connections 2023-11-28T17:39:47.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f399815b3d0 0x7f39980ca600 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f39980cd2f0 0x7f39980ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f39840668d0 0x7f3984068d90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 --2- 172.21.15.16:0/4036507652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f399806e880 0x7f39981494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 >> 172.21.15.16:0/4036507652 conn(0x7f399806a5a0 msgr2=0x7f399815cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:47.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 shutdown_connections 2023-11-28T17:39:47.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.103+0000 7f399e1d1640 1 -- 172.21.15.16:0/4036507652 wait complete. 2023-11-28T17:39:47.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:39:47.125 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:39:47.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88fc1c3640 1 Processor -- start 2023-11-28T17:39:47.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88fc1c3640 1 -- start start 2023-11-28T17:39:47.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88fc1c3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f88f40cf3b0 0x7f88f40714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88fc1c3640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40ce4f0 con 0x7f88f40cef30 2023-11-28T17:39:47.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88fc1c3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f40ce7d0 con 0x7f88f4144c80 2023-11-28T17:39:47.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88fc1c3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f40709b0 con 0x7f88f40cf3b0 2023-11-28T17:39:47.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88f975e640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f88f40cef30 0x7f88f4070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39636/0 (socket says 172.21.15.16:39636) 2023-11-28T17:39:47.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.267+0000 7f88f975e640 1 -- 172.21.15.16:0/2574991698 learned_addr learned my addr 172.21.15.16:0/2574991698 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:47.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88fa760640 1 --2- 172.21.15.16:0/2574991698 >> v2:172.21.15.64:3300/0 conn(0x7f88f40cf3b0 0x7f88f40714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799412820 0 0) 0x7f88f40ce4f0 con 0x7f88f40cef30 2023-11-28T17:39:47.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e0003530 con 0x7f88f40cef30 2023-11-28T17:39:47.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 426271316 0 0) 0x7f88f40ce7d0 con 0x7f88f4144c80 2023-11-28T17:39:47.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f40ce4f0 con 0x7f88f4144c80 2023-11-28T17:39:47.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88fa760640 1 -- 172.21.15.16:0/2574991698 >> v1:172.21.15.64:6789/0 conn(0x7f88f4144c80 legacy=0x7f88f40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88fa760640 1 -- 172.21.15.16:0/2574991698 >> v1:172.21.15.16:6789/0 conn(0x7f88f40cef30 legacy=0x7f88f4070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88fa760640 1 -- 172.21.15.16:0/2574991698 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40ceab0 con 0x7f88f40cf3b0 2023-11-28T17:39:47.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88fa760640 1 --2- 172.21.15.16:0/2574991698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40714e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009d90 tx=0x7f88ec01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9e4c34f0c489b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0a5920 con 0x7f88f40cf3b0 2023-11-28T17:39:47.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec0a5a80 con 0x7f88f40cf3b0 2023-11-28T17:39:47.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.271+0000 7f88f8f5d640 1 -- 172.21.15.16:0/2574991698 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ec0a5e10 con 0x7f88f40cf3b0 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- 172.21.15.16:0/2574991698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 msgr2=0x7f88f40714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/2574991698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40714e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009d90 tx=0x7f88ec01c950 comp rx=0 tx=0).stop 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- 172.21.15.16:0/2574991698 shutdown_connections 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/2574991698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40714e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- 172.21.15.16:0/2574991698 >> 172.21.15.16:0/2574991698 conn(0x7f88f406a5a0 msgr2=0x7f88f406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- 172.21.15.16:0/2574991698 shutdown_connections 2023-11-28T17:39:47.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- 172.21.15.16:0/2574991698 wait complete. 2023-11-28T17:39:47.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 Processor -- start 2023-11-28T17:39:47.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- start start 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 0x7f88f40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88f4144c80 0x7f88f40ad710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40ad280 con 0x7f88f40cef30 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40ac950 con 0x7f88f40cf3b0 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fc1c3640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f40acc30 con 0x7f88f4144c80 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 0x7f88f40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 0x7f88f40cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48792/0 (socket says 172.21.15.16:48792) 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 -- 172.21.15.16:0/130507897 learned_addr learned my addr 172.21.15.16:0/130507897 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f975e640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fa760640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88f4144c80 0x7f88f40ad710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 -- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88f4144c80 msgr2=0x7f88f40ad710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88f4144c80 0x7f88f40ad710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 -- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 msgr2=0x7f88f40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f9f5f640 1 -- 172.21.15.16:0/130507897 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec009a70 con 0x7f88f40cef30 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88f975e640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.275+0000 7f88fa760640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88f4144c80 0x7f88f40ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:47.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88f9f5f640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 0x7f88f40cc980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f88f000c490 tx=0x7f88f000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f00052d0 con 0x7f88f40cef30 2023-11-28T17:39:47.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f0005430 con 0x7f88f40cef30 2023-11-28T17:39:47.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0012870 con 0x7f88f40cef30 2023-11-28T17:39:47.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f40acf10 con 0x7f88f40cef30 2023-11-28T17:39:47.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f4158920 con 0x7f88f40cef30 2023-11-28T17:39:47.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f40ad0a0 con 0x7f88f40cef30 2023-11-28T17:39:47.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f88f00129d0 con 0x7f88f40cef30 2023-11-28T17:39:47.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88ea7fc640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88d80668d0 0x7f88d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88f0084150 con 0x7f88f40cef30 2023-11-28T17:39:47.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.279+0000 7f88f975e640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88d80668d0 0x7f88d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.283+0000 7f88f975e640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88d80668d0 0x7f88d8068d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b0e70 tx=0x7f88e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.283+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88f00512f0 con 0x7f88f40cef30 2023-11-28T17:39:47.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.443+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88f4068860 con 0x7f88f40cef30 2023-11-28T17:39:47.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.443+0000 7f88ea7fc640 1 -- 172.21.15.16:0/130507897 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88f0054910 con 0x7f88f40cef30 2023-11-28T17:39:47.446 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:39:47.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88d80668d0 msgr2=0x7f88d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88d80668d0 0x7f88d8068d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b0e70 tx=0x7f88e4009040 comp rx=0 tx=0).stop 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 msgr2=0x7f88f40cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 0x7f88f40cc980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f88f000c490 tx=0x7f88f000c950 comp rx=0 tx=0).stop 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 shutdown_connections 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88f4144c80 0x7f88f40ad710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88d80668d0 0x7f88d8068d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88f40cf3b0 0x7f88f40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 --2- 172.21.15.16:0/130507897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88f40cef30 0x7f88f40cc980 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 >> 172.21.15.16:0/130507897 conn(0x7f88f406a5a0 msgr2=0x7f88f415bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 shutdown_connections 2023-11-28T17:39:47.449 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.447+0000 7f88fc1c3640 1 -- 172.21.15.16:0/130507897 wait complete. 2023-11-28T17:39:47.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:39:47.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 Processor -- start 2023-11-28T17:39:47.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 -- start start 2023-11-28T17:39:47.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f533815d620 0x7f53380cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f533806e880 0x7f533806ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533806f210 con 0x7f533806d300 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380cbcd0 con 0x7f533815d620 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533c85a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53380cee20 con 0x7f533806e880 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f533815d620 0x7f53380cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f533815d620 0x7f53380cb790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48806/0 (socket says 172.21.15.16:48806) 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 -- 172.21.15.16:0/3916602053 learned_addr learned my addr 172.21.15.16:0/3916602053 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f532ffff640 1 --1- 172.21.15.16:0/3916602053 >> v1:172.21.15.16:6789/0 conn(0x7f533806d300 0x7f5338161a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39638/0 (socket says 172.21.15.16:39638) 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 -- 172.21.15.16:0/3916602053 >> v2:172.21.15.64:3300/0 conn(0x7f533806e880 msgr2=0x7f533806ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f5336d9d640 1 --2- 172.21.15.16:0/3916602053 >> v2:172.21.15.64:3300/0 conn(0x7f533806e880 0x7f533806ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 --2- 172.21.15.16:0/3916602053 >> v2:172.21.15.64:3300/0 conn(0x7f533806e880 0x7f533806ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 -- 172.21.15.16:0/3916602053 >> v1:172.21.15.16:6789/0 conn(0x7f533806d300 legacy=0x7f5338161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f533659c640 1 -- 172.21.15.16:0/3916602053 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53380cf100 con 0x7f533815d620 2023-11-28T17:39:47.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.611+0000 7f5336d9d640 1 --2- 172.21.15.16:0/3916602053 >> v2:172.21.15.64:3300/0 conn(0x7f533806e880 0x7f533806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533659c640 1 --2- 172.21.15.16:0/3916602053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533815d620 0x7f53380cb790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5328009870 tx=0x7f532801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e611d51fa15ddb4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f5335d9b640 1 -- 172.21.15.16:0/3916602053 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280aa430 con 0x7f533815d620 2023-11-28T17:39:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f5335d9b640 1 -- 172.21.15.16:0/3916602053 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53280aa590 con 0x7f533815d620 2023-11-28T17:39:47.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f5335d9b640 1 -- 172.21.15.16:0/3916602053 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53280aa920 con 0x7f533815d620 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 -- 172.21.15.16:0/3916602053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533815d620 msgr2=0x7f53380cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 --2- 172.21.15.16:0/3916602053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533815d620 0x7f53380cb790 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5328009870 tx=0x7f532801c4d0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 -- 172.21.15.16:0/3916602053 shutdown_connections 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 --2- 172.21.15.16:0/3916602053 >> v2:172.21.15.64:3300/0 conn(0x7f533806e880 0x7f533806ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 --2- 172.21.15.16:0/3916602053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533815d620 0x7f53380cb790 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 -- 172.21.15.16:0/3916602053 >> 172.21.15.16:0/3916602053 conn(0x7f533806a5a0 msgr2=0x7f533806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:47.619 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 -- 172.21.15.16:0/3916602053 shutdown_connections 2023-11-28T17:39:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 -- 172.21.15.16:0/3916602053 wait complete. 2023-11-28T17:39:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 Processor -- start 2023-11-28T17:39:47.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.615+0000 7f533c85a640 1 -- start start 2023-11-28T17:39:47.621 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f533806d300 0x7f53380b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 0x7f533815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f533815d620 0x7f5338154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53380c69e0 con 0x7f533806e880 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5338155f70 con 0x7f533815d620 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5338155360 con 0x7f533806d300 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 0x7f533815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 0x7f533815da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48818/0 (socket says 172.21.15.16:48818) 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 -- 172.21.15.16:0/4032021563 learned_addr learned my addr 172.21.15.16:0/4032021563 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f5336d9d640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f533815d620 0x7f5338154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533659c640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f533806d300 0x7f53380b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 -- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f533806d300 msgr2=0x7f53380b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f533806d300 0x7f53380b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.622 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 -- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f533815d620 msgr2=0x7f5338154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f533815d620 0x7f5338154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 -- 172.21.15.16:0/4032021563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53280094d0 con 0x7f533806e880 2023-11-28T17:39:47.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f5336d9d640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f533815d620 0x7f5338154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532ffff640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 0x7f533815da00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f532000c430 tx=0x7f532000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200074e0 con 0x7f533806e880 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320007640 con 0x7f533806e880 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5338155640 con 0x7f533806e880 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320004a10 con 0x7f533806e880 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5338155c00 con 0x7f533806e880 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.619+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5338155d90 con 0x7f533806e880 2023-11-28T17:39:47.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.623+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5320004b70 con 0x7f533806e880 2023-11-28T17:39:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.623+0000 7f532effd640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5318066900 0x7f5318068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.623+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5320083cd0 con 0x7f533806e880 2023-11-28T17:39:47.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.623+0000 7f533659c640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5318066900 0x7f5318068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.623+0000 7f533659c640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5318066900 0x7f5318068dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53280ae000 tx=0x7f53280b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.627+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5320050e70 con 0x7f533806e880 2023-11-28T17:39:47.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53381560e0 con 0x7f533806e880 2023-11-28T17:39:47.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f532effd640 1 -- 172.21.15.16:0/4032021563 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5320054490 con 0x7f533806e880 2023-11-28T17:39:47.786 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:39:47.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5318066900 msgr2=0x7f5318068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5318066900 0x7f5318068dc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f53280ae000 tx=0x7f53280b5040 comp rx=0 tx=0).stop 2023-11-28T17:39:47.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 msgr2=0x7f533815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 0x7f533815da00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f532000c430 tx=0x7f532000c8f0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 shutdown_connections 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5318066900 0x7f5318068dc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f533815d620 0x7f5338154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f533806e880 0x7f533815da00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 --2- 172.21.15.16:0/4032021563 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f533806d300 0x7f53380b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.783+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 >> 172.21.15.16:0/4032021563 conn(0x7f533806a5a0 msgr2=0x7f533806c280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.787+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 shutdown_connections 2023-11-28T17:39:47.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.787+0000 7f533c85a640 1 -- 172.21.15.16:0/4032021563 wait complete. 2023-11-28T17:39:47.811 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:39:47.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.951+0000 7f03dfcaa640 1 Processor -- start 2023-11-28T17:39:47.956 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.951+0000 7f03dfcaa640 1 -- start start 2023-11-28T17:39:47.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03dfcaa640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f03d8070460 0x7f03d80708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03dfcaa640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03d8145100 0x7f03d8145500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03dfcaa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d8070e00 con 0x7f03d8161710 2023-11-28T17:39:47.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03dfcaa640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d806c6d0 con 0x7f03d8145100 2023-11-28T17:39:47.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03dfcaa640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d806c9b0 con 0x7f03d8070460 2023-11-28T17:39:47.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03d8145100 0x7f03d8145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f03d8145100 0x7f03d8145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48834/0 (socket says 172.21.15.16:48834) 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 -- 172.21.15.16:0/2644441480 learned_addr learned my addr 172.21.15.16:0/2644441480 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03dd245640 1 --2- 172.21.15.16:0/2644441480 >> v2:172.21.15.64:3300/0 conn(0x7f03d8070460 0x7f03d80708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 -- 172.21.15.16:0/2644441480 >> v2:172.21.15.64:3300/0 conn(0x7f03d8070460 msgr2=0x7f03d80708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 --2- 172.21.15.16:0/2644441480 >> v2:172.21.15.64:3300/0 conn(0x7f03d8070460 0x7f03d80708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 -- 172.21.15.16:0/2644441480 >> v1:172.21.15.64:6789/0 conn(0x7f03d8161710 legacy=0x7f03d8165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:47.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.955+0000 7f03de247640 1 -- 172.21.15.16:0/2644441480 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d806cc90 con 0x7f03d8145100 2023-11-28T17:39:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03de247640 1 --2- 172.21.15.16:0/2644441480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8145500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03d80744c0 tx=0x7f03d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5964d0a06e1be0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dca44640 1 -- 172.21.15.16:0/2644441480 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00a5860 con 0x7f03d8145100 2023-11-28T17:39:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dca44640 1 -- 172.21.15.16:0/2644441480 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d00a59c0 con 0x7f03d8145100 2023-11-28T17:39:47.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dca44640 1 -- 172.21.15.16:0/2644441480 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d00a5d50 con 0x7f03d8145100 2023-11-28T17:39:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 -- 172.21.15.16:0/2644441480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 msgr2=0x7f03d8145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/2644441480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8145500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f03d80744c0 tx=0x7f03d001c9a0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 -- 172.21.15.16:0/2644441480 shutdown_connections 2023-11-28T17:39:47.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/2644441480 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8145500 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/2644441480 >> v2:172.21.15.64:3300/0 conn(0x7f03d8070460 0x7f03d80708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 -- 172.21.15.16:0/2644441480 >> 172.21.15.16:0/2644441480 conn(0x7f03d806a5a0 msgr2=0x7f03d806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 -- 172.21.15.16:0/2644441480 shutdown_connections 2023-11-28T17:39:47.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 -- 172.21.15.16:0/2644441480 wait complete. 2023-11-28T17:39:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 Processor -- start 2023-11-28T17:39:47.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.959+0000 7f03dfcaa640 1 -- start start 2023-11-28T17:39:47.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03d8070460 0x7f03d8143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03d8161710 0x7f03d8142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d80b1c60 con 0x7f03d8145100 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8159650 con 0x7f03d8161710 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d8164180 con 0x7f03d8070460 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8164890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48840/0 (socket says 172.21.15.16:48840) 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 -- 172.21.15.16:0/1431682670 learned_addr learned my addr 172.21.15.16:0/1431682670 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03de247640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03d8161710 0x7f03d8142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dda46640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03d8070460 0x7f03d8143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 -- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03d8070460 msgr2=0x7f03d8143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03d8070460 0x7f03d8143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 -- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03d8161710 msgr2=0x7f03d8142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03d8161710 0x7f03d8142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 -- 172.21.15.16:0/1431682670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0009b30 con 0x7f03d8145100 2023-11-28T17:39:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dda46640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03d8070460 0x7f03d8143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:47.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dd245640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8164890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d620 tx=0x7f03c800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800b620 con 0x7f03d8145100 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c800b780 con 0x7f03d8145100 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d80b16c0 con 0x7f03d8145100 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c800bb10 con 0x7f03d8145100 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d8162040 con 0x7f03d8145100 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.963+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d81457e0 con 0x7f03d8145100 2023-11-28T17:39:47.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.967+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f03c800bc70 con 0x7f03d8145100 2023-11-28T17:39:47.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.967+0000 7f03ce7fc640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f03bc0668d0 0x7f03bc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:47.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.967+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03c8084920 con 0x7f03d8145100 2023-11-28T17:39:47.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.967+0000 7f03dda46640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f03bc0668d0 0x7f03bc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:47.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.967+0000 7f03dda46640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f03bc0668d0 0x7f03bc068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03d4000f70 tx=0x7f03d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:47.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:47.971+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03c8051ac0 con 0x7f03d8145100 2023-11-28T17:39:48.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.131+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f03d8068860 con 0x7f03d8145100 2023-11-28T17:39:48.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.131+0000 7f03ce7fc640 1 -- 172.21.15.16:0/1431682670 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f03c8007380 con 0x7f03d8145100 2023-11-28T17:39:48.136 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:39:48.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f03bc0668d0 msgr2=0x7f03bc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f03bc0668d0 0x7f03bc068d90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f03d4000f70 tx=0x7f03d4009040 comp rx=0 tx=0).stop 2023-11-28T17:39:48.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 msgr2=0x7f03d8164890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8164890 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f03c800d620 tx=0x7f03c800dae0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 shutdown_connections 2023-11-28T17:39:48.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f03bc0668d0 0x7f03bc068d90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f03d8161710 0x7f03d8142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f03d8145100 0x7f03d8164890 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 --2- 172.21.15.16:0/1431682670 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f03d8070460 0x7f03d8143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 >> 172.21.15.16:0/1431682670 conn(0x7f03d806a5a0 msgr2=0x7f03d815ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:48.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 shutdown_connections 2023-11-28T17:39:48.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.135+0000 7f03dfcaa640 1 -- 172.21.15.16:0/1431682670 wait complete. 2023-11-28T17:39:48.157 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:39:48.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.295+0000 7f8bf1be6640 1 Processor -- start 2023-11-28T17:39:48.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.295+0000 7f8bf1be6640 1 -- start start 2023-11-28T17:39:48.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bf1be6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec0cef30 0x7f8bec0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bf1be6640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8bec070dd0 0x7f8bec071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bf1be6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bec0ce4f0 con 0x7f8bec144c80 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bf1be6640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bec0709b0 con 0x7f8bec070dd0 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bf1be6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec145060 con 0x7f8bec0cef30 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8bec070dd0 0x7f8bec071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f8bec070dd0 0x7f8bec071260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48844/0 (socket says 172.21.15.16:48844) 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 -- 172.21.15.16:0/2978297693 learned_addr learned my addr 172.21.15.16:0/2978297693 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8beaffd640 1 --2- 172.21.15.16:0/2978297693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec0cef30 0x7f8bec0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 -- 172.21.15.16:0/2978297693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec0cef30 msgr2=0x7f8bec0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:48.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 --2- 172.21.15.16:0/2978297693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec0cef30 0x7f8bec0cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 -- 172.21.15.16:0/2978297693 >> v1:172.21.15.64:6789/0 conn(0x7f8bec144c80 legacy=0x7f8bec0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.304 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.299+0000 7f8bebfff640 1 -- 172.21.15.16:0/2978297693 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec0ce7d0 con 0x7f8bec070dd0 2023-11-28T17:39:48.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bebfff640 1 --2- 172.21.15.16:0/2978297693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec071260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009e50 tx=0x7f8be401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db73764384e7ea0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:48.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bea7fc640 1 -- 172.21.15.16:0/2978297693 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40a5600 con 0x7f8bec070dd0 2023-11-28T17:39:48.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bea7fc640 1 -- 172.21.15.16:0/2978297693 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be40a5760 con 0x7f8bec070dd0 2023-11-28T17:39:48.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bea7fc640 1 -- 172.21.15.16:0/2978297693 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be40a5af0 con 0x7f8bec070dd0 2023-11-28T17:39:48.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 -- 172.21.15.16:0/2978297693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 msgr2=0x7f8bec071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/2978297693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec071260 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009e50 tx=0x7f8be401c830 comp rx=0 tx=0).stop 2023-11-28T17:39:48.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 -- 172.21.15.16:0/2978297693 shutdown_connections 2023-11-28T17:39:48.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/2978297693 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec071260 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/2978297693 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec0cef30 0x7f8bec0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 -- 172.21.15.16:0/2978297693 >> 172.21.15.16:0/2978297693 conn(0x7f8bec06a5a0 msgr2=0x7f8bec06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:48.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 -- 172.21.15.16:0/2978297693 shutdown_connections 2023-11-28T17:39:48.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 -- 172.21.15.16:0/2978297693 wait complete. 2023-11-28T17:39:48.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 Processor -- start 2023-11-28T17:39:48.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.303+0000 7f8bf1be6640 1 -- start start 2023-11-28T17:39:48.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec0cef30 0x7f8bec134b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec144c80 0x7f8bec15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec156a60 con 0x7f8bec070dd0 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec136d30 con 0x7f8bec0cef30 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bec137010 con 0x7f8bec144c80 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec156520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48850/0 (socket says 172.21.15.16:48850) 2023-11-28T17:39:48.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 -- 172.21.15.16:0/812515964 learned_addr learned my addr 172.21.15.16:0/812515964 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beaffd640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec0cef30 0x7f8bec134b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bebfff640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec144c80 0x7f8bec15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 -- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec144c80 msgr2=0x7f8bec15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec144c80 0x7f8bec15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 -- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec0cef30 msgr2=0x7f8bec134b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec0cef30 0x7f8bec134b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 -- 172.21.15.16:0/812515964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4009b30 con 0x7f8bec070dd0 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bebfff640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec144c80 0x7f8bec15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beaffd640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec0cef30 0x7f8bec134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8beb7fe640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec156520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c500 tx=0x7f8bdc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc005220 con 0x7f8bec070dd0 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc005380 con 0x7f8bec070dd0 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bec1372f0 con 0x7f8bec070dd0 2023-11-28T17:39:48.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc007270 con 0x7f8bec070dd0 2023-11-28T17:39:48.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bec1375d0 con 0x7f8bec070dd0 2023-11-28T17:39:48.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bec141ba0 con 0x7f8bec070dd0 2023-11-28T17:39:48.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.307+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8bdc0073d0 con 0x7f8bec070dd0 2023-11-28T17:39:48.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.311+0000 7f8bd3fff640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8bd8066900 0x7f8bd8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.311+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bdc083d60 con 0x7f8bec070dd0 2023-11-28T17:39:48.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.311+0000 7f8beaffd640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8bd8066900 0x7f8bd8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.315 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.311+0000 7f8beaffd640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8bd8066900 0x7f8bd8068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8bec13ceb0 tx=0x7f8be0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:48.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.315+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bdc050f10 con 0x7f8bec070dd0 2023-11-28T17:39:48.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bec068860 con 0x7f8bec070dd0 2023-11-28T17:39:48.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bd3fff640 1 -- 172.21.15.16:0/812515964 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f8bdc054530 con 0x7f8bec070dd0 2023-11-28T17:39:48.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:48.509 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:39:48.509 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:39:48.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8bd8066900 msgr2=0x7f8bd8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8bd8066900 0x7f8bd8068dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8bec13ceb0 tx=0x7f8be0008040 comp rx=0 tx=0).stop 2023-11-28T17:39:48.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 msgr2=0x7f8bec156520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec156520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c500 tx=0x7f8bdc00c9c0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 shutdown_connections 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8bec144c80 0x7f8bec15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8bd8066900 0x7f8bd8068dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8bec0cef30 0x7f8bec134b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 --2- 172.21.15.16:0/812515964 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8bec070dd0 0x7f8bec156520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 >> 172.21.15.16:0/812515964 conn(0x7f8bec06a5a0 msgr2=0x7f8bec0b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 shutdown_connections 2023-11-28T17:39:48.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.507+0000 7f8bf1be6640 1 -- 172.21.15.16:0/812515964 wait complete. 2023-11-28T17:39:48.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:48.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 Processor -- start 2023-11-28T17:39:48.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 -- start start 2023-11-28T17:39:48.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb94c144c80 0x7fb94c0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb94c0cf640 0x7fb94c070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c0ce4f0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c0709b0 con 0x7fb94c0cf640 2023-11-28T17:39:48.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb951c9c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb94c145060 con 0x7fb94c144c80 2023-11-28T17:39:48.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb94c0cf640 0x7fb94c070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb94c0cf640 0x7fb94c070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48856/0 (socket says 172.21.15.16:48856) 2023-11-28T17:39:48.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 -- 172.21.15.16:0/2523589366 learned_addr learned my addr 172.21.15.16:0/2523589366 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:48.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94b7fe640 1 --2- 172.21.15.16:0/2523589366 >> v2:172.21.15.64:3300/0 conn(0x7fb94c144c80 0x7fb94c0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 -- 172.21.15.16:0/2523589366 >> v2:172.21.15.64:3300/0 conn(0x7fb94c144c80 msgr2=0x7fb94c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:48.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 --2- 172.21.15.16:0/2523589366 >> v2:172.21.15.64:3300/0 conn(0x7fb94c144c80 0x7fb94c0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 -- 172.21.15.16:0/2523589366 >> v1:172.21.15.64:6789/0 conn(0x7fb94c0cdf00 legacy=0x7fb94c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.671+0000 7fb94bfff640 1 -- 172.21.15.16:0/2523589366 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0ce7d0 con 0x7fb94c0cf640 2023-11-28T17:39:48.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb94bfff640 1 --2- 172.21.15.16:0/2523589366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cf640 0x7fb94c070dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0b1dd0 tx=0x7fb94401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e799e4aab283187c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:48.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb94a7fc640 1 -- 172.21.15.16:0/2523589366 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440a57a0 con 0x7fb94c0cf640 2023-11-28T17:39:48.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb94a7fc640 1 -- 172.21.15.16:0/2523589366 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9440a5900 con 0x7fb94c0cf640 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb94a7fc640 1 -- 172.21.15.16:0/2523589366 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9440a5c90 con 0x7fb94c0cf640 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 -- 172.21.15.16:0/2523589366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cf640 msgr2=0x7fb94c070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 --2- 172.21.15.16:0/2523589366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cf640 0x7fb94c070dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0b1dd0 tx=0x7fb94401c9d0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 -- 172.21.15.16:0/2523589366 shutdown_connections 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 --2- 172.21.15.16:0/2523589366 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cf640 0x7fb94c070dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 --2- 172.21.15.16:0/2523589366 >> v2:172.21.15.64:3300/0 conn(0x7fb94c144c80 0x7fb94c0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 -- 172.21.15.16:0/2523589366 >> 172.21.15.16:0/2523589366 conn(0x7fb94c06a5a0 msgr2=0x7fb94c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 -- 172.21.15.16:0/2523589366 shutdown_connections 2023-11-28T17:39:48.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.675+0000 7fb951c9c640 1 -- 172.21.15.16:0/2523589366 wait complete. 2023-11-28T17:39:48.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 Processor -- start 2023-11-28T17:39:48.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 -- start start 2023-11-28T17:39:48.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 0x7fb94c13c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0cf640 0x7fb94c0adbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb94c144c80 0x7fb94c0b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0ac4b0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c13e080 con 0x7fb94c0cf640 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c13e360 con 0x7fb94c144c80 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 0x7fb94c13c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 0x7fb94c13c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48858/0 (socket says 172.21.15.16:48858) 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 -- 172.21.15.16:0/3066190641 learned_addr learned my addr 172.21.15.16:0/3066190641 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94affd640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0cf640 0x7fb94c0adbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94bfff640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb94c144c80 0x7fb94c0b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 -- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb94c144c80 msgr2=0x7fb94c0b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb94c144c80 0x7fb94c0b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 -- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0cf640 msgr2=0x7fb94c0adbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0cf640 0x7fb94c0adbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 -- 172.21.15.16:0/3066190641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944009b30 con 0x7fb94c0cdf00 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb94b7fe640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 0x7fb94c13c860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d5f0 tx=0x7fb93c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c0125f0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93c012750 con 0x7fb94c0cdf00 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93c012ae0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c13e640 con 0x7fb94c0cdf00 2023-11-28T17:39:48.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.679+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c13cda0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.683+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c068860 con 0x7fb94c0cdf00 2023-11-28T17:39:48.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.683+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb93c012c40 con 0x7fb94c0cdf00 2023-11-28T17:39:48.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.683+0000 7fb933fff640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9380668d0 0x7fb938068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:48.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.683+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb93c084860 con 0x7fb94c0cdf00 2023-11-28T17:39:48.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.683+0000 7fb94affd640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9380668d0 0x7fb938068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:48.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.683+0000 7fb94affd640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9380668d0 0x7fb938068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0a93d0 tx=0x7fb940009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:48.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.687+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb93c051ab0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.843+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb94c13eaf0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb933fff640 1 -- 172.21.15.16:0/3066190641 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fb93c0550d0 con 0x7fb94c0cdf00 2023-11-28T17:39:48.849 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:48.849 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9380668d0 msgr2=0x7fb938068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9380668d0 0x7fb938068d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0a93d0 tx=0x7fb940009040 comp rx=0 tx=0).stop 2023-11-28T17:39:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 msgr2=0x7fb94c13c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 0x7fb94c13c860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb93c00d5f0 tx=0x7fb93c00dab0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 shutdown_connections 2023-11-28T17:39:48.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb94c144c80 0x7fb94c0b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9380668d0 0x7fb938068d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb94c0cf640 0x7fb94c0adbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 --2- 172.21.15.16:0/3066190641 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb94c0cdf00 0x7fb94c13c860 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 >> 172.21.15.16:0/3066190641 conn(0x7fb94c06a5a0 msgr2=0x7fb94c13f630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 shutdown_connections 2023-11-28T17:39:48.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:48.847+0000 7fb951c9c640 1 -- 172.21.15.16:0/3066190641 wait complete. 2023-11-28T17:39:48.871 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:39:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 Processor -- start 2023-11-28T17:39:49.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 -- start start 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa60815d540 0x7fa6080b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6080d3690 0x7fa6080cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6080b32c0 con 0x7fa6080d1f50 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60815d920 con 0x7fa6080d3690 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60e9c4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6080b35a0 con 0x7fa60815d540 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6080d3690 0x7fa6080cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa6080d3690 0x7fa6080cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48870/0 (socket says 172.21.15.16:48870) 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 -- 172.21.15.16:0/1050692688 learned_addr learned my addr 172.21.15.16:0/1050692688 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa607fff640 1 --2- 172.21.15.16:0/1050692688 >> v2:172.21.15.64:3300/0 conn(0x7fa60815d540 0x7fa6080b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 -- 172.21.15.16:0/1050692688 >> v2:172.21.15.64:3300/0 conn(0x7fa60815d540 msgr2=0x7fa6080b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 --2- 172.21.15.16:0/1050692688 >> v2:172.21.15.64:3300/0 conn(0x7fa60815d540 0x7fa6080b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 -- 172.21.15.16:0/1050692688 >> v1:172.21.15.64:6789/0 conn(0x7fa6080d1f50 legacy=0x7fa6080d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.011+0000 7fa60cf61640 1 -- 172.21.15.16:0/1050692688 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6080b3880 con 0x7fa6080d3690 2023-11-28T17:39:49.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60cf61640 1 --2- 172.21.15.16:0/1050692688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6080d3690 0x7fa6080cdde0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa60808cc80 tx=0x7fa60001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ec8918c8893189 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa606ffd640 1 -- 172.21.15.16:0/1050692688 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a57d0 con 0x7fa6080d3690 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa606ffd640 1 -- 172.21.15.16:0/1050692688 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000a5930 con 0x7fa6080d3690 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa606ffd640 1 -- 172.21.15.16:0/1050692688 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000a5cc0 con 0x7fa6080d3690 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 -- 172.21.15.16:0/1050692688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6080d3690 msgr2=0x7fa6080cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/1050692688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6080d3690 0x7fa6080cdde0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa60808cc80 tx=0x7fa60001c910 comp rx=0 tx=0).stop 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 -- 172.21.15.16:0/1050692688 shutdown_connections 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/1050692688 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa6080d3690 0x7fa6080cdde0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/1050692688 >> v2:172.21.15.64:3300/0 conn(0x7fa60815d540 0x7fa6080b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 -- 172.21.15.16:0/1050692688 >> 172.21.15.16:0/1050692688 conn(0x7fa60808ccf0 msgr2=0x7fa60809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 -- 172.21.15.16:0/1050692688 shutdown_connections 2023-11-28T17:39:49.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.015+0000 7fa60e9c4640 1 -- 172.21.15.16:0/1050692688 wait complete. 2023-11-28T17:39:49.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 Processor -- start 2023-11-28T17:39:49.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 -- start start 2023-11-28T17:39:49.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6080d1f50 0x7fa6080b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6080d3690 0x7fa6080b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 0x7fa608151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6080b7510 con 0x7fa60815d540 2023-11-28T17:39:49.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608152380 con 0x7fa6080d1f50 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608152660 con 0x7fa6080d3690 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 0x7fa608151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 0x7fa608151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48884/0 (socket says 172.21.15.16:48884) 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 -- 172.21.15.16:0/3243932095 learned_addr learned my addr 172.21.15.16:0/3243932095 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa607fff640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6080d1f50 0x7fa6080b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa6077fe640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6080d3690 0x7fa6080b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 -- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6080d3690 msgr2=0x7fa6080b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6080d3690 0x7fa6080b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 -- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6080d1f50 msgr2=0x7fa6080b6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6080d1f50 0x7fa6080b6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 -- 172.21.15.16:0/3243932095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600009b30 con 0x7fa60815d540 2023-11-28T17:39:49.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60cf61640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 0x7fa608151630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6000af040 tx=0x7fa6000196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000b8670 con 0x7fa60815d540 2023-11-28T17:39:49.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6000b87d0 con 0x7fa60815d540 2023-11-28T17:39:49.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa608152940 con 0x7fa60815d540 2023-11-28T17:39:49.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000b8b60 con 0x7fa60815d540 2023-11-28T17:39:49.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.019+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa608152f00 con 0x7fa60815d540 2023-11-28T17:39:49.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.023+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa608068860 con 0x7fa60815d540 2023-11-28T17:39:49.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.023+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa6000b8cc0 con 0x7fa60815d540 2023-11-28T17:39:49.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.023+0000 7fa604ff9640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa5f40668d0 0x7fa5f4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.023+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa60011f970 con 0x7fa60815d540 2023-11-28T17:39:49.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.023+0000 7fa607fff640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa5f40668d0 0x7fa5f4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.023+0000 7fa607fff640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa5f40668d0 0x7fa5f4068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6080b9270 tx=0x7fa5f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.027+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6000ece30 con 0x7fa60815d540 2023-11-28T17:39:49.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6081527a0 con 0x7fa60815d540 2023-11-28T17:39:49.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa604ff9640 1 -- 172.21.15.16:0/3243932095 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fa6081527a0 con 0x7fa60815d540 2023-11-28T17:39:49.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:49.219 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:39:49.219 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:39:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa5f40668d0 msgr2=0x7fa5f4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa5f40668d0 0x7fa5f4068d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6080b9270 tx=0x7fa5f8008040 comp rx=0 tx=0).stop 2023-11-28T17:39:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 msgr2=0x7fa608151630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 0x7fa608151630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa6000af040 tx=0x7fa6000196b0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 shutdown_connections 2023-11-28T17:39:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa60815d540 0x7fa608151630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa6080d3690 0x7fa6080b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa5f40668d0 0x7fa5f4068d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 --2- 172.21.15.16:0/3243932095 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6080d1f50 0x7fa6080b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.215+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 >> 172.21.15.16:0/3243932095 conn(0x7fa60808ccf0 msgr2=0x7fa60815c980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.219+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 shutdown_connections 2023-11-28T17:39:49.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.219+0000 7fa60e9c4640 1 -- 172.21.15.16:0/3243932095 wait complete. 2023-11-28T17:39:49.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T17:39:34.527033+0000', 'modified': '2023-11-28T17:39:37.774627+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6837/3552980398', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6835', 'nonce': 3552980398}, {'type': 'v1', 'addr': '172.21.15.64:6837', 'nonce': 3552980398}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T17:39:49.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T17:39:49.649 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-28T17:39:49.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.791+0000 7f1059add640 1 Processor -- start 2023-11-28T17:39:49.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.791+0000 7f1059add640 1 -- start start 2023-11-28T17:39:49.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1059add640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f105406b140 0x7f10540ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1059add640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f10540b3430 0x7f10540b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1059add640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10540b3da0 con 0x7f1054146ec0 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1059add640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105406ecd0 con 0x7f105406b140 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1059add640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1054072660 con 0x7f10540b3430 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f105406b140 0x7f10540ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f105406b140 0x7f10540ccae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48898/0 (socket says 172.21.15.16:48898) 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 -- 172.21.15.16:0/2665825067 learned_addr learned my addr 172.21.15.16:0/2665825067 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1053fff640 1 --2- 172.21.15.16:0/2665825067 >> v2:172.21.15.64:3300/0 conn(0x7f10540b3430 0x7f10540b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 -- 172.21.15.16:0/2665825067 >> v2:172.21.15.64:3300/0 conn(0x7f10540b3430 msgr2=0x7f10540b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 --2- 172.21.15.16:0/2665825067 >> v2:172.21.15.64:3300/0 conn(0x7f10540b3430 0x7f10540b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 -- 172.21.15.16:0/2665825067 >> v1:172.21.15.64:6789/0 conn(0x7f1054146ec0 legacy=0x7f1054071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.795+0000 7f1052ffd640 1 -- 172.21.15.16:0/2665825067 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054071dc0 con 0x7f105406b140 2023-11-28T17:39:49.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1052ffd640 1 --2- 172.21.15.16:0/2665825067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105406b140 0x7f10540ccae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1054074450 tx=0x7f104801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27291413572631f5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f10527fc640 1 -- 172.21.15.16:0/2665825067 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480ab5f0 con 0x7f105406b140 2023-11-28T17:39:49.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f10527fc640 1 -- 172.21.15.16:0/2665825067 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10480ab750 con 0x7f105406b140 2023-11-28T17:39:49.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f10527fc640 1 -- 172.21.15.16:0/2665825067 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480abae0 con 0x7f105406b140 2023-11-28T17:39:49.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 -- 172.21.15.16:0/2665825067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105406b140 msgr2=0x7f10540ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 --2- 172.21.15.16:0/2665825067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105406b140 0x7f10540ccae0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1054074450 tx=0x7f104801c500 comp rx=0 tx=0).stop 2023-11-28T17:39:49.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 -- 172.21.15.16:0/2665825067 shutdown_connections 2023-11-28T17:39:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 --2- 172.21.15.16:0/2665825067 >> v2:172.21.15.64:3300/0 conn(0x7f10540b3430 0x7f10540b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 --2- 172.21.15.16:0/2665825067 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f105406b140 0x7f10540ccae0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 -- 172.21.15.16:0/2665825067 >> 172.21.15.16:0/2665825067 conn(0x7f10540d00b0 msgr2=0x7f10540d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 -- 172.21.15.16:0/2665825067 shutdown_connections 2023-11-28T17:39:49.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 -- 172.21.15.16:0/2665825067 wait complete. 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 Processor -- start 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 -- start start 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f105406b140 0x7f10540b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.799+0000 7f1059add640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540b3430 0x7f10540ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1059add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 0x7f10540ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1059add640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1054142440 con 0x7f1054146ec0 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1059add640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10540acfa0 con 0x7f10540b3430 2023-11-28T17:39:49.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1059add640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10540af7d0 con 0x7f105406b140 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 0x7f10540ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 0x7f10540ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48900/0 (socket says 172.21.15.16:48900) 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 -- 172.21.15.16:0/2383873976 learned_addr learned my addr 172.21.15.16:0/2383873976 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f10537fe640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f105406b140 0x7f10540b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1052ffd640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540b3430 0x7f10540ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 -- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f105406b140 msgr2=0x7f10540b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f105406b140 0x7f10540b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 -- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540b3430 msgr2=0x7f10540ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540b3430 0x7f10540ad430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 -- 172.21.15.16:0/2383873976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480094d0 con 0x7f1054146ec0 2023-11-28T17:39:49.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1053fff640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 0x7f10540ad970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f104c00efc0 tx=0x7f104c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f103bfff640 1 -- 172.21.15.16:0/2383873976 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c014480 con 0x7f1054146ec0 2023-11-28T17:39:49.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f103bfff640 1 -- 172.21.15.16:0/2383873976 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c00f040 con 0x7f1054146ec0 2023-11-28T17:39:49.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f103bfff640 1 -- 172.21.15.16:0/2383873976 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c014820 con 0x7f1054146ec0 2023-11-28T17:39:49.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10540ac950 con 0x7f1054146ec0 2023-11-28T17:39:49.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10540afab0 con 0x7f1054146ec0 2023-11-28T17:39:49.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.803+0000 7f103bfff640 1 -- 172.21.15.16:0/2383873976 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f104c014980 con 0x7f1054146ec0 2023-11-28T17:39:49.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f103bfff640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f10400668d0 0x7f1040068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f103bfff640 1 -- 172.21.15.16:0/2383873976 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f104c085220 con 0x7f1054146ec0 2023-11-28T17:39:49.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f10537fe640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f10400668d0 0x7f1040068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 Processor -- start 2023-11-28T17:39:49.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 -- start start 2023-11-28T17:39:49.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f10537fe640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f10400668d0 0x7f1040068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10540aedb0 tx=0x7f1044009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d0012b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d000ddfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d000de8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfffa7110 con 0x560d000de500 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfff379a0 con 0x560d0012b650 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cfff34ed0 con 0x560d0012ad30 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d000de8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f10537fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d0012b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1052ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d000ddfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d000de8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48910/0 (socket says 172.21.15.16:48910) 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 -- 172.21.15.16:0/3078262992 learned_addr learned my addr 172.21.15.16:0/3078262992 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 -- 172.21.15.16:0/3078262992 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 msgr2=0x560d0012b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d0012b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 -- 172.21.15.16:0/3078262992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 msgr2=0x560d000ddfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d000ddfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 -- 172.21.15.16:0/3078262992 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cffc28890 con 0x560d000de500 2023-11-28T17:39:49.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f1053fff640 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d000de8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f104c05de50 tx=0x7f104c0561f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c56cbff9b80b96 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f10397fa640 1 -- 172.21.15.16:0/3078262992 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c0544d0 con 0x560d000de500 2023-11-28T17:39:49.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f10397fa640 1 -- 172.21.15.16:0/3078262992 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c052840 con 0x560d000de500 2023-11-28T17:39:49.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f10397fa640 1 -- 172.21.15.16:0/3078262992 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c05c2c0 con 0x560d000de500 2023-11-28T17:39:49.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 -- 172.21.15.16:0/3078262992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 msgr2=0x560d000de8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.807+0000 7f105ce38000 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d000de8e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f104c05de50 tx=0x7f104c0561f0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- 172.21.15.16:0/3078262992 shutdown_connections 2023-11-28T17:39:49.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d000de8e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d000ddfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- 172.21.15.16:0/3078262992 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d0012b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- 172.21.15.16:0/3078262992 >> 172.21.15.16:0/3078262992 conn(0x560d0010b8c0 msgr2=0x560d0010dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- 172.21.15.16:0/3078262992 shutdown_connections 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- 172.21.15.16:0/3078262992 wait complete. 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- start start 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 Processor -- start 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d000de500 0x560d000e4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d000e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 0x560d000e4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cfff307c0 con 0x560d0012b650 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cffee8bf0 con 0x560d000de500 2023-11-28T17:39:49.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cffeeea90 con 0x560d0012ad30 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 10 client.0 _ll_register_callbacks cb 0x560d000cbe20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 0x560d000e4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 0x560d000e4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48920/0 (socket says 172.21.15.16:48920) 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 -- 172.21.15.16:0/1297919844 learned_addr learned my addr 172.21.15.16:0/1297919844 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1052ffd640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d000e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10537fe640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d000de500 0x560d000e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 -- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 msgr2=0x560d000e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d000e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 -- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d000de500 msgr2=0x560d000e4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d000de500 0x560d000e4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 -- 172.21.15.16:0/1297919844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10540afab0 con 0x560d0012b650 2023-11-28T17:39:49.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f1053fff640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 0x560d000e4fa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f104c00c990 tx=0x7f104c085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8765edc3cc241b70 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10327fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-11-28T17:39:49.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10327fc640 1 -- 172.21.15.16:0/1297919844 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c05c2c0 con 0x560d0012b650 2023-11-28T17:39:49.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cffef2470 con 0x560d0012b650 2023-11-28T17:39:49.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10327fc640 1 -- 172.21.15.16:0/1297919844 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f104c056390 con 0x560d0012b650 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10327fc640 1 -- 172.21.15.16:0/1297919844 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f104c056550 con 0x560d0012b650 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 10 client.4653 fetch_fsmap learned FSMap version 8 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560cffef1190 con 0x560d0012b650 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10327fc640 1 -- 172.21.15.16:0/1297919844 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560cffef2470 con 0x560d0012b650 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f10327fc640 1 -- 172.21.15.16:0/1297919844 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f104c076070 con 0x560d0012b650 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T17:39:49.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 10 client.4653 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 20 client.4653 populate_metadata read hostname 'smithi016' 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.811+0000 7f105ce38000 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d000e59b0 0x560d0013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 4 client.4653 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 --> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560cffef5b50 con 0x560d000e59b0 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f10537fe640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d000e59b0 0x560d0013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f10537fe640 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d000e59b0 0x560d0013cff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1982346d00774a53 server_cookie=699bddc8c98d6a07 in_seq=0 out_seq=0 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f10327fc640 10 client.4653 ms_handle_connect on v2:172.21.15.64:6835/3552980398 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f10327fc640 1 -- 172.21.15.16:0/1297919844 <== mds.0 v2:172.21.15.64:6835/3552980398 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560cffef5b50 con 0x560d000e59b0 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f10327fc640 10 client.4653 handle_command_reply: tid=0 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 client.4653 shutdown 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 msgr2=0x560d000e4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 0x560d000e4fa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f104c00c990 tx=0x7f104c085040 comp rx=0 tx=0).stop 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 shutdown_connections 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d000e59b0 0x560d0013cff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012b650 0x560d000e4fa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012ad30 0x560d000e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 --2- 172.21.15.16:0/1297919844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d000de500 0x560d000e4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f10327fc640 0 client.4653 ms_handle_reset on v2:172.21.15.64:6835/3552980398 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 >> 172.21.15.16:0/1297919844 conn(0x560d0010b8c0 msgr2=0x560d000dd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 shutdown_connections 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 1 -- 172.21.15.16:0/1297919844 wait complete. 2023-11-28T17:39:49.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.815+0000 7f105ce38000 20 client.4653 trim_cache size 0 max 16384 2023-11-28T17:39:49.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 Processor -- start 2023-11-28T17:39:49.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 -- start start 2023-11-28T17:39:49.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d0010a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012ad30 0x560d0010a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012b650 0x560d0013cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cffbe9940 con 0x560d000de500 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cffeed9b0 con 0x560d0012ad30 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cfff2a610 con 0x560d0012b650 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d0010a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d0010a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48928/0 (socket says 172.21.15.16:48928) 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 -- 172.21.15.16:0/805983537 learned_addr learned my addr 172.21.15.16:0/805983537 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f1052ffd640 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012ad30 0x560d0010a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f1053fff640 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012b650 0x560d0013cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 -- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012b650 msgr2=0x560d0013cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012b650 0x560d0013cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 -- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012ad30 msgr2=0x560d0010a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012ad30 0x560d0010a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 -- 172.21.15.16:0/805983537 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cffed7490 con 0x560d000de500 2023-11-28T17:39:49.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.831+0000 7f10537fe640 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d0010a3a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560cffecf6b0 tx=0x7f1044012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634c7e4b58be90c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1039ffb640 1 -- 172.21.15.16:0/805983537 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044028070 con 0x560d000de500 2023-11-28T17:39:49.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1039ffb640 1 -- 172.21.15.16:0/805983537 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1044016110 con 0x560d000de500 2023-11-28T17:39:49.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1039ffb640 1 -- 172.21.15.16:0/805983537 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1044016b00 con 0x560d000de500 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- 172.21.15.16:0/805983537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 msgr2=0x560d0010a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d0010a3a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x560cffecf6b0 tx=0x7f1044012000 comp rx=0 tx=0).stop 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- 172.21.15.16:0/805983537 shutdown_connections 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d0012b650 0x560d0013cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012ad30 0x560d0010a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- 172.21.15.16:0/805983537 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d000de500 0x560d0010a3a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- 172.21.15.16:0/805983537 >> 172.21.15.16:0/805983537 conn(0x560d0010b8c0 msgr2=0x560d000dc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- 172.21.15.16:0/805983537 shutdown_connections 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- 172.21.15.16:0/805983537 wait complete. 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- start start 2023-11-28T17:39:49.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 Processor -- start 2023-11-28T17:39:49.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d000de500 0x560d0018b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 0x560d0018bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d00146a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d000e1100 con 0x560d0012ad30 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cffc291b0 con 0x560d0012b650 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x560cffef9910 con 0x560d000de500 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 10 client.0 _ll_register_callbacks cb 0x560cfffa7060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 0x560d0018bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 0x560d0018bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48936/0 (socket says 172.21.15.16:48936) 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 -- 172.21.15.16:0/1390639214 learned_addr learned my addr 172.21.15.16:0/1390639214 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f10537fe640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d000de500 0x560d0018b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1053fff640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d00146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 -- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d000de500 msgr2=0x560d0018b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d000de500 0x560d0018b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 -- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 msgr2=0x560d00146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d00146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 -- 172.21.15.16:0/1390639214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1044019040 con 0x560d0012ad30 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f1052ffd640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 0x560d0018bd50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1048097ec0 tx=0x7f10480046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3f9c0c753ed900 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:49.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f10327fc640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f10327fc640 1 -- 172.21.15.16:0/1390639214 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10480bf470 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f10327fc640 1 -- 172.21.15.16:0/1390639214 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10480b9040 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.835+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560cfff2f110 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 1 -- 172.21.15.16:0/1390639214 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10480bf5d0 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 10 client.4659 fetch_fsmap learned FSMap version 8 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x560cffc28cc0 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 1 -- 172.21.15.16:0/1390639214 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560cfff2f110 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 1 -- 172.21.15.16:0/1390639214 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f10480bd050 con 0x560d0012ad30 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 10 client.4659 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-28T17:39:49.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 20 client.4659 populate_metadata read hostname 'smithi016' 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d001481d0 0x560d00194680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 4 client.4659 mds_command: new command op to 4302 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 --> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560cfff5d650 con 0x560d001481d0 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10537fe640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d001481d0 0x560d00194680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10537fe640 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d001481d0 0x560d00194680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cdfb87894130650 server_cookie=ba0cd6d9d9aa750c in_seq=0 out_seq=0 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 10 client.4659 ms_handle_connect on v2:172.21.15.64:6835/3552980398 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 1 -- 172.21.15.16:0/1390639214 <== mds.0 v2:172.21.15.64:6835/3552980398 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x560cfff5d650 con 0x560d001481d0 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 10 client.4659 handle_command_reply: tid=0 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 client.4659 shutdown 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 msgr2=0x560d0018bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 0x560d0018bd50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1048097ec0 tx=0x7f10480046d0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 shutdown_connections 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:6835/3552980398,v1:172.21.15.64:6837/3552980398] conn(0x560d001481d0 0x560d00194680 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x560d0012b650 0x560d00146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x560d0012ad30 0x560d0018bd50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 --2- 172.21.15.16:0/1390639214 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x560d000de500 0x560d0018b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f10327fc640 0 client.4659 ms_handle_reset on v2:172.21.15.64:6835/3552980398 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 >> 172.21.15.16:0/1390639214 conn(0x560d0010b8c0 msgr2=0x560d000dcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 shutdown_connections 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 1 -- 172.21.15.16:0/1390639214 wait complete. 2023-11-28T17:39:49.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f105ce38000 20 client.4659 trim_cache size 0 max 16384 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "412d3c1b-e5e1-47ba-972b-0544ebc8f3e9", 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 4302, 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 14.467767082, 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 8, 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 22, 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 22, 2023-11-28T17:39:49.848 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 21.623405869999999 2023-11-28T17:39:49.849 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-28T17:39:49.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f10400668d0 msgr2=0x7f1040068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f10400668d0 0x7f1040068d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10540aedb0 tx=0x7f1044009040 comp rx=0 tx=0).stop 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 msgr2=0x7f10540ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 0x7f10540ad970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f104c00efc0 tx=0x7f104c00c490 comp rx=0 tx=0).stop 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 shutdown_connections 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1054146ec0 0x7f10540ad970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f10400668d0 0x7f1040068d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f10540b3430 0x7f10540ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 --2- 172.21.15.16:0/2383873976 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f105406b140 0x7f10540b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 >> 172.21.15.16:0/2383873976 conn(0x7f10540d00b0 msgr2=0x7f10540cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 shutdown_connections 2023-11-28T17:39:49.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:49.839+0000 7f1059add640 1 -- 172.21.15.16:0/2383873976 wait complete. 2023-11-28T17:39:49.862 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T17:39:49.885 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T17:39:49.886 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-28T17:39:49.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:49.886 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-28T17:39:49.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:49.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-11-28T17:39:49.967 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-11-28T17:39:49.969 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:39:49.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:49.969 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-28T17:39:50.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.025 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-11-28T17:39:50.096 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-11-28T17:39:50.098 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:39:50.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.099 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-11-28T17:39:50.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.110 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-11-28T17:39:50.176 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2023-11-28T17:39:50.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:39:50.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.178 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-11-28T17:39:50.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-11-28T17:39:50.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T17:39:50.301 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2023-11-28T17:39:50.301 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-28T17:39:50.301 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T17:39:50.302 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T17:39:50.302 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T17:39:50.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 Processor -- start 2023-11-28T17:39:50.445 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 -- start start 2023-11-28T17:39:50.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed6815d540 0x7fed680b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed680d1f50 0x7fed680d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fed680d34c0 0x7fed680cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6815d920 con 0x7fed680d1f50 2023-11-28T17:39:50.447 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed680b32c0 con 0x7fed680d34c0 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6f0fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed680b35a0 con 0x7fed6815d540 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed680d1f50 0x7fed680d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6ce9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed6815d540 0x7fed680b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fed680d1f50 0x7fed680d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48952/0 (socket says 172.21.15.16:48952) 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 -- 172.21.15.16:0/3490874497 learned_addr learned my addr 172.21.15.16:0/3490874497 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed6d69b640 1 --2- 172.21.15.16:0/3490874497 >> v2:172.21.15.64:3300/0 conn(0x7fed680d34c0 0x7fed680cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 -- 172.21.15.16:0/3490874497 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed6815d540 msgr2=0x7fed680b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 --2- 172.21.15.16:0/3490874497 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed6815d540 0x7fed680b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 -- 172.21.15.16:0/3490874497 >> v2:172.21.15.64:3300/0 conn(0x7fed680d34c0 msgr2=0x7fed680cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 --2- 172.21.15.16:0/3490874497 >> v2:172.21.15.64:3300/0 conn(0x7fed680d34c0 0x7fed680cfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.448 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.443+0000 7fed67fff640 1 -- 172.21.15.16:0/3490874497 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed680b3880 con 0x7fed680d1f50 2023-11-28T17:39:50.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed67fff640 1 --2- 172.21.15.16:0/3490874497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d1f50 0x7fed680d2f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed680d4020 tx=0x7fed5401c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb0268258a2a893 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:50.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed677fe640 1 -- 172.21.15.16:0/3490874497 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540ab600 con 0x7fed680d1f50 2023-11-28T17:39:50.450 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed677fe640 1 -- 172.21.15.16:0/3490874497 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540a7050 con 0x7fed680d1f50 2023-11-28T17:39:50.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed677fe640 1 -- 172.21.15.16:0/3490874497 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540ab980 con 0x7fed680d1f50 2023-11-28T17:39:50.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 -- 172.21.15.16:0/3490874497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d1f50 msgr2=0x7fed680d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:50.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/3490874497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d1f50 0x7fed680d2f80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fed680d4020 tx=0x7fed5401c210 comp rx=0 tx=0).stop 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 -- 172.21.15.16:0/3490874497 shutdown_connections 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/3490874497 >> v2:172.21.15.64:3300/0 conn(0x7fed680d34c0 0x7fed680cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/3490874497 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d1f50 0x7fed680d2f80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/3490874497 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed6815d540 0x7fed680b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 -- 172.21.15.16:0/3490874497 >> 172.21.15.16:0/3490874497 conn(0x7fed6808ccf0 msgr2=0x7fed6809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 -- 172.21.15.16:0/3490874497 shutdown_connections 2023-11-28T17:39:50.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.447+0000 7fed6f0fe640 1 -- 172.21.15.16:0/3490874497 wait complete. 2023-11-28T17:39:50.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 Processor -- start 2023-11-28T17:39:50.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 -- start start 2023-11-28T17:39:50.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed680d1f50 0x7fed68150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 0x7fed681509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed6815d540 0x7fed68151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6815ca70 con 0x7fed680d34c0 2023-11-28T17:39:50.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed681513d0 con 0x7fed6815d540 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed681516b0 con 0x7fed680d1f50 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 0x7fed681509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 0x7fed681509f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48964/0 (socket says 172.21.15.16:48964) 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 -- 172.21.15.16:0/1677815203 learned_addr learned my addr 172.21.15.16:0/1677815203 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6ce9a640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed680d1f50 0x7fed68150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6d69b640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed6815d540 0x7fed68151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 -- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed680d1f50 msgr2=0x7fed68150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed680d1f50 0x7fed68150120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 -- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed6815d540 msgr2=0x7fed68151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed6815d540 0x7fed68151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 -- 172.21.15.16:0/1677815203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540094d0 con 0x7fed680d34c0 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed67fff640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 0x7fed681509f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed5401a8c0 tx=0x7fed54018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540b4420 con 0x7fed680d34c0 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540b4580 con 0x7fed680d34c0 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed68151990 con 0x7fed680d34c0 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540b48f0 con 0x7fed680d34c0 2023-11-28T17:39:50.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.451+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6815ad20 con 0x7fed680d34c0 2023-11-28T17:39:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.455+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed68154500 con 0x7fed680d34c0 2023-11-28T17:39:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.455+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fed540b2070 con 0x7fed680d34c0 2023-11-28T17:39:50.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.455+0000 7fed657fa640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fed4c066900 0x7fed4c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.455+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed5411d780 con 0x7fed680d34c0 2023-11-28T17:39:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.455+0000 7fed6ce9a640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fed4c066900 0x7fed4c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:50.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.455+0000 7fed6ce9a640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fed4c066900 0x7fed4c068dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed68152fe0 tx=0x7fed5c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:50.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.459+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed68154500 con 0x7fed680d34c0 2023-11-28T17:39:50.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.655+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fed68154500 con 0x7fed680d34c0 2023-11-28T17:39:50.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.655+0000 7fed657fa640 1 -- 172.21.15.16:0/1677815203 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fed68154500 con 0x7fed680d34c0 2023-11-28T17:39:50.660 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T17:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fed4c066900 msgr2=0x7fed4c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:50.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fed4c066900 0x7fed4c068dc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fed68152fe0 tx=0x7fed5c009190 comp rx=0 tx=0).stop 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 msgr2=0x7fed681509f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 0x7fed681509f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fed5401a8c0 tx=0x7fed54018fb0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 shutdown_connections 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fed4c066900 0x7fed4c068dc0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed6815d540 0x7fed68151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fed680d34c0 0x7fed681509f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 --2- 172.21.15.16:0/1677815203 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fed680d1f50 0x7fed68150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:50.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 >> 172.21.15.16:0/1677815203 conn(0x7fed6808ccf0 msgr2=0x7fed68156d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:50.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 shutdown_connections 2023-11-28T17:39:50.663 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:50.659+0000 7fed6f0fe640 1 -- 172.21.15.16:0/1677815203 wait complete. 2023-11-28T17:39:50.680 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T17:39:50.681 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T17:39:50.681 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-11-28T17:39:50.681 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T17:39:50.681 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T17:39:50.681 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T17:39:50.682 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T17:39:50.682 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T17:39:50.682 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T17:39:50.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.683 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-11-28T17:39:50.693 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:50.693 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:50.693 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:50.694 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:50.694 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:50.694 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:50.695 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:50.695 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:50.695 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2023-11-28T17:39:50.695 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:50.696 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:50.696 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2023-11-28T17:39:50.696 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T17:39:50.696 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:50.696 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2023-11-28T17:39:50.697 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T17:39:50.697 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42397sec preferred_lft 42397sec 2023-11-28T17:39:50.697 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-11-28T17:39:50.697 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:50.697 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:50.698 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:50.698 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2023-11-28T17:39:50.698 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T17:39:50.699 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:be:b9:3b:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:50.699 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T17:39:50.699 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:50.700 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T17:39:50.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.701 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:50.701 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:50.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add name ceph-brx type bridge 2023-11-28T17:39:50.701 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr flush dev ceph-brx 2023-11-28T17:39:50.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set ceph-brx up 2023-11-28T17:39:50.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T17:39:50.703 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:50.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.810 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T17:39:50.830 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-11-28T17:39:50.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.832 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-11-28T17:39:50.906 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-11-28T17:39:50.906 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T17:39:50.906 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T17:39:50.906 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T17:39:50.907 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T17:39:50.907 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T17:39:50.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:50.907 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:50.907 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:50.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T17:39:50.908 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T17:39:50.908 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T17:39:50.908 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:51.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.002 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-28T17:39:51.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.012 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2023-11-28T17:39:51.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.061 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:51.061 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:51.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T17:39:51.061 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T17:39:51.062 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:51.145 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T17:39:51.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.145 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:51.145 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:51.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T17:39:51.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T17:39:51.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T17:39:51.145 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T17:39:51.146 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T17:39:51.146 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:51.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.312 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:51.312 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:51.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2023-11-28T17:39:51.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T17:39:51.313 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:51.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:51.355 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T17:39:51.409 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T17:39:51.409 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:51.410 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T17:39:51.461 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T17:39:51.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.461 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:39:51.566 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:39:51.566 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T17:39:51.566 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:39:51.670 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:39:51.670 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T17:39:51.670 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:39:51.670 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:51.670 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:51.684 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:39:51.684 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T17:39:51.684 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:39:51.684 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:51.685 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:51.685 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790" 2023-11-28T17:39:51.685 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2023-11-28T17:39:51.685 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=412d3c1b-e5e1-47ba-972b-0544ebc8f3e9" will pass to kernel 2023-11-28T17:39:51.688 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T17:39:51.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T17:39:51.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.712 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:51.787 INFO:teuthology.orchestra.run.smithi016.stdout:client4478 2023-11-28T17:39:51.787 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:51.787 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:39:51.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.841 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:51.904 INFO:teuthology.orchestra.run.smithi016.stdout:client4478 2023-11-28T17:39:51.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.905 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:51.968 INFO:teuthology.orchestra.run.smithi016.stdout:client4478 2023-11-28T17:39:51.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:51.969 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/412d3c1b-e5e1-47ba-972b-0544ebc8f3e9.client4478/status') 2023-11-28T17:39:52.041 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4478 (3)172.21.15.16:0/4023228961 2023-11-28T17:39:52.042 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2023-11-28T17:39:52.042 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2023-11-28T17:39:52.042 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2023-11-28T17:39:52.042 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 5.2666e-05 s, 1.3 MB/s 2023-11-28T17:39:52.043 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-28T17:39:52.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T17:39:52.044 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T17:39:52.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T17:39:52.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 Processor -- start 2023-11-28T17:39:52.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 -- start start 2023-11-28T17:39:52.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fece00cef30 0x7fece00cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:52.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fece0070dd0 0x7fece0071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:52.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00ce4f0 con 0x7fece0144c80 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00709b0 con 0x7fece00cef30 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece6972640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece0145060 con 0x7fece0070dd0 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fece00cef30 0x7fece00cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fece00cef30 0x7fece00cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48968/0 (socket says 172.21.15.16:48968) 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 -- 172.21.15.16:0/1788210294 learned_addr learned my addr 172.21.15.16:0/1788210294 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fece4f0f640 1 --2- 172.21.15.16:0/1788210294 >> v2:172.21.15.64:3300/0 conn(0x7fece0070dd0 0x7fece0071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 -- 172.21.15.16:0/1788210294 >> v2:172.21.15.64:3300/0 conn(0x7fece0070dd0 msgr2=0x7fece0071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 --2- 172.21.15.16:0/1788210294 >> v2:172.21.15.64:3300/0 conn(0x7fece0070dd0 0x7fece0071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 -- 172.21.15.16:0/1788210294 >> v1:172.21.15.64:6789/0 conn(0x7fece0144c80 legacy=0x7fece00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:52.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.227+0000 7fecdf7fe640 1 -- 172.21.15.16:0/1788210294 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00ce7d0 con 0x7fece00cef30 2023-11-28T17:39:52.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fecdf7fe640 1 --2- 172.21.15.16:0/1788210294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece00cef30 0x7fece00cf3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fece006b4e0 tx=0x7fecd401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa0c974ab94f32b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:52.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fecdeffd640 1 -- 172.21.15.16:0/1788210294 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40ab610 con 0x7fece00cef30 2023-11-28T17:39:52.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fecdeffd640 1 -- 172.21.15.16:0/1788210294 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40ab770 con 0x7fece00cef30 2023-11-28T17:39:52.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fecdeffd640 1 -- 172.21.15.16:0/1788210294 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40abb00 con 0x7fece00cef30 2023-11-28T17:39:52.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 -- 172.21.15.16:0/1788210294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece00cef30 msgr2=0x7fece00cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:52.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 --2- 172.21.15.16:0/1788210294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece00cef30 0x7fece00cf3b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fece006b4e0 tx=0x7fecd401c500 comp rx=0 tx=0).stop 2023-11-28T17:39:52.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 -- 172.21.15.16:0/1788210294 shutdown_connections 2023-11-28T17:39:52.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 --2- 172.21.15.16:0/1788210294 >> v2:172.21.15.64:3300/0 conn(0x7fece0070dd0 0x7fece0071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 --2- 172.21.15.16:0/1788210294 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece00cef30 0x7fece00cf3b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 -- 172.21.15.16:0/1788210294 >> 172.21.15.16:0/1788210294 conn(0x7fece006a5a0 msgr2=0x7fece006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:52.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 -- 172.21.15.16:0/1788210294 shutdown_connections 2023-11-28T17:39:52.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.231+0000 7fece6972640 1 -- 172.21.15.16:0/1788210294 wait complete. 2023-11-28T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 Processor -- start 2023-11-28T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 -- start start 2023-11-28T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece0070dd0 0x7fece01f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fece00cef30 0x7fece00b3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 0x7fece01f5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:52.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00b3d00 con 0x7fece0144c80 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00b3fe0 con 0x7fece0070dd0 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece01f6290 con 0x7fece00cef30 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 0x7fece01f5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 0x7fece01f5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48980/0 (socket says 172.21.15.16:48980) 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 -- 172.21.15.16:0/3949511159 learned_addr learned my addr 172.21.15.16:0/3949511159 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fecdf7fe640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fece00cef30 0x7fece00b3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fecdffff640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece0070dd0 0x7fece01f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 -- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fece00cef30 msgr2=0x7fece00b3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:52.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fece00cef30 0x7fece00b3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 -- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece0070dd0 msgr2=0x7fece01f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece0070dd0 0x7fece01f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 -- 172.21.15.16:0/3949511159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40094d0 con 0x7fece0144c80 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fecdf7fe640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fece00cef30 0x7fece00b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece4f0f640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 0x7fece01f5820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fecd8007e60 tx=0x7fecd800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8014420 con 0x7fece0144c80 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd80145a0 con 0x7fece0144c80 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece01f6570 con 0x7fece0144c80 2023-11-28T17:39:52.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8014950 con 0x7fece0144c80 2023-11-28T17:39:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.235+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00b3a50 con 0x7fece0144c80 2023-11-28T17:39:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.239+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece01f67b0 con 0x7fece0144c80 2023-11-28T17:39:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.239+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fecd8014ab0 con 0x7fece0144c80 2023-11-28T17:39:52.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.239+0000 7fecdcff9640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feccc0668d0 0x7feccc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.239+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecd8084c50 con 0x7fece0144c80 2023-11-28T17:39:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.239+0000 7fecdffff640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feccc0668d0 0x7feccc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:52.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.243+0000 7fecdffff640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feccc0668d0 0x7feccc068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fece00b1270 tx=0x7fecd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:52.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.243+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fece01f67b0 con 0x7fece0144c80 2023-11-28T17:39:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.431+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fece01f67b0 con 0x7fece0144c80 2023-11-28T17:39:52.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fecdcff9640 1 -- 172.21.15.16:0/3949511159 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fece01f67b0 con 0x7fece0144c80 2023-11-28T17:39:52.437 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T17:39:52.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feccc0668d0 msgr2=0x7feccc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feccc0668d0 0x7feccc068d90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fece00b1270 tx=0x7fecd0009040 comp rx=0 tx=0).stop 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 msgr2=0x7fece01f5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 0x7fece01f5820 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fecd8007e60 tx=0x7fecd800e4b0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 shutdown_connections 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fece0144c80 0x7fece01f5820 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fece00cef30 0x7fece00b3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feccc0668d0 0x7feccc068d90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 --2- 172.21.15.16:0/3949511159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fece0070dd0 0x7fece01f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 >> 172.21.15.16:0/3949511159 conn(0x7fece006a5a0 msgr2=0x7fece015bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 shutdown_connections 2023-11-28T17:39:52.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:52.435+0000 7fece6972640 1 -- 172.21.15.16:0/3949511159 wait complete. 2023-11-28T17:39:52.459 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T17:39:52.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T17:39:52.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-11-28T17:39:52.459 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-28T17:39:52.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-28T17:39:52.460 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T17:39:52.460 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T17:39:52.460 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T17:39:52.460 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-28T17:39:52.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.460 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-11-28T17:39:52.470 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:52.471 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42395sec preferred_lft 42395sec 2023-11-28T17:39:52.472 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:be:b9:3b:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:52.473 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.474 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T17:39:52.537 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-11-28T17:39:52.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.539 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-11-28T17:39:52.594 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-11-28T17:39:52.594 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T17:39:52.594 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T17:39:52.595 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T17:39:52.595 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T17:39:52.595 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T17:39:52.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.595 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:52.595 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:52.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T17:39:52.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T17:39:52.595 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T17:39:52.596 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:52.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.688 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-28T17:39:52.698 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T17:39:52.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.699 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list-id 2023-11-28T17:39:52.753 INFO:teuthology.orchestra.run.smithi016.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-28T17:39:52.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.754 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:52.754 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:52.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T17:39:52.755 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-28T17:39:52.755 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:52.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.837 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T17:39:52.901 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether e2:77:5a:b9:bf:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T17:39:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T17:39:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::e077:5aff:feb9:bfad/64 scope link 2023-11-28T17:39:52.903 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.904 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-28T17:39:52.970 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:52.970 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether e2:77:5a:b9:bf:ad brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.971 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::e077:5aff:feb9:bfad/64 scope link 2023-11-28T17:39:52.972 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:52.973 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-28T17:39:52.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:52.973 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:52.973 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:52.973 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-28T17:39:52.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T17:39:52.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-28T17:39:52.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-28T17:39:52.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-28T17:39:52.974 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:53.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.123 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:39:53.124 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:39:53.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.1 up 2023-11-28T17:39:53.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T17:39:53.124 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:39:53.166 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:53.166 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-28T17:39:53.221 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-28T17:39:53.221 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:53.221 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-28T17:39:53.276 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T17:39:53.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T17:39:53.376 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T17:39:53.376 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T17:39:53.376 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:39:53.391 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T17:39:53.391 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T17:39:53.391 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:39:53.391 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:53.391 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790" 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2023-11-28T17:39:53.400 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=412d3c1b-e5e1-47ba-972b-0544ebc8f3e9" will pass to kernel 2023-11-28T17:39:53.403 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T17:39:53.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.404 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-28T17:39:53.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.425 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:53.484 INFO:teuthology.orchestra.run.smithi016.stdout:client4484 2023-11-28T17:39:53.484 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:39:53.485 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:39:53.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.537 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:53.596 INFO:teuthology.orchestra.run.smithi016.stdout:client4484 2023-11-28T17:39:53.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.596 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:53.655 INFO:teuthology.orchestra.run.smithi016.stdout:client4484 2023-11-28T17:39:53.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:53.656 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/412d3c1b-e5e1-47ba-972b-0544ebc8f3e9.client4484/status') 2023-11-28T17:39:53.721 INFO:teuthology.orchestra.run.smithi016.stdout:instance: client.4484 (3)172.21.15.16:0/1347739037 2023-11-28T17:39:53.722 INFO:teuthology.orchestra.run.smithi016.stdout:blocklisted: false 2023-11-28T17:39:53.723 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records in 2023-11-28T17:39:53.723 INFO:teuthology.orchestra.run.smithi016.stderr:0+1 records out 2023-11-28T17:39:53.723 INFO:teuthology.orchestra.run.smithi016.stderr:70 bytes copied, 5.3375e-05 s, 1.3 MB/s 2023-11-28T17:39:53.723 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-28T17:39:53.724 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T17:39:53.724 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T17:39:53.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T17:39:53.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 Processor -- start 2023-11-28T17:39:53.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 -- start start 2023-11-28T17:39:53.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b3c0cef30 0x7f0b3c0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c070dd0 0x7f0b3c071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b3c0ce4f0 con 0x7f0b3c144c80 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b3c0709b0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.903+0000 7f0b409aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c145060 con 0x7f0b3c070dd0 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b3c0cef30 0x7f0b3c0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f0b3c0cef30 0x7f0b3c0cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48984/0 (socket says 172.21.15.16:48984) 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 -- 172.21.15.16:0/1276886317 learned_addr learned my addr 172.21.15.16:0/1276886317 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b3ad9d640 1 --2- 172.21.15.16:0/1276886317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c070dd0 0x7f0b3c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 -- 172.21.15.16:0/1276886317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c070dd0 msgr2=0x7f0b3c071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:53.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 --2- 172.21.15.16:0/1276886317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c070dd0 0x7f0b3c071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 -- 172.21.15.16:0/1276886317 >> v1:172.21.15.64:6789/0 conn(0x7f0b3c144c80 legacy=0x7f0b3c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:53.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 -- 172.21.15.16:0/1276886317 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c0ce7d0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b33fff640 1 --2- 172.21.15.16:0/1276886317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0cf3b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4aeec127d611f7f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:53.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b39d9b640 1 -- 172.21.15.16:0/1276886317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ab600 con 0x7f0b3c0cef30 2023-11-28T17:39:53.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b39d9b640 1 -- 172.21.15.16:0/1276886317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240a7050 con 0x7f0b3c0cef30 2023-11-28T17:39:53.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.907+0000 7f0b39d9b640 1 -- 172.21.15.16:0/1276886317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240ab980 con 0x7f0b3c0cef30 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- 172.21.15.16:0/1276886317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 msgr2=0x7f0b3c0cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 --2- 172.21.15.16:0/1276886317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0cf3b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b24009870 tx=0x7f0b2401c360 comp rx=0 tx=0).stop 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- 172.21.15.16:0/1276886317 shutdown_connections 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 --2- 172.21.15.16:0/1276886317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c070dd0 0x7f0b3c071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 --2- 172.21.15.16:0/1276886317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0cf3b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- 172.21.15.16:0/1276886317 >> 172.21.15.16:0/1276886317 conn(0x7f0b3c06a5a0 msgr2=0x7f0b3c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- 172.21.15.16:0/1276886317 shutdown_connections 2023-11-28T17:39:53.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- 172.21.15.16:0/1276886317 wait complete. 2023-11-28T17:39:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 Processor -- start 2023-11-28T17:39:53.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- start start 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b3c070dd0 0x7f0b3c1f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c144c80 0x7f0b3c1406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0af8a0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0afb80 con 0x7f0b3c070dd0 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b409aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3c0afe60 con 0x7f0b3c144c80 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48996/0 (socket says 172.21.15.16:48996) 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 -- 172.21.15.16:0/3498539710 learned_addr learned my addr 172.21.15.16:0/3498539710 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:53.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b3a59c640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b3c070dd0 0x7f0b3c1f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b3ad9d640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c144c80 0x7f0b3c1406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 -- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c144c80 msgr2=0x7f0b3c1406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c144c80 0x7f0b3c1406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 -- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b3c070dd0 msgr2=0x7f0b3c1f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b3c070dd0 0x7f0b3c1f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b33fff640 1 -- 172.21.15.16:0/3498539710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b240094d0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.911+0000 7f0b3ad9d640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c144c80 0x7f0b3c1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b33fff640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0b0970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ae040 tx=0x7f0b24019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240b4640 con 0x7f0b3c0cef30 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b240b47a0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b240b4b30 con 0x7f0b3c0cef30 2023-11-28T17:39:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c0b0140 con 0x7f0b3c0cef30 2023-11-28T17:39:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c0b0eb0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3c0b02d0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0b240b2070 con 0x7f0b3c0cef30 2023-11-28T17:39:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b32ffd640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0b1c0668d0 0x7f0b1c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b2411e1f0 con 0x7f0b3c0cef30 2023-11-28T17:39:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.915+0000 7f0b3a59c640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0b1c0668d0 0x7f0b1c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:53.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.919+0000 7f0b3a59c640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0b1c0668d0 0x7f0b1c068d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c007fd0 tx=0x7f0b2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:53.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:53.919+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b240eb4b0 con 0x7f0b3c0cef30 2023-11-28T17:39:54.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0b3c068860 con 0x7f0b3c0cef30 2023-11-28T17:39:54.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b32ffd640 1 -- 172.21.15.16:0/3498539710 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0b240b0060 con 0x7f0b3c0cef30 2023-11-28T17:39:54.118 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0b1c0668d0 msgr2=0x7f0b1c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0b1c0668d0 0x7f0b1c068d90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c007fd0 tx=0x7f0b2c009040 comp rx=0 tx=0).stop 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 msgr2=0x7f0b3c0b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0b0970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b240ae040 tx=0x7f0b24019100 comp rx=0 tx=0).stop 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 shutdown_connections 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0b3c144c80 0x7f0b3c1406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0b3c0cef30 0x7f0b3c0b0970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:54.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0b1c0668d0 0x7f0b1c068d90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 --2- 172.21.15.16:0/3498539710 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0b3c070dd0 0x7f0b3c1f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 >> 172.21.15.16:0/3498539710 conn(0x7f0b3c06a5a0 msgr2=0x7f0b3c13c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 shutdown_connections 2023-11-28T17:39:54.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:54.115+0000 7f0b409aa640 1 -- 172.21.15.16:0/3498539710 wait complete. 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T17:39:54.139 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-28T17:39:54.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.140 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-11-28T17:39:54.151 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:54.151 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:54.151 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:54.151 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:54.151 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:54.151 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-11-28T17:39:54.152 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-11-28T17:39:54.153 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:54.153 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T17:39:54.153 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9d:50:d2:d7 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:54.153 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T17:39:54.153 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:54.153 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T17:39:54.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.153 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:54.153 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:54.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2023-11-28T17:39:54.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2023-11-28T17:39:54.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2023-11-28T17:39:54.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T17:39:54.154 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:54.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.273 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T17:39:54.293 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-11-28T17:39:54.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.296 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-11-28T17:39:54.483 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-11-28T17:39:54.483 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T17:39:54.484 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T17:39:54.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.485 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:54.485 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:54.485 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T17:39:54.485 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T17:39:54.486 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T17:39:54.486 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:54.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.541 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-11-28T17:39:54.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.551 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2023-11-28T17:39:54.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.602 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:54.602 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:54.602 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T17:39:54.602 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-28T17:39:54.602 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:54.687 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-28T17:39:54.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.688 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:54.688 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:54.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-28T17:39:54.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T17:39:54.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-28T17:39:54.689 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-28T17:39:54.689 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-28T17:39:54.689 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:54.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.845 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:54.845 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:54.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2023-11-28T17:39:54.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T17:39:54.845 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:54.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:54.887 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-28T17:39:54.941 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-28T17:39:54.942 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:54.942 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-28T17:39:54.992 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T17:39:54.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:54.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T17:39:55.100 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T17:39:55.101 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T17:39:55.101 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-11-28T17:39:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T17:39:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T17:39:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-11-28T17:39:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:55.202 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790" 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2023-11-28T17:39:55.213 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=412d3c1b-e5e1-47ba-972b-0544ebc8f3e9" will pass to kernel 2023-11-28T17:39:55.216 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T17:39:55.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.217 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-28T17:39:55.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.238 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:55.308 INFO:teuthology.orchestra.run.smithi064.stdout:client4493 2023-11-28T17:39:55.308 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:55.309 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:39:55.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.365 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:55.419 INFO:teuthology.orchestra.run.smithi064.stdout:client4493 2023-11-28T17:39:55.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.420 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:55.472 INFO:teuthology.orchestra.run.smithi064.stdout:client4493 2023-11-28T17:39:55.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.472 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/412d3c1b-e5e1-47ba-972b-0544ebc8f3e9.client4493/status') 2023-11-28T17:39:55.532 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.4493 (3)192.168.0.1:0/805414608 2023-11-28T17:39:55.533 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2023-11-28T17:39:55.533 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2023-11-28T17:39:55.533 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2023-11-28T17:39:55.533 INFO:teuthology.orchestra.run.smithi064.stderr:68 bytes copied, 5.3783e-05 s, 1.3 MB/s 2023-11-28T17:39:55.534 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-28T17:39:55.535 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T17:39:55.535 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T17:39:55.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T17:39:55.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 Processor -- start 2023-11-28T17:39:55.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 -- start start 2023-11-28T17:39:55.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f554806ca40 0x7f554815a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:55.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55480cf8a0 0x7f55480b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:55.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5548070700 con 0x7f55481574c0 2023-11-28T17:39:55.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f554815ad80 con 0x7f554806ca40 2023-11-28T17:39:55.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f554e0fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5548070950 con 0x7f55480cf8a0 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f5546ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f554806ca40 0x7f554815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f5546ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f554806ca40 0x7f554815a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:48998/0 (socket says 172.21.15.16:48998) 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f5546ffd640 1 -- 172.21.15.16:0/4289857429 learned_addr learned my addr 172.21.15.16:0/4289857429 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.687+0000 7f5547fff640 1 --2- 172.21.15.16:0/4289857429 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55480cf8a0 0x7f55480b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f5546ffd640 1 -- 172.21.15.16:0/4289857429 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55480cf8a0 msgr2=0x7f55480b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f5546ffd640 1 --2- 172.21.15.16:0/4289857429 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55480cf8a0 0x7f55480b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f5546ffd640 1 -- 172.21.15.16:0/4289857429 >> v1:172.21.15.16:6789/0 conn(0x7f55481574c0 legacy=0x7f554806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:55.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f5546ffd640 1 -- 172.21.15.16:0/4289857429 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548070c30 con 0x7f554806ca40 2023-11-28T17:39:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f5546ffd640 1 --2- 172.21.15.16:0/4289857429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f554815a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182f923955940b95 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:55.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f55467fc640 1 -- 172.21.15.16:0/4289857429 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0ad680 con 0x7f554806ca40 2023-11-28T17:39:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f55467fc640 1 -- 172.21.15.16:0/4289857429 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553c0ad7e0 con 0x7f554806ca40 2023-11-28T17:39:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f55467fc640 1 -- 172.21.15.16:0/4289857429 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553c0adb70 con 0x7f554806ca40 2023-11-28T17:39:55.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f554e0fe640 1 -- 172.21.15.16:0/4289857429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 msgr2=0x7f554815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4289857429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f554815a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f553c009870 tx=0x7f553c01c510 comp rx=0 tx=0).stop 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f554e0fe640 1 -- 172.21.15.16:0/4289857429 shutdown_connections 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4289857429 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55480cf8a0 0x7f55480b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4289857429 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f554815a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.691+0000 7f554e0fe640 1 -- 172.21.15.16:0/4289857429 >> 172.21.15.16:0/4289857429 conn(0x7f554806a5a0 msgr2=0x7f554806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 -- 172.21.15.16:0/4289857429 shutdown_connections 2023-11-28T17:39:55.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 -- 172.21.15.16:0/4289857429 wait complete. 2023-11-28T17:39:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 Processor -- start 2023-11-28T17:39:55.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 -- start start 2023-11-28T17:39:55.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f55480b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55480cf8a0 0x7f55480cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55481574c0 0x7f554814e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480b0030 con 0x7f554806ca40 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480af420 con 0x7f55480cf8a0 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f554e0fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55480af700 con 0x7f55481574c0 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f55480b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f55480b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:49000/0 (socket says 172.21.15.16:49000) 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 -- 172.21.15.16:0/4181567317 learned_addr learned my addr 172.21.15.16:0/4181567317 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:55.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f5546ffd640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55480cf8a0 0x7f55480cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f5547fff640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55481574c0 0x7f554814e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 -- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55481574c0 msgr2=0x7f554814e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55481574c0 0x7f554814e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 -- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55480cf8a0 msgr2=0x7f55480cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55480cf8a0 0x7f55480cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 -- 172.21.15.16:0/4181567317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c0094d0 con 0x7f554806ca40 2023-11-28T17:39:55.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.695+0000 7f55477fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f55480b04c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f553800c3c0 tx=0x7f553800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55380052d0 con 0x7f554806ca40 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538005430 con 0x7f554806ca40 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538003840 con 0x7f554806ca40 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55480af9e0 con 0x7f554806ca40 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55480aec60 con 0x7f554806ca40 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5548068860 con 0x7f554806ca40 2023-11-28T17:39:55.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f55380039a0 con 0x7f554806ca40 2023-11-28T17:39:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f552ffff640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f55340668d0 0x7f5534068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.699+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5538083980 con 0x7f554806ca40 2023-11-28T17:39:55.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.703+0000 7f5546ffd640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f55340668d0 0x7f5534068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:55.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.703+0000 7f5546ffd640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f55340668d0 0x7f5534068d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f553c0af000 tx=0x7f553c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:55.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.707+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5538050bd0 con 0x7f554806ca40 2023-11-28T17:39:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5548150620 con 0x7f554806ca40 2023-11-28T17:39:55.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f552ffff640 1 -- 172.21.15.16:0/4181567317 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5538017070 con 0x7f554806ca40 2023-11-28T17:39:55.902 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T17:39:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f55340668d0 msgr2=0x7f5534068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f55340668d0 0x7f5534068d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f553c0af000 tx=0x7f553c0a7000 comp rx=0 tx=0).stop 2023-11-28T17:39:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 msgr2=0x7f55480b04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f55480b04c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f553800c3c0 tx=0x7f553800c880 comp rx=0 tx=0).stop 2023-11-28T17:39:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 shutdown_connections 2023-11-28T17:39:55.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55481574c0 0x7f554814e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f55340668d0 0x7f5534068d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f55480cf8a0 0x7f55480cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 --2- 172.21.15.16:0/4181567317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f554806ca40 0x7f55480b04c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 >> 172.21.15.16:0/4181567317 conn(0x7f554806a5a0 msgr2=0x7f55481582b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 shutdown_connections 2023-11-28T17:39:55.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:55.899+0000 7f554e0fe640 1 -- 172.21.15.16:0/4181567317 wait complete. 2023-11-28T17:39:55.923 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T17:39:55.923 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T17:39:55.923 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-11-28T17:39:55.923 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-28T17:39:55.924 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-28T17:39:55.924 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T17:39:55.924 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T17:39:55.924 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T17:39:55.924 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-28T17:39:55.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.924 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-11-28T17:39:55.934 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:55.934 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:55.934 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:55.935 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 02:42:9d:50:d2:d7 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T17:39:55.936 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:55.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.937 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T17:39:55.995 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-11-28T17:39:55.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:55.997 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T17:39:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T17:39:56.056 INFO:teuthology.orchestra.run.smithi064.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T17:39:56.056 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T17:39:56.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.056 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:56.056 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:56.056 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T17:39:56.056 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T17:39:56.056 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T17:39:56.056 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:56.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.150 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-11-28T17:39:56.160 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-28T17:39:56.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.161 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2023-11-28T17:39:56.213 INFO:teuthology.orchestra.run.smithi064.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-28T17:39:56.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.214 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:56.214 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:56.214 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-28T17:39:56.214 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-28T17:39:56.214 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:56.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.298 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T17:39:56.366 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:56.366 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:56.366 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:56.366 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.366 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether fa:f3:0d:22:e5:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::f8f3:dff:fe22:e517/64 scope link tentative 2023-11-28T17:39:56.367 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.368 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-28T17:39:56.433 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:39:56.434 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:39:56.434 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:39:56.434 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.434 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-11-28T17:39:56.434 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.434 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:39:56.435 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether fa:f3:0d:22:e5:17 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-28T17:39:56.435 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-28T17:39:56.435 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.435 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::f8f3:dff:fe22:e517/64 scope link 2023-11-28T17:39:56.435 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:39:56.436 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-28T17:39:56.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.436 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-28T17:39:56.437 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:56.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.584 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-11-28T17:39:56.584 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-11-28T17:39:56.584 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.1 up 2023-11-28T17:39:56.584 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.1 master ceph-brx 2023-11-28T17:39:56.585 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-11-28T17:39:56.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:56.627 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-28T17:39:56.681 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-28T17:39:56.682 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:39:56.682 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-28T17:39:56.732 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T17:39:56.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.732 DEBUG:teuthology.orchestra.run.smithi064:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T17:39:56.828 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T17:39:56.828 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T17:39:56.829 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-11-28T17:39:56.843 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T17:39:56.844 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T17:39:56.844 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-11-28T17:39:56.844 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:56.844 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:56.853 INFO:teuthology.orchestra.run.smithi064.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:invalid new device string format 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790" 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2023-11-28T17:39:56.854 INFO:teuthology.orchestra.run.smithi064.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=412d3c1b-e5e1-47ba-972b-0544ebc8f3e9" will pass to kernel 2023-11-28T17:39:56.856 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T17:39:56.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.857 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-28T17:39:56.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.878 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:56.936 INFO:teuthology.orchestra.run.smithi064.stdout:client4689 2023-11-28T17:39:56.937 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:39:56.937 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:39:56.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:56.989 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:57.044 INFO:teuthology.orchestra.run.smithi064.stdout:client4689 2023-11-28T17:39:57.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:57.045 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:39:57.099 INFO:teuthology.orchestra.run.smithi064.stdout:client4689 2023-11-28T17:39:57.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:39:57.100 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/412d3c1b-e5e1-47ba-972b-0544ebc8f3e9.client4689/status') 2023-11-28T17:39:57.161 INFO:teuthology.orchestra.run.smithi064.stdout:instance: client.4689 (3)172.21.15.64:0/2964264237 2023-11-28T17:39:57.161 INFO:teuthology.orchestra.run.smithi064.stdout:blocklisted: false 2023-11-28T17:39:57.162 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records in 2023-11-28T17:39:57.162 INFO:teuthology.orchestra.run.smithi064.stderr:0+1 records out 2023-11-28T17:39:57.162 INFO:teuthology.orchestra.run.smithi064.stderr:70 bytes copied, 5.3425e-05 s, 1.3 MB/s 2023-11-28T17:39:57.163 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T17:39:57.179 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:57.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.327+0000 7fc8026ea640 1 Processor -- start 2023-11-28T17:39:57.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc8026ea640 1 -- start start 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc8026ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06d300 0x7fc7fc161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc8026ea640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7fc06e880 0x7fc7fc06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc8026ea640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc161f70 con 0x7fc7fc15d620 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc8026ea640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc06f250 con 0x7fc7fc06e880 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc8026ea640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc0cee20 con 0x7fc7fc06d300 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc7fbfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc7fc15d620 0x7fc7fc0cb790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36692/0 (socket says 172.21.15.16:36692) 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc7fbfff640 1 -- 172.21.15.16:0/55413980 learned_addr learned my addr 172.21.15.16:0/55413980 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc800c87640 1 --2- 172.21.15.16:0/55413980 >> v2:172.21.15.64:3300/0 conn(0x7fc7fc06e880 0x7fc7fc06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc7fb7fe640 1 --2- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06d300 0x7fc7fc161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc7faffd640 1 -- 172.21.15.16:0/55413980 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569959948 0 0) 0x7fc7fc161f70 con 0x7fc7fc15d620 2023-11-28T17:39:57.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc7faffd640 1 -- 172.21.15.16:0/55413980 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e4003530 con 0x7fc7fc15d620 2023-11-28T17:39:57.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc800c87640 1 -- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06d300 msgr2=0x7fc7fc161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:57.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc800c87640 1 --2- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06d300 0x7fc7fc161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc800c87640 1 -- 172.21.15.16:0/55413980 >> v1:172.21.15.16:6789/0 conn(0x7fc7fc15d620 legacy=0x7fc7fc0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.331+0000 7fc800c87640 1 -- 172.21.15.16:0/55413980 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc0cf100 con 0x7fc7fc06e880 2023-11-28T17:39:57.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc800c87640 1 --2- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc06e880 0x7fc7fc06ed10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009d90 tx=0x7fc7f401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7426432fa772799d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:57.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc7faffd640 1 -- 172.21.15.16:0/55413980 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40a59e0 con 0x7fc7fc06e880 2023-11-28T17:39:57.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc7faffd640 1 -- 172.21.15.16:0/55413980 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40a5b40 con 0x7fc7fc06e880 2023-11-28T17:39:57.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc7faffd640 1 -- 172.21.15.16:0/55413980 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40ad440 con 0x7fc7fc06e880 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 -- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc06e880 msgr2=0x7fc7fc06ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 --2- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc06e880 0x7fc7fc06ed10 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc7f4009d90 tx=0x7fc7f401c920 comp rx=0 tx=0).stop 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 -- 172.21.15.16:0/55413980 shutdown_connections 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 --2- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc06e880 0x7fc7fc06ed10 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 --2- 172.21.15.16:0/55413980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06d300 0x7fc7fc161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 -- 172.21.15.16:0/55413980 >> 172.21.15.16:0/55413980 conn(0x7fc7fc06a5a0 msgr2=0x7fc7fc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 -- 172.21.15.16:0/55413980 shutdown_connections 2023-11-28T17:39:57.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.335+0000 7fc8026ea640 1 -- 172.21.15.16:0/55413980 wait complete. 2023-11-28T17:39:57.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 Processor -- start 2023-11-28T17:39:57.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- start start 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 0x7fc7fc1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06e880 0x7fc7fc155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc15d620 0x7fc7fc1580c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc150ea0 con 0x7fc7fc06d300 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc150260 con 0x7fc7fc15d620 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc150500 con 0x7fc7fc06e880 2023-11-28T17:39:57.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 0x7fc7fc1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7fb7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06e880 0x7fc7fc155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7fbfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 0x7fc7fc1512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54672/0 (socket says 172.21.15.16:54672) 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc15d620 0x7fc7fc1580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7fbfff640 1 -- 172.21.15.16:0/980119722 learned_addr learned my addr 172.21.15.16:0/980119722 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 -- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06e880 msgr2=0x7fc7fc155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06e880 0x7fc7fc155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 -- 172.21.15.16:0/980119722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 msgr2=0x7fc7fc1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 0x7fc7fc1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 -- 172.21.15.16:0/980119722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f4009a70 con 0x7fc7fc15d620 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7fbfff640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 0x7fc7fc1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:57.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7fb7fe640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06e880 0x7fc7fc155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:57.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc800c87640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc15d620 0x7fc7fc1580c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ac000 tx=0x7fc7f40196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:57.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40add20 con 0x7fc7fc15d620 2023-11-28T17:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f40ade80 con 0x7fc7fc15d620 2023-11-28T17:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f40b7610 con 0x7fc7fc15d620 2023-11-28T17:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc1507e0 con 0x7fc7fc15d620 2023-11-28T17:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc156330 con 0x7fc7fc15d620 2023-11-28T17:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.339+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc150fe0 con 0x7fc7fc15d620 2023-11-28T17:39:57.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.343+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc7f40b4050 con 0x7fc7fc15d620 2023-11-28T17:39:57.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.343+0000 7fc7f8ff9640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc7e80668d0 0x7fc7e8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.343+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7f411fb00 con 0x7fc7fc15d620 2023-11-28T17:39:57.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.343+0000 7fc7fbfff640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc7e80668d0 0x7fc7e8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.343+0000 7fc7fbfff640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc7e80668d0 0x7fc7e8068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0011f0 tx=0x7fc7ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:57.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.347+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7f40ecfc0 con 0x7fc7fc15d620 2023-11-28T17:39:57.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.503+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7fc150fe0 con 0x7fc7fc15d620 2023-11-28T17:39:57.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc7f8ff9640 1 -- 172.21.15.16:0/980119722 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fc7fc150fe0 con 0x7fc7fc15d620 2023-11-28T17:39:57.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:57.509 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:57.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc7e80668d0 msgr2=0x7fc7e8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc7e80668d0 0x7fc7e8068d90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0011f0 tx=0x7fc7ec009040 comp rx=0 tx=0).stop 2023-11-28T17:39:57.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc15d620 msgr2=0x7fc7fc1580c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc15d620 0x7fc7fc1580c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc7f40ac000 tx=0x7fc7f40196c0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 shutdown_connections 2023-11-28T17:39:57.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc7e80668d0 0x7fc7e8068d90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7fc15d620 0x7fc7fc1580c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc7fc06e880 0x7fc7fc155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 --2- 172.21.15.16:0/980119722 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc7fc06d300 0x7fc7fc1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 >> 172.21.15.16:0/980119722 conn(0x7fc7fc06a5a0 msgr2=0x7fc7fc0c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:57.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 shutdown_connections 2023-11-28T17:39:57.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.507+0000 7fc8026ea640 1 -- 172.21.15.16:0/980119722 wait complete. 2023-11-28T17:39:57.530 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:39:57.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:39:57.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.671+0000 7f989f501640 1 Processor -- start 2023-11-28T17:39:57.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989f501640 1 -- start start 2023-11-28T17:39:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989f501640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f98980cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989f501640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f989806e880 0x7f989806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989f501640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98980cbcd0 con 0x7f989806d300 2023-11-28T17:39:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989f501640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989806f250 con 0x7f989806e880 2023-11-28T17:39:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989f501640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98980cee20 con 0x7f989815d620 2023-11-28T17:39:57.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f989806e880 0x7f989806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f989806e880 0x7f989806ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54684/0 (socket says 172.21.15.16:54684) 2023-11-28T17:39:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 -- 172.21.15.16:0/415438895 learned_addr learned my addr 172.21.15.16:0/415438895 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989d29d640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f98980cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 -- 172.21.15.16:0/415438895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 msgr2=0x7f98980cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f98980cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 -- 172.21.15.16:0/415438895 >> v1:172.21.15.64:6789/0 conn(0x7f989806d300 legacy=0x7f9898161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989da9e640 1 -- 172.21.15.16:0/415438895 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980cf100 con 0x7f989806e880 2023-11-28T17:39:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.675+0000 7f989d29d640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f98980cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:57.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989da9e640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806e880 0x7f989806ed10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9890009e50 tx=0x7f989001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4f2a00f1626f0b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f988ffff640 1 -- 172.21.15.16:0/415438895 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900a58a0 con 0x7f989806e880 2023-11-28T17:39:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f988ffff640 1 -- 172.21.15.16:0/415438895 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900a5a00 con 0x7f989806e880 2023-11-28T17:39:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f988ffff640 1 -- 172.21.15.16:0/415438895 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900a5d90 con 0x7f989806e880 2023-11-28T17:39:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 -- 172.21.15.16:0/415438895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806e880 msgr2=0x7f989806ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806e880 0x7f989806ed10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9890009e50 tx=0x7f989001c9e0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 -- 172.21.15.16:0/415438895 shutdown_connections 2023-11-28T17:39:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806e880 0x7f989806ed10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 --2- 172.21.15.16:0/415438895 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f98980cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 -- 172.21.15.16:0/415438895 >> 172.21.15.16:0/415438895 conn(0x7f989806a5a0 msgr2=0x7f989806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 -- 172.21.15.16:0/415438895 shutdown_connections 2023-11-28T17:39:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 -- 172.21.15.16:0/415438895 wait complete. 2023-11-28T17:39:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 Processor -- start 2023-11-28T17:39:57.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.679+0000 7f989f501640 1 -- start start 2023-11-28T17:39:57.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 0x7f98980c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989806e880 0x7f9898153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f9898154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98980c5d10 con 0x7f989806d300 2023-11-28T17:39:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898154f50 con 0x7f989806e880 2023-11-28T17:39:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898154060 con 0x7f989815d620 2023-11-28T17:39:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 0x7f98980c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 0x7f98980c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54688/0 (socket says 172.21.15.16:54688) 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 -- 172.21.15.16:0/1283364012 learned_addr learned my addr 172.21.15.16:0/1283364012 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989da9e640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f9898154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989ca9c640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989806e880 0x7f9898153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 -- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 msgr2=0x7f9898154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f9898154250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 -- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989806e880 msgr2=0x7f9898153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989806e880 0x7f9898153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 -- 172.21.15.16:0/1283364012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009420 con 0x7f989806d300 2023-11-28T17:39:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989d29d640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 0x7f98980c70d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f989400ebe0 tx=0x7f989400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989400eee0 con 0x7f989806d300 2023-11-28T17:39:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989400cc30 con 0x7f989806d300 2023-11-28T17:39:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894013470 con 0x7f989806d300 2023-11-28T17:39:57.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890009b30 con 0x7f989806d300 2023-11-28T17:39:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98981551a0 con 0x7f989806d300 2023-11-28T17:39:57.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.683+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9898068860 con 0x7f989806d300 2023-11-28T17:39:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.687+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f98940135d0 con 0x7f989806d300 2023-11-28T17:39:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.687+0000 7f988dffb640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f987c066920 0x7f987c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.687+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9894084630 con 0x7f989806d300 2023-11-28T17:39:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.687+0000 7f989ca9c640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f987c066920 0x7f987c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:57.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.687+0000 7f989ca9c640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f987c066920 0x7f987c068de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f989815a8d0 tx=0x7f9888009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:57.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.691+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9894051990 con 0x7f989806d300 2023-11-28T17:39:57.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.847+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f98980cbab0 con 0x7f989806d300 2023-11-28T17:39:57.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.847+0000 7f988dffb640 1 -- 172.21.15.16:0/1283364012 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9894054fb0 con 0x7f989806d300 2023-11-28T17:39:57.850 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f987c066920 msgr2=0x7f987c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f987c066920 0x7f987c068de0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f989815a8d0 tx=0x7f9888009040 comp rx=0 tx=0).stop 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 msgr2=0x7f98980c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 0x7f98980c70d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f989400ebe0 tx=0x7f989400c520 comp rx=0 tx=0).stop 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 shutdown_connections 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f989815d620 0x7f9898154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f987c066920 0x7f987c068de0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f989806e880 0x7f9898153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 --2- 172.21.15.16:0/1283364012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f989806d300 0x7f98980c70d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:57.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 >> 172.21.15.16:0/1283364012 conn(0x7f989806a5a0 msgr2=0x7f989815df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:57.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 shutdown_connections 2023-11-28T17:39:57.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:57.851+0000 7f989f501640 1 -- 172.21.15.16:0/1283364012 wait complete. 2023-11-28T17:39:57.872 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:39:58.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b83432640 1 Processor -- start 2023-11-28T17:39:58.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b83432640 1 -- start start 2023-11-28T17:39:58.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b83432640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5b7c0cf3b0 0x7f5b7c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b83432640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0ce4f0 con 0x7f5b7c144c80 2023-11-28T17:39:58.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b83432640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7c0ce7d0 con 0x7f5b7c0cef30 2023-11-28T17:39:58.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b83432640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7c0709b0 con 0x7f5b7c0cf3b0 2023-11-28T17:39:58.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b811ce640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5b7c144c80 0x7f5b7c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36706/0 (socket says 172.21.15.16:36706) 2023-11-28T17:39:58.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b811ce640 1 -- 172.21.15.16:0/1757749103 learned_addr learned my addr 172.21.15.16:0/1757749103 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:58.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b819cf640 1 --2- 172.21.15.16:0/1757749103 >> v2:172.21.15.64:3300/0 conn(0x7f5b7c0cf3b0 0x7f5b7c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563401016 0 0) 0x7f5b7c0ce4f0 con 0x7f5b7c144c80 2023-11-28T17:39:58.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b68003530 con 0x7f5b7c144c80 2023-11-28T17:39:58.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941406300 0 0) 0x7f5b7c0ce7d0 con 0x7f5b7c0cef30 2023-11-28T17:39:58.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b7c0ce4f0 con 0x7f5b7c0cef30 2023-11-28T17:39:58.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b819cf640 1 -- 172.21.15.16:0/1757749103 >> v1:172.21.15.64:6789/0 conn(0x7f5b7c0cef30 legacy=0x7f5b7c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b819cf640 1 -- 172.21.15.16:0/1757749103 >> v1:172.21.15.16:6789/0 conn(0x7f5b7c144c80 legacy=0x7f5b7c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.015+0000 7f5b819cf640 1 -- 172.21.15.16:0/1757749103 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c0ceab0 con 0x7f5b7c0cf3b0 2023-11-28T17:39:58.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b819cf640 1 --2- 172.21.15.16:0/1757749103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c0714e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009d90 tx=0x7f5b7401c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c10dc509dc908b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740a5920 con 0x7f5b7c0cf3b0 2023-11-28T17:39:58.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740a5a80 con 0x7f5b7c0cf3b0 2023-11-28T17:39:58.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b73fff640 1 -- 172.21.15.16:0/1757749103 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740a5e10 con 0x7f5b7c0cf3b0 2023-11-28T17:39:58.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 -- 172.21.15.16:0/1757749103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 msgr2=0x7f5b7c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 --2- 172.21.15.16:0/1757749103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c0714e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5b74009d90 tx=0x7f5b7401c950 comp rx=0 tx=0).stop 2023-11-28T17:39:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 -- 172.21.15.16:0/1757749103 shutdown_connections 2023-11-28T17:39:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 --2- 172.21.15.16:0/1757749103 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c0714e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 -- 172.21.15.16:0/1757749103 >> 172.21.15.16:0/1757749103 conn(0x7f5b7c06a5a0 msgr2=0x7f5b7c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 -- 172.21.15.16:0/1757749103 shutdown_connections 2023-11-28T17:39:58.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.019+0000 7f5b83432640 1 -- 172.21.15.16:0/1757749103 wait complete. 2023-11-28T17:39:58.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 Processor -- start 2023-11-28T17:39:58.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 -- start start 2023-11-28T17:39:58.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5b7c0cef30 0x7f5b7c15eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c13cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 0x7f5b7c0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0b4020 con 0x7f5b7c144c80 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c15f3e0 con 0x7f5b7c0cf3b0 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7c0b31f0 con 0x7f5b7c0cef30 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 0x7f5b7c0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 0x7f5b7c0ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54694/0 (socket says 172.21.15.16:54694) 2023-11-28T17:39:58.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 -- 172.21.15.16:0/3585706170 learned_addr learned my addr 172.21.15.16:0/3585706170 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:58.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b811ce640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5b7c0cef30 0x7f5b7c15eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b809cd640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c13cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 -- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5b7c0cef30 msgr2=0x7f5b7c15eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5b7c0cef30 0x7f5b7c15eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 -- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 msgr2=0x7f5b7c13cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c13cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 -- 172.21.15.16:0/3585706170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74009a70 con 0x7f5b7c144c80 2023-11-28T17:39:58.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b819cf640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 0x7f5b7c0ae990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b740b0040 tx=0x7f5b740196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740adce0 con 0x7f5b7c144c80 2023-11-28T17:39:58.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b740ade40 con 0x7f5b7c144c80 2023-11-28T17:39:58.031 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b740b9690 con 0x7f5b7c144c80 2023-11-28T17:39:58.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b7c13d560 con 0x7f5b7c144c80 2023-11-28T17:39:58.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.023+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b7c13d0d0 con 0x7f5b7c144c80 2023-11-28T17:39:58.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.027+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b7c13d320 con 0x7f5b7c144c80 2023-11-28T17:39:58.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.027+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5b740b97f0 con 0x7f5b7c144c80 2023-11-28T17:39:58.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.027+0000 7f5b71ffb640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5b600668d0 0x7f5b60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.027+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b7411f8b0 con 0x7f5b7c144c80 2023-11-28T17:39:58.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.027+0000 7f5b811ce640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5b600668d0 0x7f5b60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.027+0000 7f5b811ce640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5b600668d0 0x7f5b60068d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007fd0 tx=0x7f5b78007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.031+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5b7c13d320 con 0x7f5b7c144c80 2023-11-28T17:39:58.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.191+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b7c13d320 con 0x7f5b7c144c80 2023-11-28T17:39:58.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.191+0000 7f5b71ffb640 1 -- 172.21.15.16:0/3585706170 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b7c13d320 con 0x7f5b7c144c80 2023-11-28T17:39:58.196 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:39:58.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5b600668d0 msgr2=0x7f5b60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5b600668d0 0x7f5b60068d90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5b78007fd0 tx=0x7f5b78007d80 comp rx=0 tx=0).stop 2023-11-28T17:39:58.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 msgr2=0x7f5b7c0ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 0x7f5b7c0ae990 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5b740b0040 tx=0x7f5b740196f0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 shutdown_connections 2023-11-28T17:39:58.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5b7c144c80 0x7f5b7c0ae990 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5b600668d0 0x7f5b60068d90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b7c0cf3b0 0x7f5b7c13cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 --2- 172.21.15.16:0/3585706170 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5b7c0cef30 0x7f5b7c15eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 >> 172.21.15.16:0/3585706170 conn(0x7f5b7c06a5a0 msgr2=0x7f5b7c159620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:58.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 shutdown_connections 2023-11-28T17:39:58.200 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.195+0000 7f5b83432640 1 -- 172.21.15.16:0/3585706170 wait complete. 2023-11-28T17:39:58.217 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:39:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 Processor -- start 2023-11-28T17:39:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 -- start start 2023-11-28T17:39:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f90f006d300 0x7f90f0161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006e880 0x7f90f006ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f0161f70 con 0x7f90f015d620 2023-11-28T17:39:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f006f250 con 0x7f90f006d300 2023-11-28T17:39:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f77d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f00cee20 con 0x7f90f006e880 2023-11-28T17:39:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f90f006d300 0x7f90f0161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f90f006d300 0x7f90f0161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54708/0 (socket says 172.21.15.16:54708) 2023-11-28T17:39:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1479573684 learned_addr learned my addr 172.21.15.16:0/1479573684 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f5d6e640 1 --2- 172.21.15.16:0/1479573684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006e880 0x7f90f006ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1479573684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006e880 msgr2=0x7f90f006ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:58.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 --2- 172.21.15.16:0/1479573684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006e880 0x7f90f006ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1479573684 >> v1:172.21.15.64:6789/0 conn(0x7f90f015d620 legacy=0x7f90f00cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.363+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1479573684 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f00cf100 con 0x7f90f006d300 2023-11-28T17:39:58.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f4d6c640 1 --2- 172.21.15.16:0/1479573684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006d300 0x7f90f0161a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f90e00098a0 tx=0x7f90e001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0255e2169fbd097 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90e7fff640 1 -- 172.21.15.16:0/1479573684 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00aa650 con 0x7f90f006d300 2023-11-28T17:39:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90e7fff640 1 -- 172.21.15.16:0/1479573684 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e00aa7b0 con 0x7f90f006d300 2023-11-28T17:39:58.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90e7fff640 1 -- 172.21.15.16:0/1479573684 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00aab40 con 0x7f90f006d300 2023-11-28T17:39:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 -- 172.21.15.16:0/1479573684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006d300 msgr2=0x7f90f0161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1479573684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006d300 0x7f90f0161a30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f90e00098a0 tx=0x7f90e001c4f0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 -- 172.21.15.16:0/1479573684 shutdown_connections 2023-11-28T17:39:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1479573684 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006e880 0x7f90f006ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1479573684 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006d300 0x7f90f0161a30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 -- 172.21.15.16:0/1479573684 >> 172.21.15.16:0/1479573684 conn(0x7f90f006a5a0 msgr2=0x7f90f006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 -- 172.21.15.16:0/1479573684 shutdown_connections 2023-11-28T17:39:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.367+0000 7f90f77d1640 1 -- 172.21.15.16:0/1479573684 wait complete. 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 Processor -- start 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- start start 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006d300 0x7f90f0158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 0x7f90f00c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90f015d620 0x7f90f0154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0157ab0 con 0x7f90f006e880 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0157d90 con 0x7f90f015d620 2023-11-28T17:39:58.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f0158070 con 0x7f90f006d300 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 0x7f90f00c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f556d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006d300 0x7f90f0158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 0x7f90f00c6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54720/0 (socket says 172.21.15.16:54720) 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1881265365 learned_addr learned my addr 172.21.15.16:0/1881265365 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f5d6e640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90f015d620 0x7f90f0154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006d300 msgr2=0x7f90f0158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006d300 0x7f90f0158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90f015d620 msgr2=0x7f90f0154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90f015d620 0x7f90f0154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 -- 172.21.15.16:0/1881265365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e00094d0 con 0x7f90f006e880 2023-11-28T17:39:58.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f556d640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006d300 0x7f90f0158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:39:58.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f4d6c640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 0x7f90f00c6f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f90e00ac040 tx=0x7f90e001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00b3800 con 0x7f90f006e880 2023-11-28T17:39:58.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e00b3980 con 0x7f90f006e880 2023-11-28T17:39:58.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f0158350 con 0x7f90f006e880 2023-11-28T17:39:58.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00b3d30 con 0x7f90f006e880 2023-11-28T17:39:58.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f0157760 con 0x7f90f006e880 2023-11-28T17:39:58.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.371+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f0068860 con 0x7f90f006e880 2023-11-28T17:39:58.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.375+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f90e00b2380 con 0x7f90f006e880 2023-11-28T17:39:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.375+0000 7f90e5ffb640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f90d40668d0 0x7f90d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.375+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90e011e6f0 con 0x7f90f006e880 2023-11-28T17:39:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.375+0000 7f90f556d640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f90d40668d0 0x7f90d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.375+0000 7f90f556d640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f90d40668d0 0x7f90d4068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f90f0159420 tx=0x7f90ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.379+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f90e00eb940 con 0x7f90f006e880 2023-11-28T17:39:58.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90f0158800 con 0x7f90f006e880 2023-11-28T17:39:58.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90e5ffb640 1 -- 172.21.15.16:0/1881265365 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90e00aa610 con 0x7f90f006e880 2023-11-28T17:39:58.541 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:39:58.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f90d40668d0 msgr2=0x7f90d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f90d40668d0 0x7f90d4068d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f90f0159420 tx=0x7f90ec009040 comp rx=0 tx=0).stop 2023-11-28T17:39:58.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 msgr2=0x7f90f00c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 0x7f90f00c6f50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f90e00ac040 tx=0x7f90e001ad30 comp rx=0 tx=0).stop 2023-11-28T17:39:58.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 shutdown_connections 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f90d40668d0 0x7f90d4068d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90f015d620 0x7f90f0154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f90f006e880 0x7f90f00c6f50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 --2- 172.21.15.16:0/1881265365 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f90f006d300 0x7f90f0158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 >> 172.21.15.16:0/1881265365 conn(0x7f90f006a5a0 msgr2=0x7f90f015e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 shutdown_connections 2023-11-28T17:39:58.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.539+0000 7f90f77d1640 1 -- 172.21.15.16:0/1881265365 wait complete. 2023-11-28T17:39:58.563 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:39:58.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 Processor -- start 2023-11-28T17:39:58.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 -- start start 2023-11-28T17:39:58.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb5815d540 0x7fdb580b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb580d1f50 0x7fdb580d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb580b32c0 con 0x7fdb580d34c0 2023-11-28T17:39:58.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb5815d920 con 0x7fdb5815d540 2023-11-28T17:39:58.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5ffaa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb580b35a0 con 0x7fdb580d1f50 2023-11-28T17:39:58.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb5815d540 0x7fdb580b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fdb5815d540 0x7fdb580b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54730/0 (socket says 172.21.15.16:54730) 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1113231435 learned_addr learned my addr 172.21.15.16:0/1113231435 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5d545640 1 --2- 172.21.15.16:0/1113231435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb580d1f50 0x7fdb580d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1113231435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb580d1f50 msgr2=0x7fdb580d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 --2- 172.21.15.16:0/1113231435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb580d1f50 0x7fdb580d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1113231435 >> v1:172.21.15.64:6789/0 conn(0x7fdb580d34c0 legacy=0x7fdb580cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.703+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1113231435 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb580b3880 con 0x7fdb5815d540 2023-11-28T17:39:58.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5dd46640 1 --2- 172.21.15.16:0/1113231435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb5815d540 0x7fdb580b29c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009870 tx=0x7fdb5401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644a8c2ba3487631 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5cd44640 1 -- 172.21.15.16:0/1113231435 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540aa670 con 0x7fdb5815d540 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5cd44640 1 -- 172.21.15.16:0/1113231435 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540aa7d0 con 0x7fdb5815d540 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5cd44640 1 -- 172.21.15.16:0/1113231435 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540aab60 con 0x7fdb5815d540 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1113231435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb5815d540 msgr2=0x7fdb580b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1113231435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb5815d540 0x7fdb580b29c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009870 tx=0x7fdb5401c510 comp rx=0 tx=0).stop 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1113231435 shutdown_connections 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1113231435 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb580d1f50 0x7fdb580d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1113231435 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb5815d540 0x7fdb580b29c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1113231435 >> 172.21.15.16:0/1113231435 conn(0x7fdb5808ccf0 msgr2=0x7fdb5809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:58.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1113231435 shutdown_connections 2023-11-28T17:39:58.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.707+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1113231435 wait complete. 2023-11-28T17:39:58.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 Processor -- start 2023-11-28T17:39:58.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- start start 2023-11-28T17:39:58.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 0x7fdb580cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb580d34c0 0x7fdb580b7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb5815d540 0x7fdb580b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb581542e0 con 0x7fdb580d1f50 2023-11-28T17:39:58.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58152f60 con 0x7fdb580d34c0 2023-11-28T17:39:58.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb58153240 con 0x7fdb5815d540 2023-11-28T17:39:58.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 0x7fdb580cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 0x7fdb580cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54744/0 (socket says 172.21.15.16:54744) 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1309113658 learned_addr learned my addr 172.21.15.16:0/1309113658 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5e547640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb5815d540 0x7fdb580b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5d545640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb580d34c0 0x7fdb580b7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb5815d540 msgr2=0x7fdb580b7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb5815d540 0x7fdb580b7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb580d34c0 msgr2=0x7fdb580b7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb580d34c0 0x7fdb580b7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 -- 172.21.15.16:0/1309113658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb540094d0 con 0x7fdb580d1f50 2023-11-28T17:39:58.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5e547640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb5815d540 0x7fdb580b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:58.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5d545640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb580d34c0 0x7fdb580b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:58.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5dd46640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 0x7fdb580cc3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ac040 tx=0x7fdb5401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540b3800 con 0x7fdb580d1f50 2023-11-28T17:39:58.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540b3980 con 0x7fdb580d1f50 2023-11-28T17:39:58.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58153520 con 0x7fdb580d1f50 2023-11-28T17:39:58.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540b3d30 con 0x7fdb580d1f50 2023-11-28T17:39:58.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb58153ae0 con 0x7fdb580d1f50 2023-11-28T17:39:58.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.711+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb58068860 con 0x7fdb580d1f50 2023-11-28T17:39:58.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.715+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdb540c6390 con 0x7fdb580d1f50 2023-11-28T17:39:58.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.715+0000 7fdb4e7fc640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdb3c0668d0 0x7fdb3c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:58.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.715+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb5411f050 con 0x7fdb580d1f50 2023-11-28T17:39:58.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.715+0000 7fdb5d545640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdb3c0668d0 0x7fdb3c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:58.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.715+0000 7fdb5d545640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdb3c0668d0 0x7fdb3c068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb580d2350 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:58.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.719+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb540ec1f0 con 0x7fdb580d1f50 2023-11-28T17:39:58.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.879+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb5806b420 con 0x7fdb580d1f50 2023-11-28T17:39:58.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.879+0000 7fdb4e7fc640 1 -- 172.21.15.16:0/1309113658 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fdb540ef810 con 0x7fdb580d1f50 2023-11-28T17:39:58.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:39:58.883 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:39:58.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdb3c0668d0 msgr2=0x7fdb3c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdb3c0668d0 0x7fdb3c068d90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdb580d2350 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2023-11-28T17:39:58.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 msgr2=0x7fdb580cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:58.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 0x7fdb580cc3e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdb540ac040 tx=0x7fdb5401ad50 comp rx=0 tx=0).stop 2023-11-28T17:39:58.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 shutdown_connections 2023-11-28T17:39:58.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdb5815d540 0x7fdb580b7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdb3c0668d0 0x7fdb3c068d90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb580d34c0 0x7fdb580b7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 --2- 172.21.15.16:0/1309113658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdb580d1f50 0x7fdb580cc3e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 >> 172.21.15.16:0/1309113658 conn(0x7fdb5808ccf0 msgr2=0x7fdb580affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 shutdown_connections 2023-11-28T17:39:58.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:58.883+0000 7fdb5ffaa640 1 -- 172.21.15.16:0/1309113658 wait complete. 2023-11-28T17:39:58.904 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:39:58.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:39:59.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 Processor -- start 2023-11-28T17:39:59.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 -- start start 2023-11-28T17:39:59.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb6180cef30 0x7fb6180cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb618070dd0 0x7fb618071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6180ce4f0 con 0x7fb618144c80 2023-11-28T17:39:59.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6180709b0 con 0x7fb618070dd0 2023-11-28T17:39:59.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61d1b8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb618145060 con 0x7fb6180cef30 2023-11-28T17:39:59.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.047+0000 7fb61759e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb618070dd0 0x7fb618071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb618070dd0 0x7fb618071220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54758/0 (socket says 172.21.15.16:54758) 2023-11-28T17:39:59.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 -- 172.21.15.16:0/3595270794 learned_addr learned my addr 172.21.15.16:0/3595270794 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:59.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 -- 172.21.15.16:0/3595270794 >> v2:172.21.15.64:3300/0 conn(0x7fb6180cef30 msgr2=0x7fb6180cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb60ffff640 1 --2- 172.21.15.16:0/3595270794 >> v2:172.21.15.64:3300/0 conn(0x7fb6180cef30 0x7fb6180cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 --2- 172.21.15.16:0/3595270794 >> v2:172.21.15.64:3300/0 conn(0x7fb6180cef30 0x7fb6180cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 -- 172.21.15.16:0/3595270794 >> v1:172.21.15.64:6789/0 conn(0x7fb618144c80 legacy=0x7fb6180cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 -- 172.21.15.16:0/3595270794 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6180ce7d0 con 0x7fb618070dd0 2023-11-28T17:39:59.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb60ffff640 1 --2- 172.21.15.16:0/3595270794 >> v2:172.21.15.64:3300/0 conn(0x7fb6180cef30 0x7fb6180cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:39:59.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61759e640 1 --2- 172.21.15.16:0/3595270794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb618070dd0 0x7fb618071220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb6180aec50 tx=0x7fb61001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98e511b56a80482 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61659c640 1 -- 172.21.15.16:0/3595270794 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100a5760 con 0x7fb618070dd0 2023-11-28T17:39:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61659c640 1 -- 172.21.15.16:0/3595270794 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6100a58c0 con 0x7fb618070dd0 2023-11-28T17:39:59.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.051+0000 7fb61659c640 1 -- 172.21.15.16:0/3595270794 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6100a5c50 con 0x7fb618070dd0 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- 172.21.15.16:0/3595270794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb618070dd0 msgr2=0x7fb618071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/3595270794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb618070dd0 0x7fb618071220 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb6180aec50 tx=0x7fb61001c990 comp rx=0 tx=0).stop 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- 172.21.15.16:0/3595270794 shutdown_connections 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/3595270794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb618070dd0 0x7fb618071220 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/3595270794 >> v2:172.21.15.64:3300/0 conn(0x7fb6180cef30 0x7fb6180cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- 172.21.15.16:0/3595270794 >> 172.21.15.16:0/3595270794 conn(0x7fb61806a5a0 msgr2=0x7fb61806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:59.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- 172.21.15.16:0/3595270794 shutdown_connections 2023-11-28T17:39:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- 172.21.15.16:0/3595270794 wait complete. 2023-11-28T17:39:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 Processor -- start 2023-11-28T17:39:59.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- start start 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb618070dd0 0x7fb61812d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 0x7fb6180ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb618144c80 0x7fb618142f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6181f6d70 con 0x7fb6180cef30 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61812d6a0 con 0x7fb618070dd0 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61d1b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61812d980 con 0x7fb618144c80 2023-11-28T17:39:59.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 0x7fb6180ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb60ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 0x7fb6180ad680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54766/0 (socket says 172.21.15.16:54766) 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb60ffff640 1 -- 172.21.15.16:0/836500026 learned_addr learned my addr 172.21.15.16:0/836500026 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb616d9d640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb618070dd0 0x7fb61812d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.055+0000 7fb61759e640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb618144c80 0x7fb618142f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60ffff640 1 -- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb618144c80 msgr2=0x7fb618142f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60ffff640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb618144c80 0x7fb618142f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60ffff640 1 -- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb618070dd0 msgr2=0x7fb61812d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60ffff640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb618070dd0 0x7fb61812d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60ffff640 1 -- 172.21.15.16:0/836500026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb610009b30 con 0x7fb6180cef30 2023-11-28T17:39:59.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb61759e640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb618144c80 0x7fb618142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:39:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60ffff640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 0x7fb6180ad680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c7f0 tx=0x7fb60000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600007820 con 0x7fb6180cef30 2023-11-28T17:39:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb600007980 con 0x7fb6180cef30 2023-11-28T17:39:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb61812dc60 con 0x7fb6180cef30 2023-11-28T17:39:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb600007d30 con 0x7fb6180cef30 2023-11-28T17:39:59.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61812b0a0 con 0x7fb6180cef30 2023-11-28T17:39:59.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6180adc80 con 0x7fb6180cef30 2023-11-28T17:39:59.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb6000113f0 con 0x7fb6180cef30 2023-11-28T17:39:59.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.059+0000 7fb60f7fe640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5f80668d0 0x7fb5f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.063+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb600084500 con 0x7fb6180cef30 2023-11-28T17:39:59.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.063+0000 7fb616d9d640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5f80668d0 0x7fb5f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.063+0000 7fb616d9d640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5f80668d0 0x7fb5f8068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6080098e0 tx=0x7fb608009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.063+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb600051750 con 0x7fb6180cef30 2023-11-28T17:39:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.223+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb618068860 con 0x7fb6180cef30 2023-11-28T17:39:59.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb60f7fe640 1 -- 172.21.15.16:0/836500026 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb600054d70 con 0x7fb6180cef30 2023-11-28T17:39:59.229 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5f80668d0 msgr2=0x7fb5f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5f80668d0 0x7fb5f8068d90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb6080098e0 tx=0x7fb608009060 comp rx=0 tx=0).stop 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 msgr2=0x7fb6180ad680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 0x7fb6180ad680 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb60000c7f0 tx=0x7fb60000ccb0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 shutdown_connections 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb618144c80 0x7fb618142f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb6180cef30 0x7fb6180ad680 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb5f80668d0 0x7fb5f8068d90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 --2- 172.21.15.16:0/836500026 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb618070dd0 0x7fb61812d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 >> 172.21.15.16:0/836500026 conn(0x7fb61806a5a0 msgr2=0x7fb618141280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:59.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 shutdown_connections 2023-11-28T17:39:59.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.227+0000 7fb61d1b8640 1 -- 172.21.15.16:0/836500026 wait complete. 2023-11-28T17:39:59.249 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:39:59.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.391+0000 7f7a0abe6640 1 Processor -- start 2023-11-28T17:39:59.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.391+0000 7f7a0abe6640 1 -- start start 2023-11-28T17:39:59.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.391+0000 7f7a0abe6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7a04072090 0x7f7a040cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.391+0000 7f7a0abe6640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0415a8b0 con 0x7f7a041548e0 2023-11-28T17:39:59.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.391+0000 7f7a0abe6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a040cea50 con 0x7f7a0415b350 2023-11-28T17:39:59.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.391+0000 7f7a0abe6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a040ce860 con 0x7f7a04072090 2023-11-28T17:39:59.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7a041548e0 0x7f7a040ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36708/0 (socket says 172.21.15.16:36708) 2023-11-28T17:39:59.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 -- 172.21.15.16:0/1243815956 learned_addr learned my addr 172.21.15.16:0/1243815956 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:39:59.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a03fff640 1 --2- 172.21.15.16:0/1243815956 >> v2:172.21.15.64:3300/0 conn(0x7f7a04072090 0x7f7a040cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416322540 0 0) 0x7f7a0415a8b0 con 0x7f7a041548e0 2023-11-28T17:39:59.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f4005740 con 0x7f7a041548e0 2023-11-28T17:39:59.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 662637283 0 0) 0x7f7a040cea50 con 0x7f7a0415b350 2023-11-28T17:39:59.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a0415a8b0 con 0x7f7a0415b350 2023-11-28T17:39:59.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2800346855 0 0) 0x7f79f4005740 con 0x7f7a041548e0 2023-11-28T17:39:59.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 >> v2:172.21.15.64:3300/0 conn(0x7f7a04072090 msgr2=0x7f7a040cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 --2- 172.21.15.16:0/1243815956 >> v2:172.21.15.64:3300/0 conn(0x7f7a04072090 0x7f7a040cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 >> v1:172.21.15.64:6789/0 conn(0x7f7a0415b350 legacy=0x7f7a040cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0415ab50 con 0x7f7a041548e0 2023-11-28T17:39:59.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f79f8001600 con 0x7f7a041548e0 2023-11-28T17:39:59.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 >> v1:172.21.15.16:6789/0 conn(0x7f7a041548e0 legacy=0x7f7a040ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f79f4006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f79f40069e0 0x7f79f4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79f40073a0 0x7f79f400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f400e270 con 0x7f79f4005d70 2023-11-28T17:39:59.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f400e3b0 con 0x7f79f40073a0 2023-11-28T17:39:59.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f400e570 con 0x7f79f40069e0 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f79f4006170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a03fff640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f79f40069e0 0x7f79f4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a09183640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79f40073a0 0x7f79f400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 -- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f79f40069e0 msgr2=0x7f79f4006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f79f40069e0 0x7f79f4006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 -- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79f40073a0 msgr2=0x7f79f400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79f40073a0 0x7f79f400dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a08982640 1 -- 172.21.15.16:0/1243815956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f4005740 con 0x7f79f4005d70 2023-11-28T17:39:59.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.395+0000 7f7a09183640 1 -- 172.21.15.16:0/1243815956 reap_dead start 2023-11-28T17:39:59.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a08982640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f79f4006170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79f8007f50 tx=0x7f79f801caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97908b42c73ff2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f8005ba0 con 0x7f79f4005d70 2023-11-28T17:39:59.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8005d20 con 0x7f79f4005d70 2023-11-28T17:39:59.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a037fe640 1 -- 172.21.15.16:0/1243815956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80072b0 con 0x7f79f4005d70 2023-11-28T17:39:59.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 -- 172.21.15.16:0/1243815956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 msgr2=0x7f79f4006170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f79f4006170 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f79f8007f50 tx=0x7f79f801caa0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 -- 172.21.15.16:0/1243815956 shutdown_connections 2023-11-28T17:39:59.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/1243815956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f79f4006170 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 -- 172.21.15.16:0/1243815956 >> 172.21.15.16:0/1243815956 conn(0x7f7a0406a5a0 msgr2=0x7f7a0406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:59.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 -- 172.21.15.16:0/1243815956 shutdown_connections 2023-11-28T17:39:59.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 -- 172.21.15.16:0/1243815956 wait complete. 2023-11-28T17:39:59.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 Processor -- start 2023-11-28T17:39:59.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.399+0000 7f7a0abe6640 1 -- start start 2023-11-28T17:39:59.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f7a040b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a041e7a50 0x7f7a04152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a04153060 0x7f7a040afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a041534e0 con 0x7f79f4005d70 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a040b1bb0 con 0x7f7a041e7a50 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a041e5e30 con 0x7f7a04153060 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f7a040b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f7a040b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54776/0 (socket says 172.21.15.16:54776) 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 -- 172.21.15.16:0/3449350000 learned_addr learned my addr 172.21.15.16:0/3449350000 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a09183640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a04153060 0x7f7a040afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a03fff640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a041e7a50 0x7f7a04152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 -- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a04153060 msgr2=0x7f7a040afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a04153060 0x7f7a040afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 -- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a041e7a50 msgr2=0x7f7a04152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a041e7a50 0x7f7a04152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 -- 172.21.15.16:0/3449350000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a041e6110 con 0x7f79f4005d70 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a08982640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f7a040b1670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f79f801c8d0 tx=0x7f79f4007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80b3070 con 0x7f79f4005d70 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f8005e90 con 0x7f79f4005d70 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f80070c0 con 0x7f79f4005d70 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a041e63f0 con 0x7f79f4005d70 2023-11-28T17:39:59.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a041e69b0 con 0x7f79f4005d70 2023-11-28T17:39:59.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.403+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a04068860 con 0x7f79f4005d70 2023-11-28T17:39:59.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.407+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f79f8007220 con 0x7f79f4005d70 2023-11-28T17:39:59.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.407+0000 7f7a017fa640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f79e8066900 0x7f79e8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.407+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79f811d8f0 con 0x7f79f4005d70 2023-11-28T17:39:59.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.407+0000 7f7a03fff640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f79e8066900 0x7f79e8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.407+0000 7f7a03fff640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f79e8066900 0x7f79e8068dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a040cbdd0 tx=0x7f79f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.411+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f79f80eaa90 con 0x7f79f4005d70 2023-11-28T17:39:59.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a040cd980 con 0x7f79f4005d70 2023-11-28T17:39:59.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a017fa640 1 -- 172.21.15.16:0/3449350000 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79f80ee0b0 con 0x7f79f4005d70 2023-11-28T17:39:59.570 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f79e8066900 msgr2=0x7f79e8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f79e8066900 0x7f79e8068dc0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a040cbdd0 tx=0x7f79f0008040 comp rx=0 tx=0).stop 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 msgr2=0x7f7a040b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f7a040b1670 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f79f801c8d0 tx=0x7f79f4007a10 comp rx=0 tx=0).stop 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 shutdown_connections 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7a04153060 0x7f7a040afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f79e8066900 0x7f79e8068dc0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7a041e7a50 0x7f7a04152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 --2- 172.21.15.16:0/3449350000 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f79f4005d70 0x7f7a040b1670 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 >> 172.21.15.16:0/3449350000 conn(0x7f7a0406a5a0 msgr2=0x7f7a040b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:59.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 shutdown_connections 2023-11-28T17:39:59.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.567+0000 7f7a0abe6640 1 -- 172.21.15.16:0/3449350000 wait complete. 2023-11-28T17:39:59.592 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:39:59.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 Processor -- start 2023-11-28T17:39:59.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 -- start start 2023-11-28T17:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f15fc15b3d0 0x7f15fc0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f15fc15f860 0x7f15fc0b4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15fc0b4570 con 0x7f15fc06e880 2023-11-28T17:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15fc15fcc0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f1600965640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15fc0ceaf0 con 0x7f15fc15f860 2023-11-28T17:39:59.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f15fa59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f15fc15b3d0 0x7f15fc0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f15fa59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f15fc15b3d0 0x7f15fc0cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54780/0 (socket says 172.21.15.16:54780) 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f15fa59c640 1 -- 172.21.15.16:0/1751027371 learned_addr learned my addr 172.21.15.16:0/1751027371 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.735+0000 7f15f3fff640 1 --2- 172.21.15.16:0/1751027371 >> v2:172.21.15.64:3300/0 conn(0x7f15fc15f860 0x7f15fc0b4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15fa59c640 1 -- 172.21.15.16:0/1751027371 >> v2:172.21.15.64:3300/0 conn(0x7f15fc15f860 msgr2=0x7f15fc0b4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15fa59c640 1 --2- 172.21.15.16:0/1751027371 >> v2:172.21.15.64:3300/0 conn(0x7f15fc15f860 0x7f15fc0b4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15fa59c640 1 -- 172.21.15.16:0/1751027371 >> v1:172.21.15.64:6789/0 conn(0x7f15fc06e880 legacy=0x7f15fc0d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:39:59.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15fa59c640 1 -- 172.21.15.16:0/1751027371 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0d0ba0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15fa59c640 1 --2- 172.21.15.16:0/1751027371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc0cd2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0d21e0 tx=0x7f15ec01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3ce5df533d3651 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15f9d9b640 1 -- 172.21.15.16:0/1751027371 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec0aa660 con 0x7f15fc15b3d0 2023-11-28T17:39:59.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15f9d9b640 1 -- 172.21.15.16:0/1751027371 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec0aa7c0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f15f9d9b640 1 -- 172.21.15.16:0/1751027371 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec0aab50 con 0x7f15fc15b3d0 2023-11-28T17:39:59.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 -- 172.21.15.16:0/1751027371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 msgr2=0x7f15fc0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 --2- 172.21.15.16:0/1751027371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc0cd2f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0d21e0 tx=0x7f15ec01c500 comp rx=0 tx=0).stop 2023-11-28T17:39:59.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 -- 172.21.15.16:0/1751027371 shutdown_connections 2023-11-28T17:39:59.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 --2- 172.21.15.16:0/1751027371 >> v2:172.21.15.64:3300/0 conn(0x7f15fc15f860 0x7f15fc0b4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 --2- 172.21.15.16:0/1751027371 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc0cd2f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 -- 172.21.15.16:0/1751027371 >> 172.21.15.16:0/1751027371 conn(0x7f15fc06a5a0 msgr2=0x7f15fc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.739+0000 7f1600965640 1 -- 172.21.15.16:0/1751027371 shutdown_connections 2023-11-28T17:39:59.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 -- 172.21.15.16:0/1751027371 wait complete. 2023-11-28T17:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 Processor -- start 2023-11-28T17:39:59.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 -- start start 2023-11-28T17:39:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15fc06e880 0x7f15fc0c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15fc15f860 0x7f15fc159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc0c9220 con 0x7f15fc15b3d0 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc0c8210 con 0x7f15fc15f860 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f1600965640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15fc15cf00 con 0x7f15fc06e880 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc154570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54782/0 (socket says 172.21.15.16:54782) 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 -- 172.21.15.16:0/1134224470 learned_addr learned my addr 172.21.15.16:0/1134224470 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15fad9d640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15fc15f860 0x7f15fc159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15fa59c640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15fc06e880 0x7f15fc0c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 -- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15fc06e880 msgr2=0x7f15fc0c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15fc06e880 0x7f15fc0c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 -- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15fc15f860 msgr2=0x7f15fc159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15fc15f860 0x7f15fc159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 -- 172.21.15.16:0/1134224470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ec0094d0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f3fff640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc154570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15e400d800 tx=0x7f15e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.743+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400b6c0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e400b820 con 0x7f15fc15b3d0 2023-11-28T17:39:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e400bb90 con 0x7f15fc15b3d0 2023-11-28T17:39:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15fc06f220 con 0x7f15fc15b3d0 2023-11-28T17:39:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15fc0c8420 con 0x7f15fc15b3d0 2023-11-28T17:39:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15fc068860 con 0x7f15fc15b3d0 2023-11-28T17:39:59.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f15e400bcf0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f15f2ffd640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f15dc0668d0 0x7f15dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:39:59.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15e40847b0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.747+0000 7f15fa59c640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f15dc0668d0 0x7f15dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:39:59.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.751+0000 7f15fa59c640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f15dc0668d0 0x7f15dc068d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0ae000 tx=0x7f15ec0b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:39:59.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.751+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f15e4051b30 con 0x7f15fc15b3d0 2023-11-28T17:39:59.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f15fc0ce3f0 con 0x7f15fc15b3d0 2023-11-28T17:39:59.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f15f2ffd640 1 -- 172.21.15.16:0/1134224470 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f15e4055150 con 0x7f15fc15b3d0 2023-11-28T17:39:59.915 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:39:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f15dc0668d0 msgr2=0x7f15dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f15dc0668d0 0x7f15dc068d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15ec0ae000 tx=0x7f15ec0b5040 comp rx=0 tx=0).stop 2023-11-28T17:39:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 msgr2=0x7f15fc154570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:39:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc154570 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f15e400d800 tx=0x7f15e400dcc0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 shutdown_connections 2023-11-28T17:39:59.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f15dc0668d0 0x7f15dc068d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f15fc15f860 0x7f15fc159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f15fc15b3d0 0x7f15fc154570 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 --2- 172.21.15.16:0/1134224470 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f15fc06e880 0x7f15fc0c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:39:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 >> 172.21.15.16:0/1134224470 conn(0x7f15fc06a5a0 msgr2=0x7f15fc0b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:39:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 shutdown_connections 2023-11-28T17:39:59.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:39:59.911+0000 7f1600965640 1 -- 172.21.15.16:0/1134224470 wait complete. 2023-11-28T17:39:59.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:00.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 Processor -- start 2023-11-28T17:40:00.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 -- start start 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0140d1f50 0x7ff0140d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff0140d34c0 0x7ff0140cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0140b32c0 con 0x7ff01415d540 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0140b30d0 con 0x7ff0140d1f50 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01b180640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01415d920 con 0x7ff0140d34c0 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0140d1f50 0x7ff0140d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0140d1f50 0x7ff0140d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54786/0 (socket says 172.21.15.16:54786) 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 -- 172.21.15.16:0/1959605811 learned_addr learned my addr 172.21.15.16:0/1959605811 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:00.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff01971d640 1 --2- 172.21.15.16:0/1959605811 >> v2:172.21.15.64:3300/0 conn(0x7ff0140d34c0 0x7ff0140cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 -- 172.21.15.16:0/1959605811 >> v2:172.21.15.64:3300/0 conn(0x7ff0140d34c0 msgr2=0x7ff0140cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:00.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 --2- 172.21.15.16:0/1959605811 >> v2:172.21.15.64:3300/0 conn(0x7ff0140d34c0 0x7ff0140cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 -- 172.21.15.16:0/1959605811 >> v1:172.21.15.64:6789/0 conn(0x7ff01415d540 legacy=0x7ff0140b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.075+0000 7ff013fff640 1 -- 172.21.15.16:0/1959605811 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0140b35a0 con 0x7ff0140d1f50 2023-11-28T17:40:00.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff013fff640 1 --2- 172.21.15.16:0/1959605811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff0140d2f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff014160ee0 tx=0x7ff00001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc633749ba22e41 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff0137fe640 1 -- 172.21.15.16:0/1959605811 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000aa430 con 0x7ff0140d1f50 2023-11-28T17:40:00.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff0137fe640 1 -- 172.21.15.16:0/1959605811 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0000aa590 con 0x7ff0140d1f50 2023-11-28T17:40:00.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff0137fe640 1 -- 172.21.15.16:0/1959605811 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000aa920 con 0x7ff0140d1f50 2023-11-28T17:40:00.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 -- 172.21.15.16:0/1959605811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 msgr2=0x7ff0140d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 --2- 172.21.15.16:0/1959605811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff0140d2f80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff014160ee0 tx=0x7ff00001c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 -- 172.21.15.16:0/1959605811 shutdown_connections 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 --2- 172.21.15.16:0/1959605811 >> v2:172.21.15.64:3300/0 conn(0x7ff0140d34c0 0x7ff0140cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 --2- 172.21.15.16:0/1959605811 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff0140d2f80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 -- 172.21.15.16:0/1959605811 >> 172.21.15.16:0/1959605811 conn(0x7ff01408ccf0 msgr2=0x7ff01409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 -- 172.21.15.16:0/1959605811 shutdown_connections 2023-11-28T17:40:00.085 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.079+0000 7ff01b180640 1 -- 172.21.15.16:0/1959605811 wait complete. 2023-11-28T17:40:00.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 Processor -- start 2023-11-28T17:40:00.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 -- start start 2023-11-28T17:40:00.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff014155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0140d34c0 0x7ff014160140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff01415d540 0x7ff0140b4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff014160990 con 0x7ff0140d1f50 2023-11-28T17:40:00.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0141553d0 con 0x7ff01415d540 2023-11-28T17:40:00.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01b180640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff014154aa0 con 0x7ff0140d34c0 2023-11-28T17:40:00.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff014155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff014155860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54800/0 (socket says 172.21.15.16:54800) 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 -- 172.21.15.16:0/1374091395 learned_addr learned my addr 172.21.15.16:0/1374091395 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff013fff640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0140d34c0 0x7ff014160140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01971d640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff01415d540 0x7ff0140b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 -- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0140d34c0 msgr2=0x7ff014160140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0140d34c0 0x7ff014160140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 -- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff01415d540 msgr2=0x7ff0140b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff01415d540 0x7ff0140b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff018f1c640 1 -- 172.21.15.16:0/1374091395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000094d0 con 0x7ff0140d1f50 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff013fff640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0140d34c0 0x7ff014160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.083+0000 7ff01971d640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff01415d540 0x7ff0140b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:00.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff018f1c640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff014155860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c3f0 tx=0x7ff00800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0080052d0 con 0x7ff0140d1f50 2023-11-28T17:40:00.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff008005430 con 0x7ff0140d1f50 2023-11-28T17:40:00.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff014154d80 con 0x7ff0140d1f50 2023-11-28T17:40:00.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008003840 con 0x7ff0140d1f50 2023-11-28T17:40:00.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff014160680 con 0x7ff0140d1f50 2023-11-28T17:40:00.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff014068860 con 0x7ff0140d1f50 2023-11-28T17:40:00.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0080039a0 con 0x7ff0140d1f50 2023-11-28T17:40:00.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff0117fa640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feff8066900 0x7feff8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0080839a0 con 0x7ff0140d1f50 2023-11-28T17:40:00.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.087+0000 7ff013fff640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feff8066900 0x7feff8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.091+0000 7ff013fff640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feff8066900 0x7feff8068dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0000ae000 tx=0x7ff0000b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.091+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff008050bf0 con 0x7ff0140d1f50 2023-11-28T17:40:00.255 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.251+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff01415a280 con 0x7ff0140d1f50 2023-11-28T17:40:00.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff0117fa640 1 -- 172.21.15.16:0/1374091395 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7ff008054210 con 0x7ff0140d1f50 2023-11-28T17:40:00.257 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:00.257 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feff8066900 msgr2=0x7feff8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feff8066900 0x7feff8068dc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff0000ae000 tx=0x7ff0000b5040 comp rx=0 tx=0).stop 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 msgr2=0x7ff014155860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff014155860 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff00800c3f0 tx=0x7ff00800c8b0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 shutdown_connections 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feff8066900 0x7feff8068dc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff01415d540 0x7ff0140b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0140d34c0 0x7ff014160140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 --2- 172.21.15.16:0/1374091395 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0140d1f50 0x7ff014155860 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 >> 172.21.15.16:0/1374091395 conn(0x7ff01408ccf0 msgr2=0x7ff0140d00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:00.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 shutdown_connections 2023-11-28T17:40:00.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.255+0000 7ff01b180640 1 -- 172.21.15.16:0/1374091395 wait complete. 2023-11-28T17:40:00.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:00.280 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:00.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb651d640 1 Processor -- start 2023-11-28T17:40:00.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb651d640 1 -- start start 2023-11-28T17:40:00.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb651d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9bb00cf8a0 0x7f9bb015a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb651d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb0070700 con 0x7f9bb006ca40 2023-11-28T17:40:00.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb651d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bb015ad80 con 0x7f9bb01574c0 2023-11-28T17:40:00.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb651d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb0070950 con 0x7f9bb00cf8a0 2023-11-28T17:40:00.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9ba7fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9bb006ca40 0x7f9bb00b2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36724/0 (socket says 172.21.15.16:36724) 2023-11-28T17:40:00.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9ba7fff640 1 -- 172.21.15.16:0/3181760105 learned_addr learned my addr 172.21.15.16:0/3181760105 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:00.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb4aba640 1 --2- 172.21.15.16:0/3181760105 >> v2:172.21.15.16:3300/0 conn(0x7f9bb00cf8a0 0x7f9bb015a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9baf7fe640 1 -- 172.21.15.16:0/3181760105 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3537087017 0 0) 0x7f9bb0070700 con 0x7f9bb006ca40 2023-11-28T17:40:00.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9baf7fe640 1 -- 172.21.15.16:0/3181760105 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b9c003530 con 0x7f9bb006ca40 2023-11-28T17:40:00.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb4aba640 1 -- 172.21.15.16:0/3181760105 >> v1:172.21.15.64:6789/0 conn(0x7f9bb01574c0 legacy=0x7f9bb006c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb4aba640 1 -- 172.21.15.16:0/3181760105 >> v1:172.21.15.16:6789/0 conn(0x7f9bb006ca40 legacy=0x7f9bb00b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.423+0000 7f9bb4aba640 1 -- 172.21.15.16:0/3181760105 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb0070c30 con 0x7f9bb00cf8a0 2023-11-28T17:40:00.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb4aba640 1 --2- 172.21.15.16:0/3181760105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb015a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800aea0 tx=0x7f9ba801da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38eaa4f5063dcb80 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9baf7fe640 1 -- 172.21.15.16:0/3181760105 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800a2d0 con 0x7f9bb00cf8a0 2023-11-28T17:40:00.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9baf7fe640 1 -- 172.21.15.16:0/3181760105 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80a6860 con 0x7f9bb00cf8a0 2023-11-28T17:40:00.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9baf7fe640 1 -- 172.21.15.16:0/3181760105 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80a6bf0 con 0x7f9bb00cf8a0 2023-11-28T17:40:00.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 -- 172.21.15.16:0/3181760105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb00cf8a0 msgr2=0x7f9bb015a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 --2- 172.21.15.16:0/3181760105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb015a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800aea0 tx=0x7f9ba801da20 comp rx=0 tx=0).stop 2023-11-28T17:40:00.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 -- 172.21.15.16:0/3181760105 shutdown_connections 2023-11-28T17:40:00.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 --2- 172.21.15.16:0/3181760105 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb015a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 -- 172.21.15.16:0/3181760105 >> 172.21.15.16:0/3181760105 conn(0x7f9bb006a5a0 msgr2=0x7f9bb006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:00.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 -- 172.21.15.16:0/3181760105 shutdown_connections 2023-11-28T17:40:00.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.427+0000 7f9bb651d640 1 -- 172.21.15.16:0/3181760105 wait complete. 2023-11-28T17:40:00.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 Processor -- start 2023-11-28T17:40:00.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 -- start start 2023-11-28T17:40:00.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 0x7f9bb0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb014c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9bb01574c0 0x7f9bb014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb014dac0 con 0x7f9bb006ca40 2023-11-28T17:40:00.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00cdf70 con 0x7f9bb00cf8a0 2023-11-28T17:40:00.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb00affc0 con 0x7f9bb01574c0 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 0x7f9bb0156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 0x7f9bb0156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54832/0 (socket says 172.21.15.16:54832) 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 -- 172.21.15.16:0/2568696681 learned_addr learned my addr 172.21.15.16:0/2568696681 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9ba7fff640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb014c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb4aba640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9bb01574c0 0x7f9bb014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 -- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9bb01574c0 msgr2=0x7f9bb014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9bb01574c0 0x7f9bb014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 -- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bb00cf8a0 msgr2=0x7f9bb014c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb014c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 -- 172.21.15.16:0/2568696681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba800ab80 con 0x7f9bb006ca40 2023-11-28T17:40:00.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb4aba640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9bb01574c0 0x7f9bb014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:00.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9baffff640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 0x7f9bb0156310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c3c0 tx=0x7f9ba000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba00052d0 con 0x7f9bb006ca40 2023-11-28T17:40:00.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba0005430 con 0x7f9bb006ca40 2023-11-28T17:40:00.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0003840 con 0x7f9bb006ca40 2023-11-28T17:40:00.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb014ce40 con 0x7f9bb006ca40 2023-11-28T17:40:00.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.431+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb014d400 con 0x7f9bb006ca40 2023-11-28T17:40:00.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.435+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb0068860 con 0x7f9bb006ca40 2023-11-28T17:40:00.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.435+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ba00039a0 con 0x7f9bb006ca40 2023-11-28T17:40:00.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.435+0000 7f9bad7fa640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9b900668d0 0x7f9b90068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.435+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ba00838f0 con 0x7f9bb006ca40 2023-11-28T17:40:00.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.435+0000 7f9ba7fff640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9b900668d0 0x7f9b90068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.435+0000 7f9ba7fff640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9b900668d0 0x7f9b90068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bb01f6bc0 tx=0x7f9b98007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.439+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ba0050bd0 con 0x7f9bb006ca40 2023-11-28T17:40:00.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bb01589f0 con 0x7f9bb006ca40 2023-11-28T17:40:00.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bad7fa640 1 -- 172.21.15.16:0/2568696681 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ba00170a0 con 0x7f9bb006ca40 2023-11-28T17:40:00.602 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9b900668d0 msgr2=0x7f9b90068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9b900668d0 0x7f9b90068d90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9bb01f6bc0 tx=0x7f9b98007d40 comp rx=0 tx=0).stop 2023-11-28T17:40:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 msgr2=0x7f9bb0156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 0x7f9bb0156310 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9ba000c3c0 tx=0x7f9ba000c880 comp rx=0 tx=0).stop 2023-11-28T17:40:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 shutdown_connections 2023-11-28T17:40:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9bb01574c0 0x7f9bb014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9b900668d0 0x7f9b90068d90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9bb00cf8a0 0x7f9bb014c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 --2- 172.21.15.16:0/2568696681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9bb006ca40 0x7f9bb0156310 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 >> 172.21.15.16:0/2568696681 conn(0x7f9bb006a5a0 msgr2=0x7f9bb0071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:00.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 shutdown_connections 2023-11-28T17:40:00.605 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.599+0000 7f9bb651d640 1 -- 172.21.15.16:0/2568696681 wait complete. 2023-11-28T17:40:00.624 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:00.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 Processor -- start 2023-11-28T17:40:00.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 -- start start 2023-11-28T17:40:00.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf8144c80 0x7fcdf80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdf80cf640 0x7fcdf8070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf80ce4f0 con 0x7fcdf80cdf00 2023-11-28T17:40:00.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf80709b0 con 0x7fcdf80cf640 2023-11-28T17:40:00.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdfcdd1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8145060 con 0x7fcdf8144c80 2023-11-28T17:40:00.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf6d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fcdf80cf640 0x7fcdf8070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf5d9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fcdf80cdf00 0x7fcdf80cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36736/0 (socket says 172.21.15.16:36736) 2023-11-28T17:40:00.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf5d9b640 1 -- 172.21.15.16:0/3309306504 learned_addr learned my addr 172.21.15.16:0/3309306504 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:00.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf659c640 1 --2- 172.21.15.16:0/3309306504 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf8144c80 0x7fcdf80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3309306504 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf8144c80 msgr2=0x7fcdf80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:00.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf6d9d640 1 --2- 172.21.15.16:0/3309306504 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf8144c80 0x7fcdf80cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3309306504 >> v1:172.21.15.16:6789/0 conn(0x7fcdf80cdf00 legacy=0x7fcdf80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3309306504 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf80ce7d0 con 0x7fcdf80cf640 2023-11-28T17:40:00.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.767+0000 7fcdf559a640 1 -- 172.21.15.16:0/3309306504 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262865698 0 0) 0x7fcdf80ce4f0 con 0x7fcdf80cdf00 2023-11-28T17:40:00.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdf6d9d640 1 --2- 172.21.15.16:0/3309306504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf80cf640 0x7fcdf8070dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009dc0 tx=0x7fcdf001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4992295d0f6bddf2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdf559a640 1 -- 172.21.15.16:0/3309306504 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00a5900 con 0x7fcdf80cf640 2023-11-28T17:40:00.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdf559a640 1 -- 172.21.15.16:0/3309306504 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf00a5a60 con 0x7fcdf80cf640 2023-11-28T17:40:00.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdf559a640 1 -- 172.21.15.16:0/3309306504 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00a5df0 con 0x7fcdf80cf640 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3309306504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf80cf640 msgr2=0x7fcdf8070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3309306504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf80cf640 0x7fcdf8070dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcdf0009dc0 tx=0x7fcdf001c930 comp rx=0 tx=0).stop 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3309306504 shutdown_connections 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3309306504 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf80cf640 0x7fcdf8070dd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3309306504 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf8144c80 0x7fcdf80cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3309306504 >> 172.21.15.16:0/3309306504 conn(0x7fcdf806a5a0 msgr2=0x7fcdf806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3309306504 shutdown_connections 2023-11-28T17:40:00.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.771+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3309306504 wait complete. 2023-11-28T17:40:00.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 Processor -- start 2023-11-28T17:40:00.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 -- start start 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf80cdf00 0x7fcdf8137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdf80cf640 0x7fcdf81426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 0x7fcdf813d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf813c620 con 0x7fcdf8144c80 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf81384e0 con 0x7fcdf80cf640 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf8141c40 con 0x7fcdf80cdf00 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 0x7fcdf813d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 0x7fcdf813d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54850/0 (socket says 172.21.15.16:54850) 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3523990167 learned_addr learned my addr 172.21.15.16:0/3523990167 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf5d9b640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdf80cf640 0x7fcdf81426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf659c640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf80cdf00 0x7fcdf8137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf80cdf00 msgr2=0x7fcdf8137fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf80cdf00 0x7fcdf8137fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdf80cf640 msgr2=0x7fcdf81426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdf80cf640 0x7fcdf81426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 -- 172.21.15.16:0/3523990167 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf0009a70 con 0x7fcdf8144c80 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf5d9b640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdf80cf640 0x7fcdf81426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf659c640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf80cdf00 0x7fcdf8137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdf6d9d640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 0x7fcdf813d080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdf001afe0 tx=0x7fcdf00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00b9860 con 0x7fcdf8144c80 2023-11-28T17:40:00.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf00b99c0 con 0x7fcdf8144c80 2023-11-28T17:40:00.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00b9d70 con 0x7fcdf8144c80 2023-11-28T17:40:00.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.775+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf8141f20 con 0x7fcdf8144c80 2023-11-28T17:40:00.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.779+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf813cb60 con 0x7fcdf8144c80 2023-11-28T17:40:00.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.779+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf813cd50 con 0x7fcdf8144c80 2023-11-28T17:40:00.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.779+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fcdf00c4460 con 0x7fcdf8144c80 2023-11-28T17:40:00.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.783+0000 7fcde6ffd640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcdd80668d0 0x7fcdd8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:00.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.783+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf0120200 con 0x7fcdf8144c80 2023-11-28T17:40:00.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.783+0000 7fcdf659c640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcdd80668d0 0x7fcdd8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:00.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.783+0000 7fcdf659c640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcdd80668d0 0x7fcdd8068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009a40 tx=0x7fcde8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:00.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.783+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcdf00ed420 con 0x7fcdf8144c80 2023-11-28T17:40:00.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcdf8068860 con 0x7fcdf8144c80 2023-11-28T17:40:00.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcde6ffd640 1 -- 172.21.15.16:0/3523990167 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcdf00f0a40 con 0x7fcdf8144c80 2023-11-28T17:40:00.945 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcdd80668d0 msgr2=0x7fcdd8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcdd80668d0 0x7fcdd8068d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009a40 tx=0x7fcde8008040 comp rx=0 tx=0).stop 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 msgr2=0x7fcdf813d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 0x7fcdf813d080 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fcdf001afe0 tx=0x7fcdf00196d0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 shutdown_connections 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fcdf8144c80 0x7fcdf813d080 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fcdd80668d0 0x7fcdd8068d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcdf80cf640 0x7fcdf81426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 --2- 172.21.15.16:0/3523990167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fcdf80cdf00 0x7fcdf8137fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 >> 172.21.15.16:0/3523990167 conn(0x7fcdf806a5a0 msgr2=0x7fcdf806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 shutdown_connections 2023-11-28T17:40:00.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:00.943+0000 7fcdfcdd1640 1 -- 172.21.15.16:0/3523990167 wait complete. 2023-11-28T17:40:00.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:01.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.107+0000 7f5c8df1e640 1 Processor -- start 2023-11-28T17:40:01.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.107+0000 7f5c8df1e640 1 -- start start 2023-11-28T17:40:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8df1e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5c8815d2c0 0x7f5c880d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8df1e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5c880d1d00 0x7f5c880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8df1e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c880afdb0 con 0x7f5c8815d6a0 2023-11-28T17:40:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8df1e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c880b34b0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8df1e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c880b2b80 con 0x7f5c880d1d00 2023-11-28T17:40:01.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8d71d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5c8815d6a0 0x7f5c880cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36750/0 (socket says 172.21.15.16:36750) 2023-11-28T17:40:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8d71d640 1 -- 172.21.15.16:0/1353528098 learned_addr learned my addr 172.21.15.16:0/1353528098 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c87fff640 1 --2- 172.21.15.16:0/1353528098 >> v2:172.21.15.64:3300/0 conn(0x7f5c880d1d00 0x7f5c880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8cf1c640 1 --2- 172.21.15.16:0/1353528098 >> v2:172.21.15.16:3300/0 conn(0x7f5c8815d2c0 0x7f5c880d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c877fe640 1 -- 172.21.15.16:0/1353528098 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213356185 0 0) 0x7f5c880afdb0 con 0x7f5c8815d6a0 2023-11-28T17:40:01.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c877fe640 1 -- 172.21.15.16:0/1353528098 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c78003530 con 0x7f5c8815d6a0 2023-11-28T17:40:01.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c87fff640 1 -- 172.21.15.16:0/1353528098 >> v2:172.21.15.16:3300/0 conn(0x7f5c8815d2c0 msgr2=0x7f5c880d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:01.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c87fff640 1 --2- 172.21.15.16:0/1353528098 >> v2:172.21.15.16:3300/0 conn(0x7f5c8815d2c0 0x7f5c880d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c87fff640 1 -- 172.21.15.16:0/1353528098 >> v1:172.21.15.16:6789/0 conn(0x7f5c8815d6a0 legacy=0x7f5c880cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c87fff640 1 -- 172.21.15.16:0/1353528098 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c880b2e60 con 0x7f5c880d1d00 2023-11-28T17:40:01.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.111+0000 7f5c8cf1c640 1 --2- 172.21.15.16:0/1353528098 >> v2:172.21.15.16:3300/0 conn(0x7f5c8815d2c0 0x7f5c880d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:01.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c87fff640 1 --2- 172.21.15.16:0/1353528098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c880d1d00 0x7f5c880cfbf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c880d42e0 tx=0x7f5c7401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=783a3c140d955d59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c877fe640 1 -- 172.21.15.16:0/1353528098 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740ab600 con 0x7f5c880d1d00 2023-11-28T17:40:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c877fe640 1 -- 172.21.15.16:0/1353528098 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740a7050 con 0x7f5c880d1d00 2023-11-28T17:40:01.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c877fe640 1 -- 172.21.15.16:0/1353528098 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740ab980 con 0x7f5c880d1d00 2023-11-28T17:40:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 -- 172.21.15.16:0/1353528098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c880d1d00 msgr2=0x7f5c880cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/1353528098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c880d1d00 0x7f5c880cfbf0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5c880d42e0 tx=0x7f5c7401c430 comp rx=0 tx=0).stop 2023-11-28T17:40:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 -- 172.21.15.16:0/1353528098 shutdown_connections 2023-11-28T17:40:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/1353528098 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c880d1d00 0x7f5c880cfbf0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/1353528098 >> v2:172.21.15.16:3300/0 conn(0x7f5c8815d2c0 0x7f5c880d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 -- 172.21.15.16:0/1353528098 >> 172.21.15.16:0/1353528098 conn(0x7f5c8809c550 msgr2=0x7f5c880d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 -- 172.21.15.16:0/1353528098 shutdown_connections 2023-11-28T17:40:01.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 -- 172.21.15.16:0/1353528098 wait complete. 2023-11-28T17:40:01.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 Processor -- start 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.115+0000 7f5c8df1e640 1 -- start start 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c880d1d00 0x7f5c88156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 0x7f5c8815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c8815d6a0 0x7f5c88153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c880cbd80 con 0x7f5c8815d2c0 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88154bb0 con 0x7f5c8815d6a0 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c88157190 con 0x7f5c880d1d00 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 0x7f5c8815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8cf1c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c880d1d00 0x7f5c88156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 0x7f5c8815f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54864/0 (socket says 172.21.15.16:54864) 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 -- 172.21.15.16:0/2695608832 learned_addr learned my addr 172.21.15.16:0/2695608832 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8d71d640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c8815d6a0 0x7f5c88153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 -- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c880d1d00 msgr2=0x7f5c88156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c880d1d00 0x7f5c88156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 -- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c8815d6a0 msgr2=0x7f5c88153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c8815d6a0 0x7f5c88153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 -- 172.21.15.16:0/2695608832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c7c009420 con 0x7f5c8815d2c0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c87fff640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 0x7f5c8815f5b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c74019040 tx=0x7f5c740191d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740b4400 con 0x7f5c8815d2c0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740b4560 con 0x7f5c8815d2c0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740b48d0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c74009420 con 0x7f5c8815d2c0 2023-11-28T17:40:01.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c881550e0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c880cbec0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.119+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5c740b2040 con 0x7f5c8815d2c0 2023-11-28T17:40:01.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.123+0000 7f5c857fa640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5c6c0668d0 0x7f5c6c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.123+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c7411def0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.123+0000 7f5c8cf1c640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5c6c0668d0 0x7f5c6c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.123+0000 7f5c8cf1c640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5c6c0668d0 0x7f5c6c068d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c880d2860 tx=0x7f5c7c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.127+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c880cbec0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.283+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5c880cbec0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c857fa640 1 -- 172.21.15.16:0/2695608832 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c880cbec0 con 0x7f5c8815d2c0 2023-11-28T17:40:01.289 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5c6c0668d0 msgr2=0x7f5c6c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5c6c0668d0 0x7f5c6c068d90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c880d2860 tx=0x7f5c7c009190 comp rx=0 tx=0).stop 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 msgr2=0x7f5c8815f5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 0x7f5c8815f5b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5c74019040 tx=0x7f5c740191d0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 shutdown_connections 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5c6c0668d0 0x7f5c6c068d90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5c8815d6a0 0x7f5c88153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5c8815d2c0 0x7f5c8815f5b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 --2- 172.21.15.16:0/2695608832 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5c880d1d00 0x7f5c88156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 >> 172.21.15.16:0/2695608832 conn(0x7f5c8809c550 msgr2=0x7f5c880b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:01.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 shutdown_connections 2023-11-28T17:40:01.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.287+0000 7f5c8df1e640 1 -- 172.21.15.16:0/2695608832 wait complete. 2023-11-28T17:40:01.310 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:01.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 Processor -- start 2023-11-28T17:40:01.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 -- start start 2023-11-28T17:40:01.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f632015d5e0 0x7f63200d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f63200cefe0 0x7f63200d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63200d2220 con 0x7f63200d1de0 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200d0fe0 con 0x7f632015d5e0 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f63255c4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63200d12c0 con 0x7f63200cefe0 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631effd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f632015d5e0 0x7f63200d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631f7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f63200d1de0 0x7f63200cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36760/0 (socket says 172.21.15.16:36760) 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631f7fe640 1 -- 172.21.15.16:0/3002084097 learned_addr learned my addr 172.21.15.16:0/3002084097 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:01.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631e7fc640 1 --2- 172.21.15.16:0/3002084097 >> v2:172.21.15.64:3300/0 conn(0x7f63200cefe0 0x7f63200d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631effd640 1 -- 172.21.15.16:0/3002084097 >> v2:172.21.15.64:3300/0 conn(0x7f63200cefe0 msgr2=0x7f63200d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:01.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631effd640 1 --2- 172.21.15.16:0/3002084097 >> v2:172.21.15.64:3300/0 conn(0x7f63200cefe0 0x7f63200d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631effd640 1 -- 172.21.15.16:0/3002084097 >> v1:172.21.15.16:6789/0 conn(0x7f63200d1de0 legacy=0x7f63200cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631effd640 1 -- 172.21.15.16:0/3002084097 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63200d15a0 con 0x7f632015d5e0 2023-11-28T17:40:01.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.451+0000 7f631dffb640 1 -- 172.21.15.16:0/3002084097 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104526159 0 0) 0x7f63200d2220 con 0x7f63200d1de0 2023-11-28T17:40:01.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f631effd640 1 --2- 172.21.15.16:0/3002084097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f632015d5e0 0x7f63200d3b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63200cd890 tx=0x7f631001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9b8f2d4b3f1c61 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f631dffb640 1 -- 172.21.15.16:0/3002084097 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63100ac600 con 0x7f632015d5e0 2023-11-28T17:40:01.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f631dffb640 1 -- 172.21.15.16:0/3002084097 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63100a8050 con 0x7f632015d5e0 2023-11-28T17:40:01.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f631dffb640 1 -- 172.21.15.16:0/3002084097 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63100ac980 con 0x7f632015d5e0 2023-11-28T17:40:01.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 -- 172.21.15.16:0/3002084097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f632015d5e0 msgr2=0x7f63200d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 --2- 172.21.15.16:0/3002084097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f632015d5e0 0x7f63200d3b40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f63200cd890 tx=0x7f631001c3a0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 -- 172.21.15.16:0/3002084097 shutdown_connections 2023-11-28T17:40:01.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 --2- 172.21.15.16:0/3002084097 >> v2:172.21.15.64:3300/0 conn(0x7f63200cefe0 0x7f63200d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 --2- 172.21.15.16:0/3002084097 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f632015d5e0 0x7f63200d3b40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 -- 172.21.15.16:0/3002084097 >> 172.21.15.16:0/3002084097 conn(0x7f632009c640 msgr2=0x7f63200d32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:01.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 -- 172.21.15.16:0/3002084097 shutdown_connections 2023-11-28T17:40:01.460 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.455+0000 7f63255c4640 1 -- 172.21.15.16:0/3002084097 wait complete. 2023-11-28T17:40:01.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 Processor -- start 2023-11-28T17:40:01.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 -- start start 2023-11-28T17:40:01.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 0x7f63200b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63200d1de0 0x7f632015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f632015d5e0 0x7f63200b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200b3530 con 0x7f63200cefe0 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63200b3e90 con 0x7f632015d5e0 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63200b2c40 con 0x7f63200d1de0 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 0x7f63200b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 0x7f63200b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54880/0 (socket says 172.21.15.16:54880) 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 -- 172.21.15.16:0/1748518043 learned_addr learned my addr 172.21.15.16:0/1748518043 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631e7fc640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63200d1de0 0x7f632015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631f7fe640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f632015d5e0 0x7f63200b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 -- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63200d1de0 msgr2=0x7f632015b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63200d1de0 0x7f632015b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 -- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f632015d5e0 msgr2=0x7f63200b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f632015d5e0 0x7f63200b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 -- 172.21.15.16:0/1748518043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6310009420 con 0x7f63200cefe0 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f631effd640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 0x7f63200b3950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6310018fb0 tx=0x7f631001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63100b7420 con 0x7f63200cefe0 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63100b7580 con 0x7f63200cefe0 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63100b78f0 con 0x7f63200cefe0 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632015c0f0 con 0x7f63200cefe0 2023-11-28T17:40:01.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.459+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63200b2e70 con 0x7f63200cefe0 2023-11-28T17:40:01.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.463+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63200b3670 con 0x7f63200cefe0 2023-11-28T17:40:01.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.463+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63100b3040 con 0x7f63200cefe0 2023-11-28T17:40:01.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.463+0000 7f63077fe640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f630c0668d0 0x7f630c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.463+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f631011e890 con 0x7f63200cefe0 2023-11-28T17:40:01.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.463+0000 7f631e7fc640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f630c0668d0 0x7f630c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.463+0000 7f631e7fc640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f630c0668d0 0x7f630c068d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f63201f9760 tx=0x7f6314008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.467+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63200b3670 con 0x7f63200cefe0 2023-11-28T17:40:01.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.627+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63200b3670 con 0x7f63200cefe0 2023-11-28T17:40:01.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.627+0000 7f63077fe640 1 -- 172.21.15.16:0/1748518043 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f63200b3670 con 0x7f63200cefe0 2023-11-28T17:40:01.631 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:01.632 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f630c0668d0 msgr2=0x7f630c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f630c0668d0 0x7f630c068d90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f63201f9760 tx=0x7f6314008040 comp rx=0 tx=0).stop 2023-11-28T17:40:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 msgr2=0x7f63200b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 0x7f63200b3950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6310018fb0 tx=0x7f631001abe0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 shutdown_connections 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f630c0668d0 0x7f630c068d90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f632015d5e0 0x7f63200b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63200d1de0 0x7f632015b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 --2- 172.21.15.16:0/1748518043 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63200cefe0 0x7f63200b3950 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 >> 172.21.15.16:0/1748518043 conn(0x7f632009c640 msgr2=0x7f63200cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 shutdown_connections 2023-11-28T17:40:01.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.631+0000 7f63255c4640 1 -- 172.21.15.16:0/1748518043 wait complete. 2023-11-28T17:40:01.652 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:01.653 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:01.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.795+0000 7febb23d8640 1 Processor -- start 2023-11-28T17:40:01.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.795+0000 7febb23d8640 1 -- start start 2023-11-28T17:40:01.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.795+0000 7febb23d8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac144c80 0x7febac0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.795+0000 7febb23d8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0ce4f0 con 0x7febac0cdf00 2023-11-28T17:40:01.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.795+0000 7febb23d8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febac0ce7d0 con 0x7febac0cf640 2023-11-28T17:40:01.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.795+0000 7febb23d8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0709b0 con 0x7febac144c80 2023-11-28T17:40:01.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febab7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7febac0cdf00 0x7febac0cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36770/0 (socket says 172.21.15.16:36770) 2023-11-28T17:40:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febab7fe640 1 -- 172.21.15.16:0/1573552548 learned_addr learned my addr 172.21.15.16:0/1573552548 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:01.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febabfff640 1 --2- 172.21.15.16:0/1573552548 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac144c80 0x7febac0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760249643 0 0) 0x7febac0ce4f0 con 0x7febac0cdf00 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb94003530 con 0x7febac0cdf00 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564258761 0 0) 0x7febac0ce7d0 con 0x7febac0cf640 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febac0ce4f0 con 0x7febac0cf640 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febabfff640 1 -- 172.21.15.16:0/1573552548 >> v1:172.21.15.64:6789/0 conn(0x7febac0cf640 legacy=0x7febac070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febabfff640 1 -- 172.21.15.16:0/1573552548 >> v1:172.21.15.16:6789/0 conn(0x7febac0cdf00 legacy=0x7febac0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3522651592 0 0) 0x7feb94003530 con 0x7febac0cdf00 2023-11-28T17:40:01.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febabfff640 1 -- 172.21.15.16:0/1573552548 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac0ceab0 con 0x7febac144c80 2023-11-28T17:40:01.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.799+0000 7febabfff640 1 --2- 172.21.15.16:0/1573552548 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac144c80 0x7febac0cd9c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097f0 tx=0x7feb9c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3c962ca65c6a195 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba0001680 con 0x7febac144c80 2023-11-28T17:40:01.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0a7050 con 0x7febac144c80 2023-11-28T17:40:01.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febaaffd640 1 -- 172.21.15.16:0/1573552548 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0ab620 con 0x7febac144c80 2023-11-28T17:40:01.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- 172.21.15.16:0/1573552548 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac144c80 msgr2=0x7febac0cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 --2- 172.21.15.16:0/1573552548 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac144c80 0x7febac0cd9c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097f0 tx=0x7feb9c01c3e0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- 172.21.15.16:0/1573552548 shutdown_connections 2023-11-28T17:40:01.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 --2- 172.21.15.16:0/1573552548 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac144c80 0x7febac0cd9c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- 172.21.15.16:0/1573552548 >> 172.21.15.16:0/1573552548 conn(0x7febac06a5a0 msgr2=0x7febac06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:01.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- 172.21.15.16:0/1573552548 shutdown_connections 2023-11-28T17:40:01.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- 172.21.15.16:0/1573552548 wait complete. 2023-11-28T17:40:01.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 Processor -- start 2023-11-28T17:40:01.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- start start 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 0x7febac1f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac0cf640 0x7febac13d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac144c80 0x7febac0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c51c0 con 0x7febac0cdf00 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c4c00 con 0x7febac144c80 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febb23d8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febac0c4ee0 con 0x7febac0cf640 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.803+0000 7febabfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 0x7febac1f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 0x7febac1f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54892/0 (socket says 172.21.15.16:54892) 2023-11-28T17:40:01.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 -- 172.21.15.16:0/1574359428 learned_addr learned my addr 172.21.15.16:0/1574359428 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febab7fe640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac0cf640 0x7febac13d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febb0975640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac144c80 0x7febac0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 -- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac0cf640 msgr2=0x7febac13d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac0cf640 0x7febac13d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 -- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac144c80 msgr2=0x7febac0c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac144c80 0x7febac0c3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 -- 172.21.15.16:0/1574359428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c009420 con 0x7febac0cdf00 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febb0975640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac144c80 0x7febac0c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:01.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febabfff640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 0x7febac1f6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097f0 tx=0x7feb9c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c004220 con 0x7febac0cdf00 2023-11-28T17:40:01.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c004380 con 0x7febac0cdf00 2023-11-28T17:40:01.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c003820 con 0x7febac0cdf00 2023-11-28T17:40:01.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac13fe70 con 0x7febac0cdf00 2023-11-28T17:40:01.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febac13d640 con 0x7febac0cdf00 2023-11-28T17:40:01.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febac068860 con 0x7febac0cdf00 2023-11-28T17:40:01.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feb9c003980 con 0x7febac0cdf00 2023-11-28T17:40:01.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.807+0000 7feba8ff9640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb980668d0 0x7feb98068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:01.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.811+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb9c11dd50 con 0x7febac0cdf00 2023-11-28T17:40:01.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.811+0000 7febab7fe640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb980668d0 0x7feb98068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:01.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.811+0000 7febab7fe640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb980668d0 0x7feb98068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febac166cf0 tx=0x7feba000f5a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:01.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.811+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb9c121030 con 0x7febac0cdf00 2023-11-28T17:40:01.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.971+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febac0c5020 con 0x7febac0cdf00 2023-11-28T17:40:01.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.971+0000 7feba8ff9640 1 -- 172.21.15.16:0/1574359428 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7febac0c5020 con 0x7febac0cdf00 2023-11-28T17:40:01.976 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:01.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb980668d0 msgr2=0x7feb98068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb980668d0 0x7feb98068d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7febac166cf0 tx=0x7feba000f5a0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 msgr2=0x7febac1f6100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 0x7febac1f6100 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0097f0 tx=0x7feb9c01ac20 comp rx=0 tx=0).stop 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 shutdown_connections 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb980668d0 0x7feb98068d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7febac144c80 0x7febac0c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7febac0cf640 0x7febac13d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 --2- 172.21.15.16:0/1574359428 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7febac0cdf00 0x7febac1f6100 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 >> 172.21.15.16:0/1574359428 conn(0x7febac06a5a0 msgr2=0x7febac15af70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 shutdown_connections 2023-11-28T17:40:01.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:01.975+0000 7febb23d8640 1 -- 172.21.15.16:0/1574359428 wait complete. 2023-11-28T17:40:01.997 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:02.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.139+0000 7f370e33b640 1 Processor -- start 2023-11-28T17:40:02.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.139+0000 7f370e33b640 1 -- start start 2023-11-28T17:40:02.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370e33b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f370815d6a0 0x7f37080cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370e33b640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37080afdb0 con 0x7f370815d2c0 2023-11-28T17:40:02.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370e33b640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37080b34b0 con 0x7f37080d0130 2023-11-28T17:40:02.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370e33b640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37080d05a0 con 0x7f370815d6a0 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370d339640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f370815d2c0 0x7f37080d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36778/0 (socket says 172.21.15.16:36778) 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370d339640 1 -- 172.21.15.16:0/3136303743 learned_addr learned my addr 172.21.15.16:0/3136303743 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370cb38640 1 --2- 172.21.15.16:0/3136303743 >> v2:172.21.15.64:3300/0 conn(0x7f370815d6a0 0x7f37080cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f36fffff640 1 -- 172.21.15.16:0/3136303743 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974398703 0 0) 0x7f37080afdb0 con 0x7f370815d2c0 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f36fffff640 1 -- 172.21.15.16:0/3136303743 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f4003530 con 0x7f370815d2c0 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370cb38640 1 -- 172.21.15.16:0/3136303743 >> v1:172.21.15.64:6789/0 conn(0x7f37080d0130 legacy=0x7f37080b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370cb38640 1 -- 172.21.15.16:0/3136303743 >> v1:172.21.15.16:6789/0 conn(0x7f370815d2c0 legacy=0x7f37080d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.143+0000 7f370cb38640 1 -- 172.21.15.16:0/3136303743 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080b2b80 con 0x7f370815d6a0 2023-11-28T17:40:02.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370cb38640 1 --2- 172.21.15.16:0/3136303743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d6a0 0x7f37080cfbf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36f80097c0 tx=0x7f36f801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b38493d8bc0f808 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f36fffff640 1 -- 172.21.15.16:0/3136303743 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80ab650 con 0x7f370815d6a0 2023-11-28T17:40:02.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f36fffff640 1 -- 172.21.15.16:0/3136303743 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f80ab7b0 con 0x7f370815d6a0 2023-11-28T17:40:02.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f36fffff640 1 -- 172.21.15.16:0/3136303743 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f80abb40 con 0x7f370815d6a0 2023-11-28T17:40:02.149 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 -- 172.21.15.16:0/3136303743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d6a0 msgr2=0x7f37080cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 --2- 172.21.15.16:0/3136303743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d6a0 0x7f37080cfbf0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f36f80097c0 tx=0x7f36f801c450 comp rx=0 tx=0).stop 2023-11-28T17:40:02.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 -- 172.21.15.16:0/3136303743 shutdown_connections 2023-11-28T17:40:02.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 --2- 172.21.15.16:0/3136303743 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d6a0 0x7f37080cfbf0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 -- 172.21.15.16:0/3136303743 >> 172.21.15.16:0/3136303743 conn(0x7f370809c550 msgr2=0x7f37080d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:02.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 -- 172.21.15.16:0/3136303743 shutdown_connections 2023-11-28T17:40:02.150 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 -- 172.21.15.16:0/3136303743 wait complete. 2023-11-28T17:40:02.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 Processor -- start 2023-11-28T17:40:02.151 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.147+0000 7f370e33b640 1 -- start start 2023-11-28T17:40:02.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 0x7f3708154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d2c0 0x7f3708157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f370815d6a0 0x7f3708158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3708158590 con 0x7f37080d0130 2023-11-28T17:40:02.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37081587c0 con 0x7f370815d2c0 2023-11-28T17:40:02.153 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3708158aa0 con 0x7f370815d6a0 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 0x7f3708154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 0x7f3708154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54900/0 (socket says 172.21.15.16:54900) 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 -- 172.21.15.16:0/447927298 learned_addr learned my addr 172.21.15.16:0/447927298 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370cb38640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d2c0 0x7f3708157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370db3a640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f370815d6a0 0x7f3708158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 -- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f370815d6a0 msgr2=0x7f3708158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f370815d6a0 0x7f3708158050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 -- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d2c0 msgr2=0x7f3708157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d2c0 0x7f3708157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 -- 172.21.15.16:0/447927298 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009420 con 0x7f37080d0130 2023-11-28T17:40:02.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370d339640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 0x7f3708154f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f370400c4d0 tx=0x7f370400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704005cf0 con 0x7f37080d0130 2023-11-28T17:40:02.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3704005e50 con 0x7f37080d0130 2023-11-28T17:40:02.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3708158d80 con 0x7f37080d0130 2023-11-28T17:40:02.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3704007270 con 0x7f37080d0130 2023-11-28T17:40:02.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3708155450 con 0x7f37080d0130 2023-11-28T17:40:02.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370804e890 con 0x7f37080d0130 2023-11-28T17:40:02.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.151+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f37040073d0 con 0x7f37080d0130 2023-11-28T17:40:02.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.155+0000 7f36fdffb640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f36ec0668d0 0x7f36ec068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.155+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3704083900 con 0x7f37080d0130 2023-11-28T17:40:02.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.155+0000 7f370cb38640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f36ec0668d0 0x7f36ec068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.155+0000 7f370cb38640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f36ec0668d0 0x7f36ec068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f36f80af000 tx=0x7f36f80b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.159+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3704050be0 con 0x7f37080d0130 2023-11-28T17:40:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.311+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37080b5070 con 0x7f37080d0130 2023-11-28T17:40:02.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f36fdffb640 1 -- 172.21.15.16:0/447927298 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37040170a0 con 0x7f37080d0130 2023-11-28T17:40:02.317 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:02.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f36ec0668d0 msgr2=0x7f36ec068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f36ec0668d0 0x7f36ec068d90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f36f80af000 tx=0x7f36f80b6040 comp rx=0 tx=0).stop 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 msgr2=0x7f3708154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 0x7f3708154f10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f370400c4d0 tx=0x7f370400c990 comp rx=0 tx=0).stop 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 shutdown_connections 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f370815d6a0 0x7f3708158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f36ec0668d0 0x7f36ec068d90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f370815d2c0 0x7f3708157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 --2- 172.21.15.16:0/447927298 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f37080d0130 0x7f3708154f10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 >> 172.21.15.16:0/447927298 conn(0x7f370809c550 msgr2=0x7f370815c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:02.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 shutdown_connections 2023-11-28T17:40:02.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.315+0000 7f370e33b640 1 -- 172.21.15.16:0/447927298 wait complete. 2023-11-28T17:40:02.337 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:02.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 Processor -- start 2023-11-28T17:40:02.485 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 -- start start 2023-11-28T17:40:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa48415d540 0x7fa4840b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.486 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 0x7fa4840cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4840b32c0 con 0x7fa4840d1f50 2023-11-28T17:40:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa48415d920 con 0x7fa48415d540 2023-11-28T17:40:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48ba79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4840b35a0 con 0x7fa4840d3690 2023-11-28T17:40:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 0x7fa4840cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa489815640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa48415d540 0x7fa4840b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 0x7fa4840cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:38524/0 (socket says 172.21.15.16:38524) 2023-11-28T17:40:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa489815640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa48415d540 0x7fa4840b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:52894/0 (socket says 172.21.15.16:52894) 2023-11-28T17:40:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa489014640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fa4840d1f50 0x7fa4840d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:44192/0 (socket says 172.21.15.16:44192) 2023-11-28T17:40:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 -- 172.21.15.16:0/4021489715 learned_addr learned my addr 172.21.15.16:0/4021489715 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:02.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 -- 172.21.15.16:0/4021489715 >> v2:172.21.15.64:3300/0 conn(0x7fa48415d540 msgr2=0x7fa4840b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 --2- 172.21.15.16:0/4021489715 >> v2:172.21.15.64:3300/0 conn(0x7fa48415d540 0x7fa4840b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 -- 172.21.15.16:0/4021489715 >> v1:172.21.15.64:6789/0 conn(0x7fa4840d1f50 legacy=0x7fa4840d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.489 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.483+0000 7fa48a016640 1 -- 172.21.15.16:0/4021489715 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4840b3880 con 0x7fa4840d3690 2023-11-28T17:40:02.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48a016640 1 --2- 172.21.15.16:0/4021489715 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 0x7fa4840cdde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009e50 tx=0x7fa47c01c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60fc87cd427ed3fc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa488813640 1 -- 172.21.15.16:0/4021489715 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0a58a0 con 0x7fa4840d3690 2023-11-28T17:40:02.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa488813640 1 -- 172.21.15.16:0/4021489715 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0a5a00 con 0x7fa4840d3690 2023-11-28T17:40:02.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa488813640 1 -- 172.21.15.16:0/4021489715 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0a5d90 con 0x7fa4840d3690 2023-11-28T17:40:02.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 -- 172.21.15.16:0/4021489715 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 msgr2=0x7fa4840cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 --2- 172.21.15.16:0/4021489715 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 0x7fa4840cdde0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa47c009e50 tx=0x7fa47c01c9e0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 -- 172.21.15.16:0/4021489715 shutdown_connections 2023-11-28T17:40:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 --2- 172.21.15.16:0/4021489715 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d3690 0x7fa4840cdde0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 --2- 172.21.15.16:0/4021489715 >> v2:172.21.15.64:3300/0 conn(0x7fa48415d540 0x7fa4840b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 -- 172.21.15.16:0/4021489715 >> 172.21.15.16:0/4021489715 conn(0x7fa48408ccf0 msgr2=0x7fa48409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 -- 172.21.15.16:0/4021489715 shutdown_connections 2023-11-28T17:40:02.492 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.487+0000 7fa48ba79640 1 -- 172.21.15.16:0/4021489715 wait complete. 2023-11-28T17:40:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 Processor -- start 2023-11-28T17:40:02.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 -- start start 2023-11-28T17:40:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d1f50 0x7fa484152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4840d3690 0x7fa484159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 0x7fa484159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841550d0 con 0x7fa48415d540 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4841553b0 con 0x7fa4840d3690 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa484155690 con 0x7fa4840d1f50 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 0x7fa484159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 0x7fa484159b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54904/0 (socket says 172.21.15.16:54904) 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 -- 172.21.15.16:0/3210335169 learned_addr learned my addr 172.21.15.16:0/3210335169 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa489014640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4840d3690 0x7fa484159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa489815640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d1f50 0x7fa484152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 -- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d1f50 msgr2=0x7fa484152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.495 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d1f50 0x7fa484152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 -- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4840d3690 msgr2=0x7fa484159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4840d3690 0x7fa484159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 -- 172.21.15.16:0/3210335169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa47c009b30 con 0x7fa48415d540 2023-11-28T17:40:02.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48a016640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 0x7fa484159b40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0af040 tx=0x7fa47c019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0b8670 con 0x7fa48415d540 2023-11-28T17:40:02.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47c0b87d0 con 0x7fa48415d540 2023-11-28T17:40:02.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47c0b8b80 con 0x7fa48415d540 2023-11-28T17:40:02.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa484155970 con 0x7fa48415d540 2023-11-28T17:40:02.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.491+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4841531c0 con 0x7fa48415d540 2023-11-28T17:40:02.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.495+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa484068860 con 0x7fa48415d540 2023-11-28T17:40:02.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.495+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa47c0b8ce0 con 0x7fa48415d540 2023-11-28T17:40:02.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.495+0000 7fa47a7fc640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa4680668d0 0x7fa468068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.495+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa47c11fba0 con 0x7fa48415d540 2023-11-28T17:40:02.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.495+0000 7fa489815640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa4680668d0 0x7fa468068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.495+0000 7fa489815640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa4680668d0 0x7fa468068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa480009ac0 tx=0x7fa480009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.499+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa47c0ecf10 con 0x7fa48415d540 2023-11-28T17:40:02.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.655+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa484155e20 con 0x7fa48415d540 2023-11-28T17:40:02.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.655+0000 7fa47a7fc640 1 -- 172.21.15.16:0/3210335169 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa47c0f0530 con 0x7fa48415d540 2023-11-28T17:40:02.660 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:02.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa4680668d0 msgr2=0x7fa468068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa4680668d0 0x7fa468068d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa480009ac0 tx=0x7fa480009190 comp rx=0 tx=0).stop 2023-11-28T17:40:02.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 msgr2=0x7fa484159b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 0x7fa484159b40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa47c0af040 tx=0x7fa47c019780 comp rx=0 tx=0).stop 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 shutdown_connections 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa48415d540 0x7fa484159b40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa4680668d0 0x7fa468068d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4840d3690 0x7fa484159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 --2- 172.21.15.16:0/3210335169 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa4840d1f50 0x7fa484152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 >> 172.21.15.16:0/3210335169 conn(0x7fa48408ccf0 msgr2=0x7fa4840b41b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 shutdown_connections 2023-11-28T17:40:02.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.659+0000 7fa48ba79640 1 -- 172.21.15.16:0/3210335169 wait complete. 2023-11-28T17:40:02.694 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-28T17:40:02.695 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:02.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 Processor -- start 2023-11-28T17:40:02.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 -- start start 2023-11-28T17:40:02.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2a1c0cef30 0x7f2a1c0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c070dd0 0x7f2a1c071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c0ce4f0 con 0x7f2a1c144c80 2023-11-28T17:40:02.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a1c0709b0 con 0x7f2a1c0cef30 2023-11-28T17:40:02.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.835+0000 7f2a209f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c145060 con 0x7f2a1c070dd0 2023-11-28T17:40:02.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1ad9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c070dd0 0x7f2a1c071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1a59c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2a1c144c80 0x7f2a1c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:44204/0 (socket says 172.21.15.16:44204) 2023-11-28T17:40:02.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a13fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2a1c0cef30 0x7f2a1c0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1a59c640 1 -- 172.21.15.16:0/1560308183 learned_addr learned my addr 172.21.15.16:0/1560308183 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:02.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a19d9b640 1 -- 172.21.15.16:0/1560308183 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304514625 0 0) 0x7f2a1c0ce4f0 con 0x7f2a1c144c80 2023-11-28T17:40:02.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a19d9b640 1 -- 172.21.15.16:0/1560308183 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a08003530 con 0x7f2a1c144c80 2023-11-28T17:40:02.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1ad9d640 1 -- 172.21.15.16:0/1560308183 >> v2:172.21.15.64:3300/0 conn(0x7f2a1c0cef30 msgr2=0x7f2a1c0cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:02.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1ad9d640 1 --2- 172.21.15.16:0/1560308183 >> v2:172.21.15.64:3300/0 conn(0x7f2a1c0cef30 0x7f2a1c0cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1ad9d640 1 -- 172.21.15.16:0/1560308183 >> v1:172.21.15.64:6789/0 conn(0x7f2a1c144c80 legacy=0x7f2a1c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a1ad9d640 1 -- 172.21.15.16:0/1560308183 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c0ce7d0 con 0x7f2a1c070dd0 2023-11-28T17:40:02.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.839+0000 7f2a13fff640 1 --2- 172.21.15.16:0/1560308183 >> v2:172.21.15.64:3300/0 conn(0x7f2a1c0cef30 0x7f2a1c0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:02.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a1ad9d640 1 --2- 172.21.15.16:0/1560308183 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c070dd0 0x7f2a1c071260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009d90 tx=0x7f2a1401c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=347352702c85dd79 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a19d9b640 1 -- 172.21.15.16:0/1560308183 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140a5740 con 0x7f2a1c070dd0 2023-11-28T17:40:02.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a19d9b640 1 -- 172.21.15.16:0/1560308183 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a140a58a0 con 0x7f2a1c070dd0 2023-11-28T17:40:02.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a19d9b640 1 -- 172.21.15.16:0/1560308183 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140a5c30 con 0x7f2a1c070dd0 2023-11-28T17:40:02.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- 172.21.15.16:0/1560308183 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c070dd0 msgr2=0x7f2a1c071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1560308183 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c070dd0 0x7f2a1c071260 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009d90 tx=0x7f2a1401c770 comp rx=0 tx=0).stop 2023-11-28T17:40:02.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- 172.21.15.16:0/1560308183 shutdown_connections 2023-11-28T17:40:02.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1560308183 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c070dd0 0x7f2a1c071260 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1560308183 >> v2:172.21.15.64:3300/0 conn(0x7f2a1c0cef30 0x7f2a1c0cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- 172.21.15.16:0/1560308183 >> 172.21.15.16:0/1560308183 conn(0x7f2a1c06a5a0 msgr2=0x7f2a1c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:02.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- 172.21.15.16:0/1560308183 shutdown_connections 2023-11-28T17:40:02.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- 172.21.15.16:0/1560308183 wait complete. 2023-11-28T17:40:02.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 Processor -- start 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- start start 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 0x7f2a1c141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c0cef30 0x7f2a1c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a1c144c80 0x7f2a1c1f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c1424c0 con 0x7f2a1c070dd0 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c1427a0 con 0x7f2a1c144c80 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.843+0000 7f2a209f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c142a80 con 0x7f2a1c0cef30 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 0x7f2a1c141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 0x7f2a1c141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54916/0 (socket says 172.21.15.16:54916) 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 -- 172.21.15.16:0/1730077113 learned_addr learned my addr 172.21.15.16:0/1730077113 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1ad9d640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a1c144c80 0x7f2a1c1f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a13fff640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c0cef30 0x7f2a1c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 -- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c0cef30 msgr2=0x7f2a1c158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c0cef30 0x7f2a1c158c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 -- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a1c144c80 msgr2=0x7f2a1c1f9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a1c144c80 0x7f2a1c1f9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:02.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 -- 172.21.15.16:0/1730077113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a04009420 con 0x7f2a1c070dd0 2023-11-28T17:40:02.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a1a59c640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 0x7f2a1c141bc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00c4d0 tx=0x7f2a0c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c005cf0 con 0x7f2a1c070dd0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a0c005e50 con 0x7f2a1c070dd0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c007270 con 0x7f2a1c070dd0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a14009a70 con 0x7f2a1c070dd0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c143040 con 0x7f2a1c070dd0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1c143230 con 0x7f2a1c070dd0 2023-11-28T17:40:02.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.847+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2a0c0073d0 con 0x7f2a1c070dd0 2023-11-28T17:40:02.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.851+0000 7f2a12ffd640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f29fc0668d0 0x7f29fc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:02.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.851+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a0c083990 con 0x7f2a1c070dd0 2023-11-28T17:40:02.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.851+0000 7f2a13fff640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f29fc0668d0 0x7f29fc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:02.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.851+0000 7f2a13fff640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f29fc0668d0 0x7f29fc068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c072840 tx=0x7f2a04009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:02.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:02.855+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a0c050be0 con 0x7f2a1c070dd0 2023-11-28T17:40:03.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.011+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a1c068860 con 0x7f2a1c070dd0 2023-11-28T17:40:03.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a12ffd640 1 -- 172.21.15.16:0/1730077113 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f2a0c017020 con 0x7f2a1c070dd0 2023-11-28T17:40:03.017 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:03.018 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:03.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f29fc0668d0 msgr2=0x7f29fc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f29fc0668d0 0x7f29fc068d90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c072840 tx=0x7f2a04009190 comp rx=0 tx=0).stop 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 msgr2=0x7f2a1c141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 0x7f2a1c141bc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00c4d0 tx=0x7f2a0c00c990 comp rx=0 tx=0).stop 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 shutdown_connections 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f29fc0668d0 0x7f29fc068d90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a1c144c80 0x7f2a1c1f9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2a1c0cef30 0x7f2a1c158c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 --2- 172.21.15.16:0/1730077113 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2a1c070dd0 0x7f2a1c141bc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 >> 172.21.15.16:0/1730077113 conn(0x7f2a1c06a5a0 msgr2=0x7f2a1c15bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:03.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 shutdown_connections 2023-11-28T17:40:03.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.015+0000 7f2a209f8640 1 -- 172.21.15.16:0/1730077113 wait complete. 2023-11-28T17:40:03.039 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:03.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:03.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f53017e6640 1 Processor -- start 2023-11-28T17:40:03.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f53017e6640 1 -- start start 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f53017e6640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52fc06e880 0x7f52fc06ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f53017e6640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc06f210 con 0x7f52fc06d300 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f53017e6640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc0cee20 con 0x7f52fc15d620 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f53017e6640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0cf100 con 0x7f52fc06e880 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52f3fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f52fc06d300 0x7f52fc161a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36788/0 (socket says 172.21.15.16:36788) 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52f3fff640 1 -- 172.21.15.16:0/2447501145 learned_addr learned my addr 172.21.15.16:0/2447501145 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:03.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fb7fe640 1 --2- 172.21.15.16:0/2447501145 >> v2:172.21.15.16:3300/0 conn(0x7f52fc06e880 0x7f52fc06ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989436657 0 0) 0x7f52e4001120 con 0x7f52fc06d300 2023-11-28T17:40:03.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8003530 con 0x7f52fc06d300 2023-11-28T17:40:03.188 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872992320 0 0) 0x7f52fc0cee20 con 0x7f52fc15d620 2023-11-28T17:40:03.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e4001120 con 0x7f52fc15d620 2023-11-28T17:40:03.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fb7fe640 1 -- 172.21.15.16:0/2447501145 >> v1:172.21.15.64:6789/0 conn(0x7f52fc15d620 legacy=0x7f52fc0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fb7fe640 1 -- 172.21.15.16:0/2447501145 >> v1:172.21.15.16:6789/0 conn(0x7f52fc06d300 legacy=0x7f52fc161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.189 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.183+0000 7f52fb7fe640 1 -- 172.21.15.16:0/2447501145 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0cf3e0 con 0x7f52fc06e880 2023-11-28T17:40:03.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f52fb7fe640 1 --2- 172.21.15.16:0/2447501145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06e880 0x7f52fc06ecd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009dc0 tx=0x7f52f401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba22528f5e6efa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40a59e0 con 0x7f52fc06e880 2023-11-28T17:40:03.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f40a5b40 con 0x7f52fc06e880 2023-11-28T17:40:03.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f52fa7fc640 1 -- 172.21.15.16:0/2447501145 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40ad440 con 0x7f52fc06e880 2023-11-28T17:40:03.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 -- 172.21.15.16:0/2447501145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06e880 msgr2=0x7f52fc06ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 --2- 172.21.15.16:0/2447501145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06e880 0x7f52fc06ecd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009dc0 tx=0x7f52f401c900 comp rx=0 tx=0).stop 2023-11-28T17:40:03.191 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 -- 172.21.15.16:0/2447501145 shutdown_connections 2023-11-28T17:40:03.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 --2- 172.21.15.16:0/2447501145 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06e880 0x7f52fc06ecd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 -- 172.21.15.16:0/2447501145 >> 172.21.15.16:0/2447501145 conn(0x7f52fc06a5a0 msgr2=0x7f52fc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:03.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 -- 172.21.15.16:0/2447501145 shutdown_connections 2023-11-28T17:40:03.192 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.187+0000 7f53017e6640 1 -- 172.21.15.16:0/2447501145 wait complete. 2023-11-28T17:40:03.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 Processor -- start 2023-11-28T17:40:03.193 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- start start 2023-11-28T17:40:03.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 0x7f52fc14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc06e880 0x7f52fc15da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52fc15d620 0x7f52fc14b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc151f00 con 0x7f52fc06d300 2023-11-28T17:40:03.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1512f0 con 0x7f52fc06e880 2023-11-28T17:40:03.195 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1515d0 con 0x7f52fc15d620 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 0x7f52fc14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 0x7f52fc14e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54938/0 (socket says 172.21.15.16:54938) 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 -- 172.21.15.16:0/1517853915 learned_addr learned my addr 172.21.15.16:0/1517853915 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52f3fff640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc06e880 0x7f52fc15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52fb7fe640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52fc15d620 0x7f52fc14b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 -- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52fc15d620 msgr2=0x7f52fc14b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52fc15d620 0x7f52fc14b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 -- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc06e880 msgr2=0x7f52fc15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc06e880 0x7f52fc15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 -- 172.21.15.16:0/1517853915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f4009a70 con 0x7f52fc06d300 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52faffd640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 0x7f52fc14e630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c430 tx=0x7f52ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.196 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec0052d0 con 0x7f52fc06d300 2023-11-28T17:40:03.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ec005450 con 0x7f52fc06d300 2023-11-28T17:40:03.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ec003840 con 0x7f52fc06d300 2023-11-28T17:40:03.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc1518b0 con 0x7f52fc06d300 2023-11-28T17:40:03.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc15df40 con 0x7f52fc06d300 2023-11-28T17:40:03.197 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.191+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc068860 con 0x7f52fc06d300 2023-11-28T17:40:03.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.195+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f52ec0039a0 con 0x7f52fc06d300 2023-11-28T17:40:03.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.195+0000 7f52f37fe640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52dc0668d0 0x7f52dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.195+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52ec083a80 con 0x7f52fc06d300 2023-11-28T17:40:03.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.195+0000 7f52f3fff640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52dc0668d0 0x7f52dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.199 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.195+0000 7f52f3fff640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52dc0668d0 0x7f52dc068d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52fc160dc0 tx=0x7f52e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.201 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.199+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52ec050cb0 con 0x7f52fc06d300 2023-11-28T17:40:03.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.355+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52fc0ce3f0 con 0x7f52fc06d300 2023-11-28T17:40:03.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.355+0000 7f52f37fe640 1 -- 172.21.15.16:0/1517853915 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52ec0170a0 con 0x7f52fc06d300 2023-11-28T17:40:03.358 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:03.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.355+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52dc0668d0 msgr2=0x7f52dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.355+0000 7f53017e6640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52dc0668d0 0x7f52dc068d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f52fc160dc0 tx=0x7f52e4009040 comp rx=0 tx=0).stop 2023-11-28T17:40:03.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.355+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 msgr2=0x7f52fc14e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.355+0000 7f53017e6640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 0x7f52fc14e630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00c430 tx=0x7f52ec00c8f0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 shutdown_connections 2023-11-28T17:40:03.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52fc15d620 0x7f52fc14b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52dc0668d0 0x7f52dc068d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc06e880 0x7f52fc15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 --2- 172.21.15.16:0/1517853915 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52fc06d300 0x7f52fc14e630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 >> 172.21.15.16:0/1517853915 conn(0x7f52fc06a5a0 msgr2=0x7f52fc06b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:03.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 shutdown_connections 2023-11-28T17:40:03.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.359+0000 7f53017e6640 1 -- 172.21.15.16:0/1517853915 wait complete. 2023-11-28T17:40:03.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:03.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa33a5b8640 1 Processor -- start 2023-11-28T17:40:03.529 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa33a5b8640 1 -- start start 2023-11-28T17:40:03.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa33a5b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa3340cf640 0x7fa334164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.530 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa33a5b8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33415a8b0 con 0x7fa334072090 2023-11-28T17:40:03.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa33a5b8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340cea50 con 0x7fa3341548e0 2023-11-28T17:40:03.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa33a5b8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3340ce860 con 0x7fa3340cf640 2023-11-28T17:40:03.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa3337fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa334072090 0x7fa3340cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36790/0 (socket says 172.21.15.16:36790) 2023-11-28T17:40:03.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa3337fe640 1 -- 172.21.15.16:0/641599983 learned_addr learned my addr 172.21.15.16:0/641599983 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:03.531 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676548677 0 0) 0x7fa33415a8b0 con 0x7fa334072090 2023-11-28T17:40:03.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa338b55640 1 --2- 172.21.15.16:0/641599983 >> v2:172.21.15.64:3300/0 conn(0x7fa3340cf640 0x7fa334164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.532 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa31c003530 con 0x7fa334072090 2023-11-28T17:40:03.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2858592417 0 0) 0x7fa31c003530 con 0x7fa334072090 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 >> v2:172.21.15.64:3300/0 conn(0x7fa3340cf640 msgr2=0x7fa334164cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 --2- 172.21.15.16:0/641599983 >> v2:172.21.15.64:3300/0 conn(0x7fa3340cf640 0x7fa334164cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 >> v1:172.21.15.64:6789/0 conn(0x7fa3341548e0 legacy=0x7fa3340ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33415ab50 con 0x7fa334072090 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7fa328001680 con 0x7fa334072090 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 >> v1:172.21.15.16:6789/0 conn(0x7fa334072090 legacy=0x7fa3340cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa31c003980 0x7fa31c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c0047d0 0x7fa31c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa31c005190 0x7fa31c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c00e210 con 0x7fa31c003980 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c00e380 con 0x7fa31c005190 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa31c00e540 con 0x7fa31c0047d0 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa333fff640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa31c003980 0x7fa31c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa338b55640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa31c005190 0x7fa31c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa3337fe640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c0047d0 0x7fa31c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa333fff640 1 -- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c0047d0 msgr2=0x7fa31c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa333fff640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c0047d0 0x7fa31c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.536 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa333fff640 1 -- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa31c005190 msgr2=0x7fa31c00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa333fff640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa31c005190 0x7fa31c00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa333fff640 1 -- 172.21.15.16:0/641599983 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa31c003530 con 0x7fa31c003980 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.527+0000 7fa338b55640 1 -- 172.21.15.16:0/641599983 reap_dead start 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa333fff640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa31c003980 0x7fa31c003da0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa324001780 tx=0x7fa32401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5362ea7f3898637d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3240052d0 con 0x7fa31c003980 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3240a7050 con 0x7fa31c003980 2023-11-28T17:40:03.537 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa332ffd640 1 -- 172.21.15.16:0/641599983 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa324003600 con 0x7fa31c003980 2023-11-28T17:40:03.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 -- 172.21.15.16:0/641599983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa31c003980 msgr2=0x7fa31c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa31c003980 0x7fa31c003da0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa324001780 tx=0x7fa32401c3e0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 -- 172.21.15.16:0/641599983 shutdown_connections 2023-11-28T17:40:03.540 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/641599983 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa31c003980 0x7fa31c003da0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 -- 172.21.15.16:0/641599983 >> 172.21.15.16:0/641599983 conn(0x7fa33406a5a0 msgr2=0x7fa33406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 -- 172.21.15.16:0/641599983 shutdown_connections 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.531+0000 7fa33a5b8640 1 -- 172.21.15.16:0/641599983 wait complete. 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 Processor -- start 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 -- start start 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c003980 0x7fa3341f9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3341fa040 0x7fa3340aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 0x7fa3340af1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340afad0 con 0x7fa334142f40 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33414d8b0 con 0x7fa3341fa040 2023-11-28T17:40:03.541 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa334148500 con 0x7fa31c003980 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 0x7fa3340af1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 0x7fa3340af1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54960/0 (socket says 172.21.15.16:54960) 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 -- 172.21.15.16:0/2307675071 learned_addr learned my addr 172.21.15.16:0/2307675071 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa3337fe640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3341fa040 0x7fa3340aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa333fff640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c003980 0x7fa3341f9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 -- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c003980 msgr2=0x7fa3341f9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c003980 0x7fa3341f9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.542 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 -- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3341fa040 msgr2=0x7fa3340aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3341fa040 0x7fa3340aec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 -- 172.21.15.16:0/2307675071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340af7f0 con 0x7fa334142f40 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa333fff640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c003980 0x7fa3341f9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa338b55640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 0x7fa3340af1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3340cc200 tx=0x7fa32c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00e040 con 0x7fa334142f40 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c00f040 con 0x7fa334142f40 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa334142480 con 0x7fa334142f40 2023-11-28T17:40:03.543 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00fe30 con 0x7fa334142f40 2023-11-28T17:40:03.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.535+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa334142a40 con 0x7fa334142f40 2023-11-28T17:40:03.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.539+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa334068860 con 0x7fa334142f40 2023-11-28T17:40:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.539+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa32c015430 con 0x7fa334142f40 2023-11-28T17:40:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.539+0000 7fa330ff9640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa3200668d0 0x7fa320068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.539+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa32c085360 con 0x7fa334142f40 2023-11-28T17:40:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.539+0000 7fa333fff640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa3200668d0 0x7fa320068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.539+0000 7fa333fff640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa3200668d0 0x7fa320068d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa324001750 tx=0x7fa3240011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.543+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa32c052610 con 0x7fa334142f40 2023-11-28T17:40:03.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.699+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3340710c0 con 0x7fa334142f40 2023-11-28T17:40:03.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.699+0000 7fa330ff9640 1 -- 172.21.15.16:0/2307675071 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa32c055c30 con 0x7fa334142f40 2023-11-28T17:40:03.704 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:03.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa3200668d0 msgr2=0x7fa320068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa3200668d0 0x7fa320068d90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa324001750 tx=0x7fa3240011a0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 msgr2=0x7fa3340af1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 0x7fa3340af1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3340cc200 tx=0x7fa32c011f10 comp rx=0 tx=0).stop 2023-11-28T17:40:03.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 shutdown_connections 2023-11-28T17:40:03.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa334142f40 0x7fa3340af1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa3200668d0 0x7fa320068d90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3341fa040 0x7fa3340aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 --2- 172.21.15.16:0/2307675071 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa31c003980 0x7fa3341f9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 >> 172.21.15.16:0/2307675071 conn(0x7fa33406a5a0 msgr2=0x7fa3340b2370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:03.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 shutdown_connections 2023-11-28T17:40:03.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.703+0000 7fa33a5b8640 1 -- 172.21.15.16:0/2307675071 wait complete. 2023-11-28T17:40:03.725 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:03.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.867+0000 7feeed6d6640 1 Processor -- start 2023-11-28T17:40:03.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.867+0000 7feeed6d6640 1 -- start start 2023-11-28T17:40:03.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feeed6d6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feee80cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feeed6d6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7feee806d300 0x7feee8161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feeed6d6640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80cbcd0 con 0x7feee806e880 2023-11-28T17:40:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feeed6d6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee8161f70 con 0x7feee806d300 2023-11-28T17:40:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feeed6d6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80cee20 con 0x7feee815d620 2023-11-28T17:40:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee77fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feee806e880 0x7feee80d1330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36804/0 (socket says 172.21.15.16:36804) 2023-11-28T17:40:03.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee77fe640 1 -- 172.21.15.16:0/1634295505 learned_addr learned my addr 172.21.15.16:0/1634295505 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:03.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feee80cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feedffff640 1 --2- 172.21.15.16:0/1634295505 >> v2:172.21.15.64:3300/0 conn(0x7feee806d300 0x7feee8161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602459095 0 0) 0x7feee80cbcd0 con 0x7feee806e880 2023-11-28T17:40:03.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed4003530 con 0x7feee806e880 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3123336919 0 0) 0x7feed4003530 con 0x7feee806e880 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 msgr2=0x7feee80cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feee80cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 >> v2:172.21.15.64:3300/0 conn(0x7feee806d300 msgr2=0x7feee8161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 --2- 172.21.15.16:0/1634295505 >> v2:172.21.15.64:3300/0 conn(0x7feee806d300 0x7feee8161a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee80cf100 con 0x7feee806e880 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7feee0001a00 con 0x7feee806e880 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feee80cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 >> v1:172.21.15.16:6789/0 conn(0x7feee806e880 legacy=0x7feee80d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feed4003980 0x7feed4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed40047d0 0x7feed4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feed4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8161f70 con 0x7feed4003980 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80cee20 con 0x7feed40047d0 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed400b990 con 0x7feee815d620 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feedffff640 1 --2- 172.21.15.16:0/1634295505 >> v2:172.21.15.64:3300/0 conn(0x7feee806d300 0x7feee8161a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feed4003980 0x7feed4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee77fe640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feed4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feedffff640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed40047d0 0x7feed4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 -- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 msgr2=0x7feed4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815d620 0x7feed4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 -- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed40047d0 msgr2=0x7feed4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed40047d0 0x7feed4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.877 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.871+0000 7feee6ffd640 1 -- 172.21.15.16:0/1634295505 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed8009420 con 0x7feed4003980 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feee6ffd640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feed4003980 0x7feed4003da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feed8009cb0 tx=0x7feed801cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa679c4066ebff22 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80a5690 con 0x7feed4003980 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed80a57f0 con 0x7feed4003980 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feee67fc640 1 -- 172.21.15.16:0/1634295505 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80a5ba0 con 0x7feed4003980 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 -- 172.21.15.16:0/1634295505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feed4003980 msgr2=0x7feed4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 --2- 172.21.15.16:0/1634295505 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feed4003980 0x7feed4003da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7feed8009cb0 tx=0x7feed801cbc0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feee77fe640 1 -- 172.21.15.16:0/1634295505 reap_dead start 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 -- 172.21.15.16:0/1634295505 shutdown_connections 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 -- 172.21.15.16:0/1634295505 >> 172.21.15.16:0/1634295505 conn(0x7feee806a5a0 msgr2=0x7feee806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:03.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 -- 172.21.15.16:0/1634295505 shutdown_connections 2023-11-28T17:40:03.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 -- 172.21.15.16:0/1634295505 wait complete. 2023-11-28T17:40:03.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 Processor -- start 2023-11-28T17:40:03.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.875+0000 7feeed6d6640 1 -- start start 2023-11-28T17:40:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed4003980 0x7feee8160b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 0x7feee81660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815b220 0x7feee815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee815bbe0 con 0x7feee81587d0 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8164460 con 0x7feed4003980 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee81646d0 con 0x7feee815b220 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 0x7feee81660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 0x7feee81660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54990/0 (socket says 172.21.15.16:54990) 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 -- 172.21.15.16:0/2852249736 learned_addr learned my addr 172.21.15.16:0/2852249736 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feee6ffd640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed4003980 0x7feee8160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feee77fe640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815b220 0x7feee815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 -- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815b220 msgr2=0x7feee815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815b220 0x7feee815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 -- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed4003980 msgr2=0x7feee8160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed4003980 0x7feee8160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 -- 172.21.15.16:0/2852249736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee81649b0 con 0x7feee81587d0 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedffff640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 0x7feee81660b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feed0011cd0 tx=0x7feed000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0011d00 con 0x7feee81587d0 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0011e60 con 0x7feee81587d0 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0004270 con 0x7feee81587d0 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8164c90 con 0x7feee81587d0 2023-11-28T17:40:03.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee8161190 con 0x7feee81587d0 2023-11-28T17:40:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.879+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee8068860 con 0x7feee81587d0 2023-11-28T17:40:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.883+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feed00043d0 con 0x7feee81587d0 2023-11-28T17:40:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.883+0000 7feedf7fe640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feec8066900 0x7feec8068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.883+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feed0084970 con 0x7feee81587d0 2023-11-28T17:40:03.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.883+0000 7feee6ffd640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feec8066900 0x7feec8068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:03.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.883+0000 7feee6ffd640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feec8066900 0x7feec8068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed80af000 tx=0x7feed80046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:03.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:03.887+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feed0051c50 con 0x7feee81587d0 2023-11-28T17:40:04.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feee80ce3f0 con 0x7feee81587d0 2023-11-28T17:40:04.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feedf7fe640 1 -- 172.21.15.16:0/2852249736 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7feed0022070 con 0x7feee81587d0 2023-11-28T17:40:04.045 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feec8066900 msgr2=0x7feec8068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feec8066900 0x7feec8068dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feed80af000 tx=0x7feed80046d0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 msgr2=0x7feee81660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 0x7feee81660b0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7feed0011cd0 tx=0x7feed000f610 comp rx=0 tx=0).stop 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 shutdown_connections 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feee815b220 0x7feee815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feee81587d0 0x7feee81660b0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feec8066900 0x7feec8068dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 --2- 172.21.15.16:0/2852249736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feed4003980 0x7feee8160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 >> 172.21.15.16:0/2852249736 conn(0x7feee806a5a0 msgr2=0x7feee80c8680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:04.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 shutdown_connections 2023-11-28T17:40:04.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.043+0000 7feeed6d6640 1 -- 172.21.15.16:0/2852249736 wait complete. 2023-11-28T17:40:04.067 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-28T17:40:04.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:40:04.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:40:04.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.207+0000 7fa912180640 1 Processor -- start 2023-11-28T17:40:04.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.207+0000 7fa912180640 1 -- start start 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.207+0000 7fa912180640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c1548e0 0x7fa90c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.207+0000 7fa912180640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa90c072090 0x7fa90c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.207+0000 7fa912180640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa90c15a8b0 con 0x7fa90c15b350 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa912180640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa90c15a6a0 con 0x7fa90c072090 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa912180640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c0ced30 con 0x7fa90c1548e0 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa90c072090 0x7fa90c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fa90c072090 0x7fa90c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:54992/0 (socket says 172.21.15.16:54992) 2023-11-28T17:40:04.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 -- 172.21.15.16:0/1540036073 learned_addr learned my addr 172.21.15.16:0/1540036073 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:04.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90b7fe640 1 --2- 172.21.15.16:0/1540036073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c1548e0 0x7fa90c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 -- 172.21.15.16:0/1540036073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c1548e0 msgr2=0x7fa90c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:04.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 --2- 172.21.15.16:0/1540036073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c1548e0 0x7fa90c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 -- 172.21.15.16:0/1540036073 >> v1:172.21.15.64:6789/0 conn(0x7fa90c15b350 legacy=0x7fa90c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 -- 172.21.15.16:0/1540036073 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0cea50 con 0x7fa90c072090 2023-11-28T17:40:04.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90affd640 1 --2- 172.21.15.16:0/1540036073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c0cef30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa900009870 tx=0x7fa90001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f3a7cb758598e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:04.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90a7fc640 1 -- 172.21.15.16:0/1540036073 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000ab600 con 0x7fa90c072090 2023-11-28T17:40:04.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90a7fc640 1 -- 172.21.15.16:0/1540036073 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9000a7050 con 0x7fa90c072090 2023-11-28T17:40:04.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.211+0000 7fa90a7fc640 1 -- 172.21.15.16:0/1540036073 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9000ab980 con 0x7fa90c072090 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- 172.21.15.16:0/1540036073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 msgr2=0x7fa90c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 --2- 172.21.15.16:0/1540036073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c0cef30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa900009870 tx=0x7fa90001c540 comp rx=0 tx=0).stop 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- 172.21.15.16:0/1540036073 shutdown_connections 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 --2- 172.21.15.16:0/1540036073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c0cef30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 --2- 172.21.15.16:0/1540036073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c1548e0 0x7fa90c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- 172.21.15.16:0/1540036073 >> 172.21.15.16:0/1540036073 conn(0x7fa90c06a5a0 msgr2=0x7fa90c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:04.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- 172.21.15.16:0/1540036073 shutdown_connections 2023-11-28T17:40:04.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- 172.21.15.16:0/1540036073 wait complete. 2023-11-28T17:40:04.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 Processor -- start 2023-11-28T17:40:04.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- start start 2023-11-28T17:40:04.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa90c1548e0 0x7fa90c13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c15b350 0x7fa90c14c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c14e950 con 0x7fa90c072090 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c13e320 con 0x7fa90c1548e0 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa912180640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa90c14dd60 con 0x7fa90c15b350 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa90b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa90b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55004/0 (socket says 172.21.15.16:55004) 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa90b7fe640 1 -- 172.21.15.16:0/2905786116 learned_addr learned my addr 172.21.15.16:0/2905786116 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa90bfff640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c15b350 0x7fa90c14c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.215+0000 7fa90affd640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa90c1548e0 0x7fa90c13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa90b7fe640 1 -- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c15b350 msgr2=0x7fa90c14c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa90b7fe640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c15b350 0x7fa90c14c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa90b7fe640 1 -- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa90c1548e0 msgr2=0x7fa90c13dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa90b7fe640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa90c1548e0 0x7fa90c13dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa90b7fe640 1 -- 172.21.15.16:0/2905786116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9000094d0 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa90b7fe640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c150b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00d830 tx=0x7fa8fc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00b6c0 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8fc00b860 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc00bc10 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90c14dfb0 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa90c14e570 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa90c068860 con 0x7fa90c072090 2023-11-28T17:40:04.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.219+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa8fc01e460 con 0x7fa90c072090 2023-11-28T17:40:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.223+0000 7fa8f3fff640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa8f80668d0 0x7fa8f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.223+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8fc084ae0 con 0x7fa90c072090 2023-11-28T17:40:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.223+0000 7fa90affd640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa8f80668d0 0x7fa8f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.223+0000 7fa90affd640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa8f80668d0 0x7fa8f8068d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06e950 tx=0x7fa900008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:04.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.227+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8fc051dc0 con 0x7fa90c072090 2023-11-28T17:40:04.443 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.439+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fa90c0b3dc0 con 0x7fa90c072090 2023-11-28T17:40:04.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.487+0000 7fa8f3fff640 1 -- 172.21.15.16:0/2905786116 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v50) v1 ==== 147+0+0 (secure 0 0 0) 0x7fa8fc0553e0 con 0x7fa90c072090 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa8f80668d0 msgr2=0x7fa8f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa8f80668d0 0x7fa8f8068d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa90c06e950 tx=0x7fa900008040 comp rx=0 tx=0).stop 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 msgr2=0x7fa90c150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c150b80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc00d830 tx=0x7fa8fc00dcf0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 shutdown_connections 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa90c15b350 0x7fa90c14c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa8f80668d0 0x7fa8f8068d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.493 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa90c1548e0 0x7fa90c13dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 --2- 172.21.15.16:0/2905786116 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa90c072090 0x7fa90c150b80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 >> 172.21.15.16:0/2905786116 conn(0x7fa90c06a5a0 msgr2=0x7fa90c14d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 shutdown_connections 2023-11-28T17:40:04.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.491+0000 7fa912180640 1 -- 172.21.15.16:0/2905786116 wait complete. 2023-11-28T17:40:04.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T17:40:04.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 Processor -- start 2023-11-28T17:40:04.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 -- start start 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f777c144c80 0x7f777c0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f777c0ce4f0 con 0x7f777c0cf470 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f777c0709b0 con 0x7f777c144c80 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f778219d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c145060 con 0x7f777c0cdf00 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f777c144c80 0x7f777c0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f777c144c80 0x7f777c0cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55012/0 (socket says 172.21.15.16:55012) 2023-11-28T17:40:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 -- 172.21.15.16:0/897332604 learned_addr learned my addr 172.21.15.16:0/897332604 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777affd640 1 --2- 172.21.15.16:0/897332604 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 -- 172.21.15.16:0/897332604 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 msgr2=0x7f777c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 --2- 172.21.15.16:0/897332604 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 -- 172.21.15.16:0/897332604 >> v1:172.21.15.64:6789/0 conn(0x7f777c0cf470 legacy=0x7f777c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:04.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.699+0000 7f777b7fe640 1 -- 172.21.15.16:0/897332604 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f777c0ce7d0 con 0x7f777c144c80 2023-11-28T17:40:04.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f777b7fe640 1 --2- 172.21.15.16:0/897332604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c0cd9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f776c009870 tx=0x7f776c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efed7a13e030f2a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:04.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f777a7fc640 1 -- 172.21.15.16:0/897332604 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0ab600 con 0x7f777c144c80 2023-11-28T17:40:04.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f777a7fc640 1 -- 172.21.15.16:0/897332604 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0a7050 con 0x7f777c144c80 2023-11-28T17:40:04.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f777a7fc640 1 -- 172.21.15.16:0/897332604 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776c0ab980 con 0x7f777c144c80 2023-11-28T17:40:04.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 -- 172.21.15.16:0/897332604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 msgr2=0x7f777c0cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 --2- 172.21.15.16:0/897332604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c0cd9c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f776c009870 tx=0x7f776c01c500 comp rx=0 tx=0).stop 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 -- 172.21.15.16:0/897332604 shutdown_connections 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 --2- 172.21.15.16:0/897332604 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 --2- 172.21.15.16:0/897332604 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c0cd9c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 -- 172.21.15.16:0/897332604 >> 172.21.15.16:0/897332604 conn(0x7f777c06a5a0 msgr2=0x7f777c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 -- 172.21.15.16:0/897332604 shutdown_connections 2023-11-28T17:40:04.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.703+0000 7f778219d640 1 -- 172.21.15.16:0/897332604 wait complete. 2023-11-28T17:40:04.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 Processor -- start 2023-11-28T17:40:04.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 -- start start 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f777c0cf470 0x7f777c13dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c12b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c1297c0 con 0x7f777c144c80 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f777c13ed90 con 0x7f777c0cf470 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f777c13e7d0 con 0x7f777c0cdf00 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c12b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c12b3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55024/0 (socket says 172.21.15.16:55024) 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 -- 172.21.15.16:0/2302727188 learned_addr learned my addr 172.21.15.16:0/2302727188 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777affd640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f777c0cf470 0x7f777c13dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777b7fe640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 -- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 msgr2=0x7f777c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 -- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f777c0cf470 msgr2=0x7f777c13dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f777c0cf470 0x7f777c13dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.712 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 -- 172.21.15.16:0/2302727188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0094d0 con 0x7f777c144c80 2023-11-28T17:40:04.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f777bfff640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c12b3a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f777400c7b0 tx=0x7f777400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:04.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774004b70 con 0x7f777c144c80 2023-11-28T17:40:04.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7774004cd0 con 0x7f777c144c80 2023-11-28T17:40:04.713 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777400aa90 con 0x7f777c144c80 2023-11-28T17:40:04.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f777c13eab0 con 0x7f777c144c80 2023-11-28T17:40:04.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.707+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f777c13cb20 con 0x7f777c144c80 2023-11-28T17:40:04.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.711+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f777c068860 con 0x7f777c144c80 2023-11-28T17:40:04.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.711+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f777400abf0 con 0x7f777c144c80 2023-11-28T17:40:04.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.711+0000 7f7763fff640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f77680668d0 0x7f7768068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:04.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.711+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77740844b0 con 0x7f777c144c80 2023-11-28T17:40:04.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.711+0000 7f777b7fe640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f77680668d0 0x7f7768068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:04.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.711+0000 7f777b7fe640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f77680668d0 0x7f7768068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f776c0ad000 tx=0x7f776c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:04.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.715+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7774051790 con 0x7f777c144c80 2023-11-28T17:40:04.878 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.875+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f777c15b440 con 0x7f777c144c80 2023-11-28T17:40:04.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.879+0000 7f7763fff640 1 -- 172.21.15.16:0/2302727188 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7774054db0 con 0x7f777c144c80 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f77680668d0 msgr2=0x7f7768068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f77680668d0 0x7f7768068d90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f776c0ad000 tx=0x7f776c008040 comp rx=0 tx=0).stop 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 msgr2=0x7f777c12b3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c12b3a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f777400c7b0 tx=0x7f777400cc70 comp rx=0 tx=0).stop 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 shutdown_connections 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f777c144c80 0x7f777c12b3a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f77680668d0 0x7f7768068d90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f777c0cf470 0x7f777c13dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 --2- 172.21.15.16:0/2302727188 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f777c0cdf00 0x7f777c0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:04.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 >> 172.21.15.16:0/2302727188 conn(0x7f777c06a5a0 msgr2=0x7f777c0adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:04.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 shutdown_connections 2023-11-28T17:40:04.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:04.883+0000 7f778219d640 1 -- 172.21.15.16:0/2302727188 wait complete. 2023-11-28T17:40:04.904 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T17:40:04.905 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T17:40:05.027 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T17:40:05.111 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T17:40:05.112 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:05.112 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:05.121 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:05.121 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:05.172 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:05.173 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:05.226 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:05.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.411+0000 7efdbcd1d640 1 Processor -- start 2023-11-28T17:40:05.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.411+0000 7efdbcd1d640 1 -- start start 2023-11-28T17:40:05.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdbcd1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 0x7efdb80ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdbcd1d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efdb80b3430 0x7efdb80b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdbcd1d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdb8071dc0 con 0x7efdb8146ec0 2023-11-28T17:40:05.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdbcd1d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb80b3e00 con 0x7efdb80b3430 2023-11-28T17:40:05.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdbcd1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb806ecd0 con 0x7efdb806b140 2023-11-28T17:40:05.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb659c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7efdb8146ec0 0x7efdb8071570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36806/0 (socket says 172.21.15.16:36806) 2023-11-28T17:40:05.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb659c640 1 -- 172.21.15.16:0/2763719299 learned_addr learned my addr 172.21.15.16:0/2763719299 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:05.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053135804 0 0) 0x7efdb8071dc0 con 0x7efdb8146ec0 2023-11-28T17:40:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efda4003530 con 0x7efdb8146ec0 2023-11-28T17:40:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb6d9d640 1 --2- 172.21.15.16:0/2763719299 >> v2:172.21.15.64:3300/0 conn(0x7efdb80b3430 0x7efdb80b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 0x7efdb80ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869264736 0 0) 0x7efda4003530 con 0x7efdb8146ec0 2023-11-28T17:40:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 msgr2=0x7efdb80ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 0x7efdb80ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 >> v2:172.21.15.64:3300/0 conn(0x7efdb80b3430 msgr2=0x7efdb80b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 --2- 172.21.15.16:0/2763719299 >> v2:172.21.15.64:3300/0 conn(0x7efdb80b3430 0x7efdb80b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb80720a0 con 0x7efdb8146ec0 2023-11-28T17:40:05.423 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7efda8001680 con 0x7efdb8146ec0 2023-11-28T17:40:05.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 >> v1:172.21.15.16:6789/0 conn(0x7efdb8146ec0 legacy=0x7efdb8071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 0x7efda4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efda4003f50 0x7efda40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.424 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4004d10 0x7efda4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb80b3e00 con 0x7efda4003f50 2023-11-28T17:40:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb806ecd0 con 0x7efda4004d10 2023-11-28T17:40:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda400b990 con 0x7efdb806b140 2023-11-28T17:40:05.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efda4003f50 0x7efda40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb6d9d640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4004d10 0x7efda4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdb659c640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 0x7efda4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 -- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 msgr2=0x7efda4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb806b140 0x7efda4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 -- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4004d10 msgr2=0x7efda4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:05.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4004d10 0x7efda4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.415+0000 7efdaffff640 1 -- 172.21.15.16:0/2763719299 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4003530 con 0x7efda4003f50 2023-11-28T17:40:05.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdaffff640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efda4003f50 0x7efda40047d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efda0009b10 tx=0x7efda001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bdbd354cad750e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:05.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00a5640 con 0x7efda4003f50 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda00a57a0 con 0x7efda4003f50 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdb5d9b640 1 -- 172.21.15.16:0/2763719299 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00a5b50 con 0x7efda4003f50 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 -- 172.21.15.16:0/2763719299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efda4003f50 msgr2=0x7efda40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/2763719299 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efda4003f50 0x7efda40047d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efda0009b10 tx=0x7efda001ca50 comp rx=0 tx=0).stop 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdb6d9d640 1 -- 172.21.15.16:0/2763719299 reap_dead start 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 -- 172.21.15.16:0/2763719299 shutdown_connections 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 -- 172.21.15.16:0/2763719299 >> 172.21.15.16:0/2763719299 conn(0x7efdb80d00b0 msgr2=0x7efdb80d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 -- 172.21.15.16:0/2763719299 shutdown_connections 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 -- 172.21.15.16:0/2763719299 wait complete. 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 Processor -- start 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.419+0000 7efdbcd1d640 1 -- start start 2023-11-28T17:40:05.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4003f50 0x7efdb815cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 0x7efdb813c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb813f790 0x7efdb813fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb813c8a0 con 0x7efdb813bee0 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8144bb0 con 0x7efda4003f50 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb8143df0 con 0x7efdb813f790 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 0x7efdb813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdb659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4003f50 0x7efdb815cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 0x7efdb813c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55034/0 (socket says 172.21.15.16:55034) 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 -- 172.21.15.16:0/389889046 learned_addr learned my addr 172.21.15.16:0/389889046 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:05.440 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdb6d9d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb813f790 0x7efdb813fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 -- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb813f790 msgr2=0x7efdb813fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb813f790 0x7efdb813fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 -- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4003f50 msgr2=0x7efdb815cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4003f50 0x7efdb815cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 -- 172.21.15.16:0/389889046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb81440d0 con 0x7efdb813bee0 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaffff640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 0x7efdb813c360 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efda001c880 tx=0x7efda4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00a5640 con 0x7efdb813bee0 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda0004240 con 0x7efdb813bee0 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda0003620 con 0x7efdb813bee0 2023-11-28T17:40:05.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb81443b0 con 0x7efdb813bee0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb8140150 con 0x7efdb813bee0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.423+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb8068860 con 0x7efdb813bee0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.427+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efda00b4040 con 0x7efdb813bee0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.427+0000 7efdaeffd640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efd98066900 0x7efd98068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.427+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efda011e990 con 0x7efdb813bee0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.427+0000 7efdb659c640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efd98066900 0x7efd98068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.427+0000 7efdb659c640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efd98066900 0x7efd98068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efda80078f0 tx=0x7efda8001de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:05.442 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.431+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efda00ebbe0 con 0x7efdb813bee0 2023-11-28T17:40:05.591 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.587+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdb8143f30 con 0x7efdb813bee0 2023-11-28T17:40:05.592 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdaeffd640 1 -- 172.21.15.16:0/389889046 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7efdb8143f30 con 0x7efdb813bee0 2023-11-28T17:40:05.593 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:05.593 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efd98066900 msgr2=0x7efd98068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efd98066900 0x7efd98068dc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efda80078f0 tx=0x7efda8001de0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 msgr2=0x7efdb813c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 0x7efdb813c360 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efda001c880 tx=0x7efda4005800 comp rx=0 tx=0).stop 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 shutdown_connections 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efdb813f790 0x7efdb813fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.595 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efdb813bee0 0x7efdb813c360 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efd98066900 0x7efd98068dc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 --2- 172.21.15.16:0/389889046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efda4003f50 0x7efdb815cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 >> 172.21.15.16:0/389889046 conn(0x7efdb80d00b0 msgr2=0x7efdb80cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:05.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 shutdown_connections 2023-11-28T17:40:05.596 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.591+0000 7efdbcd1d640 1 -- 172.21.15.16:0/389889046 wait complete. 2023-11-28T17:40:05.614 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:05.615 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:05.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 Processor -- start 2023-11-28T17:40:05.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 -- start start 2023-11-28T17:40:05.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f694c0cef30 0x7f694c0cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f694c070dd0 0x7f694c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f694c0ce4f0 con 0x7f694c144c80 2023-11-28T17:40:05.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c0709b0 con 0x7f694c0cef30 2023-11-28T17:40:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f6952432640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f694c145060 con 0x7f694c070dd0 2023-11-28T17:40:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694bfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f694c144c80 0x7f694c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36822/0 (socket says 172.21.15.16:36822) 2023-11-28T17:40:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694bfff640 1 -- 172.21.15.16:0/2522597012 learned_addr learned my addr 172.21.15.16:0/2522597012 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694b7fe640 1 --2- 172.21.15.16:0/2522597012 >> v2:172.21.15.16:3300/0 conn(0x7f694c0cef30 0x7f694c0cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f69509cf640 1 --2- 172.21.15.16:0/2522597012 >> v2:172.21.15.64:3300/0 conn(0x7f694c070dd0 0x7f694c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694affd640 1 -- 172.21.15.16:0/2522597012 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862350333 0 0) 0x7f694c0ce4f0 con 0x7f694c144c80 2023-11-28T17:40:05.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694affd640 1 -- 172.21.15.16:0/2522597012 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6934003530 con 0x7f694c144c80 2023-11-28T17:40:05.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694b7fe640 1 -- 172.21.15.16:0/2522597012 >> v2:172.21.15.64:3300/0 conn(0x7f694c070dd0 msgr2=0x7f694c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:05.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694b7fe640 1 --2- 172.21.15.16:0/2522597012 >> v2:172.21.15.64:3300/0 conn(0x7f694c070dd0 0x7f694c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694b7fe640 1 -- 172.21.15.16:0/2522597012 >> v1:172.21.15.16:6789/0 conn(0x7f694c144c80 legacy=0x7f694c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.759+0000 7f694b7fe640 1 -- 172.21.15.16:0/2522597012 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0ce7d0 con 0x7f694c0cef30 2023-11-28T17:40:05.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f694b7fe640 1 --2- 172.21.15.16:0/2522597012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c0cf3b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f694c06b4e0 tx=0x7f694001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a577ec9632e2c9b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:05.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f694affd640 1 -- 172.21.15.16:0/2522597012 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400ab600 con 0x7f694c0cef30 2023-11-28T17:40:05.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f694affd640 1 -- 172.21.15.16:0/2522597012 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69400a7050 con 0x7f694c0cef30 2023-11-28T17:40:05.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f694affd640 1 -- 172.21.15.16:0/2522597012 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400ab980 con 0x7f694c0cef30 2023-11-28T17:40:05.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 -- 172.21.15.16:0/2522597012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 msgr2=0x7f694c0cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 --2- 172.21.15.16:0/2522597012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c0cf3b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f694c06b4e0 tx=0x7f694001c460 comp rx=0 tx=0).stop 2023-11-28T17:40:05.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 -- 172.21.15.16:0/2522597012 shutdown_connections 2023-11-28T17:40:05.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 --2- 172.21.15.16:0/2522597012 >> v2:172.21.15.64:3300/0 conn(0x7f694c070dd0 0x7f694c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 --2- 172.21.15.16:0/2522597012 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c0cf3b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 -- 172.21.15.16:0/2522597012 >> 172.21.15.16:0/2522597012 conn(0x7f694c06a5a0 msgr2=0x7f694c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:05.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 -- 172.21.15.16:0/2522597012 shutdown_connections 2023-11-28T17:40:05.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.763+0000 7f6952432640 1 -- 172.21.15.16:0/2522597012 wait complete. 2023-11-28T17:40:05.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 Processor -- start 2023-11-28T17:40:05.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 -- start start 2023-11-28T17:40:05.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f694c070dd0 0x7f694c158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f694c144c80 0x7f694c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0b1bd0 con 0x7f694c0cef30 2023-11-28T17:40:05.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0b0f90 con 0x7f694c070dd0 2023-11-28T17:40:05.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c0b1230 con 0x7f694c144c80 2023-11-28T17:40:05.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c13fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55054/0 (socket says 172.21.15.16:55054) 2023-11-28T17:40:05.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 -- 172.21.15.16:0/4290815806 learned_addr learned my addr 172.21.15.16:0/4290815806 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:05.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694bfff640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f694c070dd0 0x7f694c158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f69509cf640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f694c144c80 0x7f694c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 -- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f694c144c80 msgr2=0x7f694c15bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f694c144c80 0x7f694c15bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 -- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f694c070dd0 msgr2=0x7f694c158c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f694c070dd0 0x7f694c158c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 -- 172.21.15.16:0/4290815806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940009420 con 0x7f694c0cef30 2023-11-28T17:40:05.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f694b7fe640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c13fcf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f69400ae040 tx=0x7f6940019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:05.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400abe70 con 0x7f694c0cef30 2023-11-28T17:40:05.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69400b4430 con 0x7f694c0cef30 2023-11-28T17:40:05.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69400b4800 con 0x7f694c0cef30 2023-11-28T17:40:05.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f694c0b1510 con 0x7f694c0cef30 2023-11-28T17:40:05.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.767+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c159170 con 0x7f694c0cef30 2023-11-28T17:40:05.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.771+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694c0b1e00 con 0x7f694c0cef30 2023-11-28T17:40:05.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.771+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f69400b2040 con 0x7f694c0cef30 2023-11-28T17:40:05.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.771+0000 7f6948ff9640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6938066900 0x7f6938068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:05.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.771+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f694011dfe0 con 0x7f694c0cef30 2023-11-28T17:40:05.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.771+0000 7f694bfff640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6938066900 0x7f6938068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:05.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.771+0000 7f694bfff640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6938066900 0x7f6938068dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f693c0011f0 tx=0x7f693c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.775+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f694c0b1e00 con 0x7f694c0cef30 2023-11-28T17:40:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.935+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f694c0b1e00 con 0x7f694c0cef30 2023-11-28T17:40:05.938 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.935+0000 7f6948ff9640 1 -- 172.21.15.16:0/4290815806 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f694c0b1e00 con 0x7f694c0cef30 2023-11-28T17:40:05.939 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6938066900 msgr2=0x7f6938068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6938066900 0x7f6938068dc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f693c0011f0 tx=0x7f693c007d40 comp rx=0 tx=0).stop 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 msgr2=0x7f694c13fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c13fcf0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f69400ae040 tx=0x7f6940019200 comp rx=0 tx=0).stop 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 shutdown_connections 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f694c144c80 0x7f694c15bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f694c0cef30 0x7f694c13fcf0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6938066900 0x7f6938068dc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 --2- 172.21.15.16:0/4290815806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f694c070dd0 0x7f694c158c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 >> 172.21.15.16:0/4290815806 conn(0x7f694c06a5a0 msgr2=0x7f694c15caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 shutdown_connections 2023-11-28T17:40:05.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:05.939+0000 7f6952432640 1 -- 172.21.15.16:0/4290815806 wait complete. 2023-11-28T17:40:05.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:06.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.103+0000 7f719191d640 1 Processor -- start 2023-11-28T17:40:06.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.103+0000 7f719191d640 1 -- start start 2023-11-28T17:40:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f719191d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c0ccd10 0x7f718c0cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f719191d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f718c0ce450 0x7f718c06cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f719191d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f718c071dc0 con 0x7f718c144af0 2023-11-28T17:40:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f719191d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f718c0ce8e0 con 0x7f718c0ce450 2023-11-28T17:40:06.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f719191d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c144ed0 con 0x7f718c0ccd10 2023-11-28T17:40:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f7183fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c0ccd10 0x7f718c0cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718affd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f718c144af0 0x7f718c0716b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:44246/0 (socket says 172.21.15.16:44246) 2023-11-28T17:40:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718b7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f718c0ce450 0x7f718c06cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718affd640 1 -- 172.21.15.16:0/2029917054 learned_addr learned my addr 172.21.15.16:0/2029917054 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718a7fc640 1 -- 172.21.15.16:0/2029917054 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3003150844 0 0) 0x7f717c001120 con 0x7f718c144af0 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718a7fc640 1 -- 172.21.15.16:0/2029917054 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7178003530 con 0x7f718c144af0 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718b7fe640 1 -- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c0ccd10 msgr2=0x7f718c0cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718b7fe640 1 --2- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c0ccd10 0x7f718c0cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718b7fe640 1 -- 172.21.15.16:0/2029917054 >> v1:172.21.15.64:6789/0 conn(0x7f718c144af0 legacy=0x7f718c0716b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f718b7fe640 1 -- 172.21.15.16:0/2029917054 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718c072000 con 0x7f718c0ce450 2023-11-28T17:40:06.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.107+0000 7f7183fff640 1 --2- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c0ccd10 0x7f718c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:06.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f718b7fe640 1 --2- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c06cbf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7184009d90 tx=0x7f718401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba34c380d34e527b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f718a7fc640 1 -- 172.21.15.16:0/2029917054 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840a59e0 con 0x7f718c0ce450 2023-11-28T17:40:06.113 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f718a7fc640 1 -- 172.21.15.16:0/2029917054 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71840a5b40 con 0x7f718c0ce450 2023-11-28T17:40:06.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f718a7fc640 1 -- 172.21.15.16:0/2029917054 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71840ad440 con 0x7f718c0ce450 2023-11-28T17:40:06.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 -- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 msgr2=0x7f718c06cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 --2- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c06cbf0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7184009d90 tx=0x7f718401c920 comp rx=0 tx=0).stop 2023-11-28T17:40:06.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 -- 172.21.15.16:0/2029917054 shutdown_connections 2023-11-28T17:40:06.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 --2- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c06cbf0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 --2- 172.21.15.16:0/2029917054 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c0ccd10 0x7f718c0cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 -- 172.21.15.16:0/2029917054 >> 172.21.15.16:0/2029917054 conn(0x7f718c0b0bc0 msgr2=0x7f718c0b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:06.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 -- 172.21.15.16:0/2029917054 shutdown_connections 2023-11-28T17:40:06.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 -- 172.21.15.16:0/2029917054 wait complete. 2023-11-28T17:40:06.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 Processor -- start 2023-11-28T17:40:06.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.111+0000 7f719191d640 1 -- start start 2023-11-28T17:40:06.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 0x7f718c13b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c144af0 0x7f718c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c1436a0 con 0x7f718c0ccd10 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718c142a90 con 0x7f718c0ce450 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718c142d70 con 0x7f718c144af0 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 0x7f718c13b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 0x7f718c13b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55062/0 (socket says 172.21.15.16:55062) 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 -- 172.21.15.16:0/2278070940 learned_addr learned my addr 172.21.15.16:0/2278070940 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f7183fff640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718b7fe640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c144af0 0x7f718c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 -- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c144af0 msgr2=0x7f718c156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c144af0 0x7f718c156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 -- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 msgr2=0x7f718c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 -- 172.21.15.16:0/2278070940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7174009420 con 0x7f718c0ccd10 2023-11-28T17:40:06.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718b7fe640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c144af0 0x7f718c156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:06.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f718affd640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 0x7f718c13b720 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c4d0 tx=0x7f717c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c005cf0 con 0x7f718c0ccd10 2023-11-28T17:40:06.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c005e50 con 0x7f718c0ccd10 2023-11-28T17:40:06.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c007290 con 0x7f718c0ccd10 2023-11-28T17:40:06.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7184009a70 con 0x7f718c0ccd10 2023-11-28T17:40:06.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718c143330 con 0x7f718c0ccd10 2023-11-28T17:40:06.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.115+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718c04e890 con 0x7f718c0ccd10 2023-11-28T17:40:06.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.119+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f717c0073f0 con 0x7f718c0ccd10 2023-11-28T17:40:06.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.119+0000 7f7188ff9640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f716c0668d0 0x7f716c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.119+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f717c083830 con 0x7f718c0ccd10 2023-11-28T17:40:06.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.119+0000 7f7183fff640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f716c0668d0 0x7f716c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.119+0000 7f7183fff640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f716c0668d0 0x7f716c068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f718c1f8d50 tx=0x7f7174009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.123+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f717c050b30 con 0x7f718c0ccd10 2023-11-28T17:40:06.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.279+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f718c071dc0 con 0x7f718c0ccd10 2023-11-28T17:40:06.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.279+0000 7f7188ff9640 1 -- 172.21.15.16:0/2278070940 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f717c017020 con 0x7f718c0ccd10 2023-11-28T17:40:06.284 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f716c0668d0 msgr2=0x7f716c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f716c0668d0 0x7f716c068d90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f718c1f8d50 tx=0x7f7174009190 comp rx=0 tx=0).stop 2023-11-28T17:40:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 msgr2=0x7f718c13b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 0x7f718c13b720 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f717c00c4d0 tx=0x7f717c00c990 comp rx=0 tx=0).stop 2023-11-28T17:40:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 shutdown_connections 2023-11-28T17:40:06.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f718c144af0 0x7f718c156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f716c0668d0 0x7f716c068d90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f718c0ce450 0x7f718c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 --2- 172.21.15.16:0/2278070940 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f718c0ccd10 0x7f718c13b720 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 >> 172.21.15.16:0/2278070940 conn(0x7f718c0b0bc0 msgr2=0x7f718c0b0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 shutdown_connections 2023-11-28T17:40:06.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.283+0000 7f719191d640 1 -- 172.21.15.16:0/2278070940 wait complete. 2023-11-28T17:40:06.305 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.447+0000 7f6d62380640 1 Processor -- start 2023-11-28T17:40:06.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.447+0000 7f6d62380640 1 -- start start 2023-11-28T17:40:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d62380640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6d5c1548e0 0x7f6d5c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d62380640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6d5c072090 0x7f6d5c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d62380640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d62380640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c15a6a0 con 0x7f6d5c072090 2023-11-28T17:40:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d62380640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5c0ced30 con 0x7f6d5c1548e0 2023-11-28T17:40:06.454 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d62380640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c15a8b0 con 0x7f6d5c15b350 2023-11-28T17:40:06.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6d5c072090 0x7f6d5c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6d5c072090 0x7f6d5c0cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55078/0 (socket says 172.21.15.16:55078) 2023-11-28T17:40:06.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/1236991264 learned_addr learned my addr 172.21.15.16:0/1236991264 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:06.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5bfff640 1 --2- 172.21.15.16:0/1236991264 >> v2:172.21.15.64:3300/0 conn(0x7f6d5c1548e0 0x7f6d5c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d6091d640 1 --2- 172.21.15.16:0/1236991264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/1236991264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 msgr2=0x7f6d5c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:06.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 --2- 172.21.15.16:0/1236991264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c0cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/1236991264 >> v2:172.21.15.64:3300/0 conn(0x7f6d5c1548e0 msgr2=0x7f6d5c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:06.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 --2- 172.21.15.16:0/1236991264 >> v2:172.21.15.64:3300/0 conn(0x7f6d5c1548e0 0x7f6d5c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/1236991264 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5c0cea50 con 0x7f6d5c072090 2023-11-28T17:40:06.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5bfff640 1 --2- 172.21.15.16:0/1236991264 >> v2:172.21.15.64:3300/0 conn(0x7f6d5c1548e0 0x7f6d5c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:06.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.451+0000 7f6d5b7fe640 1 --2- 172.21.15.16:0/1236991264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c072090 0x7f6d5c0cef30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0744c0 tx=0x7f6d5001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f753cb4b7e98 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d5affd640 1 -- 172.21.15.16:0/1236991264 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500aa5f0 con 0x7f6d5c072090 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d5affd640 1 -- 172.21.15.16:0/1236991264 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500aa750 con 0x7f6d5c072090 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d5affd640 1 -- 172.21.15.16:0/1236991264 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500aaae0 con 0x7f6d5c072090 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- 172.21.15.16:0/1236991264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c072090 msgr2=0x7f6d5c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- 172.21.15.16:0/1236991264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c072090 0x7f6d5c0cef30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0744c0 tx=0x7f6d5001c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- 172.21.15.16:0/1236991264 shutdown_connections 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- 172.21.15.16:0/1236991264 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- 172.21.15.16:0/1236991264 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c072090 0x7f6d5c0cef30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- 172.21.15.16:0/1236991264 >> v2:172.21.15.64:3300/0 conn(0x7f6d5c1548e0 0x7f6d5c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- 172.21.15.16:0/1236991264 >> 172.21.15.16:0/1236991264 conn(0x7f6d5c06a5a0 msgr2=0x7f6d5c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:06.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- 172.21.15.16:0/1236991264 shutdown_connections 2023-11-28T17:40:06.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- 172.21.15.16:0/1236991264 wait complete. 2023-11-28T17:40:06.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 Processor -- start 2023-11-28T17:40:06.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- start start 2023-11-28T17:40:06.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d5c072090 0x7f6d5c1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 0x7f6d5c143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c1f9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c1466e0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c14d4e0 con 0x7f6d5c072090 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.455+0000 7f6d62380640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5c1444c0 con 0x7f6d5c15b350 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 0x7f6d5c143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 0x7f6d5c143f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55094/0 (socket says 172.21.15.16:55094) 2023-11-28T17:40:06.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/114953681 learned_addr learned my addr 172.21.15.16:0/114953681 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5bfff640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d5c072090 0x7f6d5c1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d6091d640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c1f9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 msgr2=0x7f6d5c1f9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c1f9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d5c072090 msgr2=0x7f6d5c1461a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d5c072090 0x7f6d5c1461a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 -- 172.21.15.16:0/114953681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c009420 con 0x7f6d5c1548e0 2023-11-28T17:40:06.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5bfff640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d5c072090 0x7f6d5c1461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d5b7fe640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 0x7f6d5c143f80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001ab80 tx=0x7f6d5001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500bd5f0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d500bd750 con 0x7f6d5c1548e0 2023-11-28T17:40:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d500bdb00 con 0x7f6d5c1548e0 2023-11-28T17:40:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d500094d0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5c1fa950 con 0x7f6d5c1548e0 2023-11-28T17:40:06.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5c068860 con 0x7f6d5c1548e0 2023-11-28T17:40:06.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.459+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6d500b33f0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.463+0000 7f6d58ff9640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6d480668d0 0x7f6d48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.463+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d500a7070 con 0x7f6d5c1548e0 2023-11-28T17:40:06.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.463+0000 7f6d5bfff640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6d480668d0 0x7f6d48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.463+0000 7f6d5bfff640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6d480668d0 0x7f6d48068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0ce430 tx=0x7f6d4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.463+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6d500ec4a0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6d5c0cdae0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d58ff9640 1 -- 172.21.15.16:0/114953681 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6d500efac0 con 0x7f6d5c1548e0 2023-11-28T17:40:06.626 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:06.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6d480668d0 msgr2=0x7f6d48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6d480668d0 0x7f6d48068d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0ce430 tx=0x7f6d4c008040 comp rx=0 tx=0).stop 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 msgr2=0x7f6d5c143f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 0x7f6d5c143f80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6d5001ab80 tx=0x7f6d5001ad10 comp rx=0 tx=0).stop 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 shutdown_connections 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6d5c15b350 0x7f6d5c1f9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6d5c1548e0 0x7f6d5c143f80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6d480668d0 0x7f6d48068d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 --2- 172.21.15.16:0/114953681 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6d5c072090 0x7f6d5c1461a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 >> 172.21.15.16:0/114953681 conn(0x7f6d5c06a5a0 msgr2=0x7f6d5c150010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 shutdown_connections 2023-11-28T17:40:06.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.623+0000 7f6d62380640 1 -- 172.21.15.16:0/114953681 wait complete. 2023-11-28T17:40:06.650 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T17:40:06.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.791+0000 7f9cb5a17640 1 Processor -- start 2023-11-28T17:40:06.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.791+0000 7f9cb5a17640 1 -- start start 2023-11-28T17:40:06.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9cb5a17640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 0x7f9cb00cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9cb5a17640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9cb00cf640 0x7f9cb0070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9cb5a17640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb00ce4f0 con 0x7f9cb00cdf00 2023-11-28T17:40:06.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9cb5a17640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb00709b0 con 0x7f9cb00cf640 2023-11-28T17:40:06.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9cb5a17640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb0145060 con 0x7f9cb0144c80 2023-11-28T17:40:06.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 0x7f9cb00cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 0x7f9cb00cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:38714/0 (socket says 172.21.15.16:38714) 2023-11-28T17:40:06.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 -- 172.21.15.16:0/1275423752 learned_addr learned my addr 172.21.15.16:0/1275423752 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:06.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caf7fe640 1 --2- 172.21.15.16:0/1275423752 >> v2:172.21.15.64:3300/0 conn(0x7f9cb00cf640 0x7f9cb0070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 -- 172.21.15.16:0/1275423752 >> v2:172.21.15.64:3300/0 conn(0x7f9cb00cf640 msgr2=0x7f9cb0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:06.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 --2- 172.21.15.16:0/1275423752 >> v2:172.21.15.64:3300/0 conn(0x7f9cb00cf640 0x7f9cb0070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 -- 172.21.15.16:0/1275423752 >> v1:172.21.15.64:6789/0 conn(0x7f9cb00cdf00 legacy=0x7f9cb00cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caeffd640 1 -- 172.21.15.16:0/1275423752 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb00ce7d0 con 0x7f9cb0144c80 2023-11-28T17:40:06.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.795+0000 7f9caf7fe640 1 --2- 172.21.15.16:0/1275423752 >> v2:172.21.15.64:3300/0 conn(0x7f9cb00cf640 0x7f9cb0070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:06.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9caeffd640 1 --2- 172.21.15.16:0/1275423752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 0x7f9cb00cd9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009870 tx=0x7f9ca001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c08d3a3deda3a446 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cadffb640 1 -- 172.21.15.16:0/1275423752 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00ab650 con 0x7f9cb0144c80 2023-11-28T17:40:06.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cadffb640 1 -- 172.21.15.16:0/1275423752 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca00ab7b0 con 0x7f9cb0144c80 2023-11-28T17:40:06.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cadffb640 1 -- 172.21.15.16:0/1275423752 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00abb40 con 0x7f9cb0144c80 2023-11-28T17:40:06.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 -- 172.21.15.16:0/1275423752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 msgr2=0x7f9cb00cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/1275423752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 0x7f9cb00cd9c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0009870 tx=0x7f9ca001c540 comp rx=0 tx=0).stop 2023-11-28T17:40:06.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 -- 172.21.15.16:0/1275423752 shutdown_connections 2023-11-28T17:40:06.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/1275423752 >> v2:172.21.15.64:3300/0 conn(0x7f9cb00cf640 0x7f9cb0070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/1275423752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb0144c80 0x7f9cb00cd9c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 -- 172.21.15.16:0/1275423752 >> 172.21.15.16:0/1275423752 conn(0x7f9cb006a5a0 msgr2=0x7f9cb006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:06.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 -- 172.21.15.16:0/1275423752 shutdown_connections 2023-11-28T17:40:06.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 -- 172.21.15.16:0/1275423752 wait complete. 2023-11-28T17:40:06.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 Processor -- start 2023-11-28T17:40:06.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.799+0000 7f9cb5a17640 1 -- start start 2023-11-28T17:40:06.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 0x7f9cb01588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb00cf640 0x7f9cb0138e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cb0144c80 0x7f9cb0154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb00a8740 con 0x7f9cb00cdf00 2023-11-28T17:40:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb013a440 con 0x7f9cb0144c80 2023-11-28T17:40:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb013b1c0 con 0x7f9cb00cf640 2023-11-28T17:40:06.806 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 0x7f9cb01588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 0x7f9cb01588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55110/0 (socket says 172.21.15.16:55110) 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 -- 172.21.15.16:0/3192628816 learned_addr learned my addr 172.21.15.16:0/3192628816 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caf7fe640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cb0144c80 0x7f9cb0154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cae7fc640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb00cf640 0x7f9cb0138e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 -- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb00cf640 msgr2=0x7f9cb0138e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb00cf640 0x7f9cb0138e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 -- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cb0144c80 msgr2=0x7f9cb0154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cb0144c80 0x7f9cb0154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 -- 172.21.15.16:0/3192628816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8009a70 con 0x7f9cb00cdf00 2023-11-28T17:40:06.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caf7fe640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cb0144c80 0x7f9cb0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:06.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9caeffd640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 0x7f9cb01588b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00ad040 tx=0x7f9ca001ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00b4800 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca00b4960 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00b4d10 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca00094d0 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb013aee0 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.803+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb013ad40 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.807+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9ca00b3380 con 0x7f9cb00cdf00 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.807+0000 7f9c97fff640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9c9c0668d0 0x7f9c9c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:06.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.807+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ca011eac0 con 0x7f9cb00cdf00 2023-11-28T17:40:06.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.807+0000 7f9cae7fc640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9c9c0668d0 0x7f9c9c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:06.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.807+0000 7f9cae7fc640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9c9c0668d0 0x7f9c9c068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cb015b4a0 tx=0x7f9ca4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:06.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.811+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9cb013ad40 con 0x7f9cb00cdf00 2023-11-28T17:40:06.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.979+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9cb00a84a0 con 0x7f9cb00cdf00 2023-11-28T17:40:06.983 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.979+0000 7f9c97fff640 1 -- 172.21.15.16:0/3192628816 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9cb00a84a0 con 0x7f9cb00cdf00 2023-11-28T17:40:06.983 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-11-28T17:40:06.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9c9c0668d0 msgr2=0x7f9c9c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9c9c0668d0 0x7f9c9c068d90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cb015b4a0 tx=0x7f9ca4009040 comp rx=0 tx=0).stop 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 msgr2=0x7f9cb01588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 0x7f9cb01588b0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00ad040 tx=0x7f9ca001ad80 comp rx=0 tx=0).stop 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 shutdown_connections 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9c9c0668d0 0x7f9c9c068d90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9cb0144c80 0x7f9cb0154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9cb00cf640 0x7f9cb0138e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 --2- 172.21.15.16:0/3192628816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9cb00cdf00 0x7f9cb01588b0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 >> 172.21.15.16:0/3192628816 conn(0x7f9cb006a5a0 msgr2=0x7f9cb013b3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 shutdown_connections 2023-11-28T17:40:06.986 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:06.983+0000 7f9cb5a17640 1 -- 172.21.15.16:0/3192628816 wait complete. 2023-11-28T17:40:07.005 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T17:40:07.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:07.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T17:40:07.043 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:40:07.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:07.043 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T17:40:07.103 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:40:07.103 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:07.113 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:40:07.113 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:07.169 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:40:07.169 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:07.225 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:07.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 Processor -- start 2023-11-28T17:40:07.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 -- start start 2023-11-28T17:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41ec0b8b80 0x7f41ec0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f41ec0b67d0 0x7f41ec0b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ec15d870 con 0x7f41ec0cfca0 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0b6d20 con 0x7f41ec0b8b80 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f411d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ec0b7000 con 0x7f41ec0b67d0 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41ec0b8b80 0x7f41ec0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41ec0b8b80 0x7f41ec0b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55220/0 (socket says 172.21.15.16:55220) 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 -- 172.21.15.16:0/2156431580 learned_addr learned my addr 172.21.15.16:0/2156431580 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:07.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f1eb9640 1 --1- 172.21.15.16:0/2156431580 >> v1:172.21.15.64:6789/0 conn(0x7f41ec0cfca0 0x7f41ec0d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:44846/0 (socket says 172.21.15.16:44846) 2023-11-28T17:40:07.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f26ba640 1 --2- 172.21.15.16:0/2156431580 >> v2:172.21.15.64:3300/0 conn(0x7f41ec0b67d0 0x7f41ec0b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 -- 172.21.15.16:0/2156431580 >> v2:172.21.15.64:3300/0 conn(0x7f41ec0b67d0 msgr2=0x7f41ec0b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:07.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 --2- 172.21.15.16:0/2156431580 >> v2:172.21.15.64:3300/0 conn(0x7f41ec0b67d0 0x7f41ec0b7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 -- 172.21.15.16:0/2156431580 >> v1:172.21.15.64:6789/0 conn(0x7f41ec0cfca0 legacy=0x7f41ec0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.367+0000 7f41f16b8640 1 -- 172.21.15.16:0/2156431580 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec0b72e0 con 0x7f41ec0b8b80 2023-11-28T17:40:07.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f16b8640 1 --2- 172.21.15.16:0/2156431580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0b8b80 0x7f41ec0b6290 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0b61b0 tx=0x7f41dc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7cad2be4a7be4d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:07.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f0eb7640 1 -- 172.21.15.16:0/2156431580 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0a89f0 con 0x7f41ec0b8b80 2023-11-28T17:40:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f0eb7640 1 -- 172.21.15.16:0/2156431580 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41dc0a8b50 con 0x7f41ec0b8b80 2023-11-28T17:40:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f0eb7640 1 -- 172.21.15.16:0/2156431580 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0b0440 con 0x7f41ec0b8b80 2023-11-28T17:40:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 -- 172.21.15.16:0/2156431580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0b8b80 msgr2=0x7f41ec0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 --2- 172.21.15.16:0/2156431580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0b8b80 0x7f41ec0b6290 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41ec0b61b0 tx=0x7f41dc01ecf0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 -- 172.21.15.16:0/2156431580 shutdown_connections 2023-11-28T17:40:07.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 --2- 172.21.15.16:0/2156431580 >> v2:172.21.15.64:3300/0 conn(0x7f41ec0b67d0 0x7f41ec0b7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 --2- 172.21.15.16:0/2156431580 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0b8b80 0x7f41ec0b6290 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 -- 172.21.15.16:0/2156431580 >> 172.21.15.16:0/2156431580 conn(0x7f41ec0720d0 msgr2=0x7f41ec0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:07.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 -- 172.21.15.16:0/2156431580 shutdown_connections 2023-11-28T17:40:07.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 -- 172.21.15.16:0/2156431580 wait complete. 2023-11-28T17:40:07.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.371+0000 7f41f411d640 1 Processor -- start 2023-11-28T17:40:07.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- start start 2023-11-28T17:40:07.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ec0b67d0 0x7f41ec146fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ec0b8b80 0x7f41ec1442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 0x7f41ec145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec145790 con 0x7f41ec0cfca0 2023-11-28T17:40:07.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec144b10 con 0x7f41ec0b8b80 2023-11-28T17:40:07.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ec144df0 con 0x7f41ec0b67d0 2023-11-28T17:40:07.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 0x7f41ec145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 0x7f41ec145bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55222/0 (socket says 172.21.15.16:55222) 2023-11-28T17:40:07.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 -- 172.21.15.16:0/995068206 learned_addr learned my addr 172.21.15.16:0/995068206 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:07.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f16b8640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ec0b8b80 0x7f41ec1442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f1eb9640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ec0b67d0 0x7f41ec146fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 -- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ec0b67d0 msgr2=0x7f41ec146fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ec0b67d0 0x7f41ec146fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 -- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ec0b8b80 msgr2=0x7f41ec1442e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ec0b8b80 0x7f41ec1442e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 -- 172.21.15.16:0/995068206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc0094d0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f26ba640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 0x7f41ec145bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f41e4007e40 tx=0x7f41e400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:07.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e4014620 con 0x7f41ec0cfca0 2023-11-28T17:40:07.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e400ee90 con 0x7f41ec0cfca0 2023-11-28T17:40:07.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e40149e0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ec1450d0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ec144820 con 0x7f41ec0cfca0 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.375+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ec1458d0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.379+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41e4014b40 con 0x7f41ec0cfca0 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.379+0000 7f41e27fc640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41d0066900 0x7f41d0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.379+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41e4084c90 con 0x7f41ec0cfca0 2023-11-28T17:40:07.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.379+0000 7f41f1eb9640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41d0066900 0x7f41d0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.379+0000 7f41f1eb9640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41d0066900 0x7f41d0068dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000f70 tx=0x7f41e8007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:07.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.383+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41ec1458d0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41ec1458d0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41e27fc640 1 -- 172.21.15.16:0/995068206 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f41ec1458d0 con 0x7f41ec0cfca0 2023-11-28T17:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:07.546 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41d0066900 msgr2=0x7f41d0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41d0066900 0x7f41d0068dc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f41e8000f70 tx=0x7f41e8007e50 comp rx=0 tx=0).stop 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 msgr2=0x7f41ec145bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 0x7f41ec145bb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f41e4007e40 tx=0x7f41e400e4b0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 shutdown_connections 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ec0cfca0 0x7f41ec145bb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41d0066900 0x7f41d0068dc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ec0b8b80 0x7f41ec1442e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 --2- 172.21.15.16:0/995068206 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ec0b67d0 0x7f41ec146fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 >> 172.21.15.16:0/995068206 conn(0x7f41ec0720d0 msgr2=0x7f41ec0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:07.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 shutdown_connections 2023-11-28T17:40:07.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.543+0000 7f41f411d640 1 -- 172.21.15.16:0/995068206 wait complete. 2023-11-28T17:40:07.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:07.568 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:07.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 Processor -- start 2023-11-28T17:40:07.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 -- start start 2023-11-28T17:40:07.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d1f50 0x7f81c80d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f81c80d34c0 0x7f81c80cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c80b32c0 con 0x7f81c815d540 2023-11-28T17:40:07.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c80b30d0 con 0x7f81c80d34c0 2023-11-28T17:40:07.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81ce1c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c815d920 con 0x7f81c80d1f50 2023-11-28T17:40:07.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c77fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f81c815d540 0x7f81c80b29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43906/0 (socket says 172.21.15.16:43906) 2023-11-28T17:40:07.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c77fe640 1 -- 172.21.15.16:0/1519974615 learned_addr learned my addr 172.21.15.16:0/1519974615 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:07.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c7fff640 1 --2- 172.21.15.16:0/1519974615 >> v2:172.21.15.64:3300/0 conn(0x7f81c80d34c0 0x7f81c80cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c6ffd640 1 --2- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d1f50 0x7f81c80d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c67fc640 1 -- 172.21.15.16:0/1519974615 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366419087 0 0) 0x7f81c80b32c0 con 0x7f81c815d540 2023-11-28T17:40:07.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c67fc640 1 -- 172.21.15.16:0/1519974615 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81b0003530 con 0x7f81c815d540 2023-11-28T17:40:07.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c7fff640 1 -- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d1f50 msgr2=0x7f81c80d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:07.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c7fff640 1 --2- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d1f50 0x7f81c80d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c7fff640 1 -- 172.21.15.16:0/1519974615 >> v1:172.21.15.16:6789/0 conn(0x7f81c815d540 legacy=0x7f81c80b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.711+0000 7f81c7fff640 1 -- 172.21.15.16:0/1519974615 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c80b35a0 con 0x7f81c80d34c0 2023-11-28T17:40:07.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81c7fff640 1 --2- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d34c0 0x7f81c80cdde0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009dc0 tx=0x7f81c001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fbc1a374dcc5986 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:07.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81c67fc640 1 -- 172.21.15.16:0/1519974615 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00a59c0 con 0x7f81c80d34c0 2023-11-28T17:40:07.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81c67fc640 1 -- 172.21.15.16:0/1519974615 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00a5b20 con 0x7f81c80d34c0 2023-11-28T17:40:07.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81c67fc640 1 -- 172.21.15.16:0/1519974615 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00ad440 con 0x7f81c80d34c0 2023-11-28T17:40:07.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81ce1c4640 1 -- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d34c0 msgr2=0x7f81c80cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d34c0 0x7f81c80cdde0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81c0009dc0 tx=0x7f81c001c900 comp rx=0 tx=0).stop 2023-11-28T17:40:07.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81ce1c4640 1 -- 172.21.15.16:0/1519974615 shutdown_connections 2023-11-28T17:40:07.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d34c0 0x7f81c80cdde0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/1519974615 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d1f50 0x7f81c80d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.715+0000 7f81ce1c4640 1 -- 172.21.15.16:0/1519974615 >> 172.21.15.16:0/1519974615 conn(0x7f81c808ccf0 msgr2=0x7f81c809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:07.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 -- 172.21.15.16:0/1519974615 shutdown_connections 2023-11-28T17:40:07.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 -- 172.21.15.16:0/1519974615 wait complete. 2023-11-28T17:40:07.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 Processor -- start 2023-11-28T17:40:07.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 -- start start 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d1f50 0x7f81c80c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d34c0 0x7f81c8160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 0x7f81c806c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c80cbc50 con 0x7f81c815d540 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8154c40 con 0x7f81c80d1f50 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81ce1c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c8154eb0 con 0x7f81c80d34c0 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 0x7f81c806c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 0x7f81c806c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55230/0 (socket says 172.21.15.16:55230) 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 -- 172.21.15.16:0/775814442 learned_addr learned my addr 172.21.15.16:0/775814442 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:07.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c77fe640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d1f50 0x7f81c80c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c6ffd640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d34c0 0x7f81c8160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 -- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d34c0 msgr2=0x7f81c8160080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d34c0 0x7f81c8160080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 -- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d1f50 msgr2=0x7f81c80c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d1f50 0x7f81c80c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 -- 172.21.15.16:0/775814442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c0009a70 con 0x7f81c815d540 2023-11-28T17:40:07.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.719+0000 7f81c7fff640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 0x7f81c806c470 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81c001cde0 tx=0x7f81c00196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:07.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00adc80 con 0x7f81c815d540 2023-11-28T17:40:07.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00ade00 con 0x7f81c815d540 2023-11-28T17:40:07.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c00b9690 con 0x7f81c815d540 2023-11-28T17:40:07.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c8155190 con 0x7f81c815d540 2023-11-28T17:40:07.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c80c93f0 con 0x7f81c815d540 2023-11-28T17:40:07.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c80cba20 con 0x7f81c815d540 2023-11-28T17:40:07.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f81c00b97f0 con 0x7f81c815d540 2023-11-28T17:40:07.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81affff640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f81b40668d0 0x7f81b4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:07.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81c011fc40 con 0x7f81c815d540 2023-11-28T17:40:07.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.723+0000 7f81c77fe640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f81b40668d0 0x7f81b4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:07.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.727+0000 7f81c77fe640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f81b40668d0 0x7f81b4068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81b80011f0 tx=0x7f81b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:07.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.727+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81c80cba20 con 0x7f81c815d540 2023-11-28T17:40:07.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81c80cba20 con 0x7f81c815d540 2023-11-28T17:40:07.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81affff640 1 -- 172.21.15.16:0/775814442 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81c80cba20 con 0x7f81c815d540 2023-11-28T17:40:07.889 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f81b40668d0 msgr2=0x7f81b4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f81b40668d0 0x7f81b4068d90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81b80011f0 tx=0x7f81b8009040 comp rx=0 tx=0).stop 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 msgr2=0x7f81c806c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 0x7f81c806c470 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f81c001cde0 tx=0x7f81c00196a0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 shutdown_connections 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f81c815d540 0x7f81c806c470 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81c80d34c0 0x7f81c8160080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f81b40668d0 0x7f81b4068d90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 --2- 172.21.15.16:0/775814442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81c80d1f50 0x7f81c80c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:07.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 >> 172.21.15.16:0/775814442 conn(0x7f81c808ccf0 msgr2=0x7f81c80b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:07.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 shutdown_connections 2023-11-28T17:40:07.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:07.887+0000 7f81ce1c4640 1 -- 172.21.15.16:0/775814442 wait complete. 2023-11-28T17:40:07.911 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:08.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.051+0000 7f6c25c9a640 1 Processor -- start 2023-11-28T17:40:08.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.051+0000 7f6c25c9a640 1 -- start start 2023-11-28T17:40:08.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c25c9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c200ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c25c9a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c20072090 0x7f6c200cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c25c9a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2015a8b0 con 0x7f6c2015b350 2023-11-28T17:40:08.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c25c9a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2015a6a0 con 0x7f6c20072090 2023-11-28T17:40:08.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c25c9a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200ced30 con 0x7f6c201548e0 2023-11-28T17:40:08.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1f7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c200ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c20072090 0x7f6c200cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1ffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f6c2015b350 0x7f6c20070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:44854/0 (socket says 172.21.15.16:44854) 2023-11-28T17:40:08.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1ffff640 1 -- 172.21.15.16:0/3457467655 learned_addr learned my addr 172.21.15.16:0/3457467655 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:08.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1e7fc640 1 -- 172.21.15.16:0/3457467655 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2710188638 0 0) 0x7f6c2015a8b0 con 0x7f6c2015b350 2023-11-28T17:40:08.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/3457467655 >> v2:172.21.15.64:3300/0 conn(0x7f6c20072090 msgr2=0x7f6c200cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:08.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1f7fe640 1 --2- 172.21.15.16:0/3457467655 >> v2:172.21.15.64:3300/0 conn(0x7f6c20072090 0x7f6c200cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/3457467655 >> v1:172.21.15.64:6789/0 conn(0x7f6c2015b350 legacy=0x7f6c20070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/3457467655 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200cea50 con 0x7f6c201548e0 2023-11-28T17:40:08.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.055+0000 7f6c1effd640 1 --2- 172.21.15.16:0/3457467655 >> v2:172.21.15.64:3300/0 conn(0x7f6c20072090 0x7f6c200cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:08.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c1f7fe640 1 --2- 172.21.15.16:0/3457467655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c200ce150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c100097c0 tx=0x7f6c1001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a82f05adad82265b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c1e7fc640 1 -- 172.21.15.16:0/3457467655 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c100ab600 con 0x7f6c201548e0 2023-11-28T17:40:08.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c1e7fc640 1 -- 172.21.15.16:0/3457467655 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c100a7050 con 0x7f6c201548e0 2023-11-28T17:40:08.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c1e7fc640 1 -- 172.21.15.16:0/3457467655 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c100ab980 con 0x7f6c201548e0 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 -- 172.21.15.16:0/3457467655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 msgr2=0x7f6c200ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/3457467655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c200ce150 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6c100097c0 tx=0x7f6c1001c480 comp rx=0 tx=0).stop 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 -- 172.21.15.16:0/3457467655 shutdown_connections 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/3457467655 >> v2:172.21.15.64:3300/0 conn(0x7f6c20072090 0x7f6c200cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/3457467655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c200ce150 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 -- 172.21.15.16:0/3457467655 >> 172.21.15.16:0/3457467655 conn(0x7f6c2006a5a0 msgr2=0x7f6c2006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 -- 172.21.15.16:0/3457467655 shutdown_connections 2023-11-28T17:40:08.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.059+0000 7f6c25c9a640 1 -- 172.21.15.16:0/3457467655 wait complete. 2023-11-28T17:40:08.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 Processor -- start 2023-11-28T17:40:08.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 -- start start 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 0x7f6c2014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c201f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c2015b350 0x7f6c20151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c201f5220 con 0x7f6c20072090 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2014e4a0 con 0x7f6c2015b350 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c20152220 con 0x7f6c201548e0 2023-11-28T17:40:08.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 0x7f6c2014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 0x7f6c2014fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55240/0 (socket says 172.21.15.16:55240) 2023-11-28T17:40:08.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/1936061847 learned_addr learned my addr 172.21.15.16:0/1936061847 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:08.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1effd640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c201f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1ffff640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c2015b350 0x7f6c20151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 msgr2=0x7f6c201f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c201f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c2015b350 msgr2=0x7f6c20151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c2015b350 0x7f6c20151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 -- 172.21.15.16:0/1936061847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14009420 con 0x7f6c20072090 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c1f7fe640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 0x7f6c2014fe00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c100ae040 tx=0x7f6c1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c100b7450 con 0x7f6c20072090 2023-11-28T17:40:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c100b75b0 con 0x7f6c20072090 2023-11-28T17:40:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c10009420 con 0x7f6c20072090 2023-11-28T17:40:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c100b7960 con 0x7f6c20072090 2023-11-28T17:40:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.063+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2014db70 con 0x7f6c20072090 2023-11-28T17:40:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.067+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c20068860 con 0x7f6c20072090 2023-11-28T17:40:08.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.067+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6c100b7ac0 con 0x7f6c20072090 2023-11-28T17:40:08.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.067+0000 7f6c07fff640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6c0c0668d0 0x7f6c0c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.067+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c1011ebc0 con 0x7f6c20072090 2023-11-28T17:40:08.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.067+0000 7f6c1effd640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6c0c0668d0 0x7f6c0c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.067+0000 7f6c1effd640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6c0c0668d0 0x7f6c0c068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c200b2cc0 tx=0x7f6c14009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.071+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6c100ebe10 con 0x7f6c20072090 2023-11-28T17:40:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.227+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c20150ca0 con 0x7f6c20072090 2023-11-28T17:40:08.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.227+0000 7f6c07fff640 1 -- 172.21.15.16:0/1936061847 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c100b00a0 con 0x7f6c20072090 2023-11-28T17:40:08.231 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:08.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6c0c0668d0 msgr2=0x7f6c0c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6c0c0668d0 0x7f6c0c068d90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6c200b2cc0 tx=0x7f6c14009190 comp rx=0 tx=0).stop 2023-11-28T17:40:08.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 msgr2=0x7f6c2014fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 0x7f6c2014fe00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6c100ae040 tx=0x7f6c1001acc0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 shutdown_connections 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6c0c0668d0 0x7f6c0c068d90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c2015b350 0x7f6c20151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6c201548e0 0x7f6c201f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 --2- 172.21.15.16:0/1936061847 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6c20072090 0x7f6c2014fe00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 >> 172.21.15.16:0/1936061847 conn(0x7f6c2006a5a0 msgr2=0x7f6c20070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 shutdown_connections 2023-11-28T17:40:08.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.231+0000 7f6c25c9a640 1 -- 172.21.15.16:0/1936061847 wait complete. 2023-11-28T17:40:08.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:08.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 Processor -- start 2023-11-28T17:40:08.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 -- start start 2023-11-28T17:40:08.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1e00cef30 0x7fd1e00cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0070dd0 0x7fd1e0071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e00ce4f0 con 0x7fd1e0144c80 2023-11-28T17:40:08.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e00709b0 con 0x7fd1e00cef30 2023-11-28T17:40:08.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e8372640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0145060 con 0x7fd1e0070dd0 2023-11-28T17:40:08.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1e00cef30 0x7fd1e00cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1e00cef30 0x7fd1e00cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55256/0 (socket says 172.21.15.16:55256) 2023-11-28T17:40:08.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 -- 172.21.15.16:0/1178943871 learned_addr learned my addr 172.21.15.16:0/1178943871 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:08.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e690f640 1 --2- 172.21.15.16:0/1178943871 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0070dd0 0x7fd1e0071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 -- 172.21.15.16:0/1178943871 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0070dd0 msgr2=0x7fd1e0071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:08.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 --2- 172.21.15.16:0/1178943871 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0070dd0 0x7fd1e0071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 -- 172.21.15.16:0/1178943871 >> v1:172.21.15.64:6789/0 conn(0x7fd1e0144c80 legacy=0x7fd1e00cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.395+0000 7fd1e590d640 1 -- 172.21.15.16:0/1178943871 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00ce7d0 con 0x7fd1e00cef30 2023-11-28T17:40:08.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e590d640 1 --2- 172.21.15.16:0/1178943871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cef30 0x7fd1e00cf3b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009870 tx=0x7fd1d001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7464b7e7331d5b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e510c640 1 -- 172.21.15.16:0/1178943871 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00ab600 con 0x7fd1e00cef30 2023-11-28T17:40:08.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e510c640 1 -- 172.21.15.16:0/1178943871 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00a7050 con 0x7fd1e00cef30 2023-11-28T17:40:08.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e510c640 1 -- 172.21.15.16:0/1178943871 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00ab980 con 0x7fd1e00cef30 2023-11-28T17:40:08.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 -- 172.21.15.16:0/1178943871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cef30 msgr2=0x7fd1e00cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 --2- 172.21.15.16:0/1178943871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cef30 0x7fd1e00cf3b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009870 tx=0x7fd1d001c360 comp rx=0 tx=0).stop 2023-11-28T17:40:08.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 -- 172.21.15.16:0/1178943871 shutdown_connections 2023-11-28T17:40:08.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 --2- 172.21.15.16:0/1178943871 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0070dd0 0x7fd1e0071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 --2- 172.21.15.16:0/1178943871 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cef30 0x7fd1e00cf3b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 -- 172.21.15.16:0/1178943871 >> 172.21.15.16:0/1178943871 conn(0x7fd1e006a5a0 msgr2=0x7fd1e006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:08.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 -- 172.21.15.16:0/1178943871 shutdown_connections 2023-11-28T17:40:08.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.399+0000 7fd1e8372640 1 -- 172.21.15.16:0/1178943871 wait complete. 2023-11-28T17:40:08.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 Processor -- start 2023-11-28T17:40:08.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 -- start start 2023-11-28T17:40:08.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 0x7fd1e013a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e00cef30 0x7fd1e0143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e0144c80 0x7fd1e0137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e0143b60 con 0x7fd1e0070dd0 2023-11-28T17:40:08.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e013c040 con 0x7fd1e0144c80 2023-11-28T17:40:08.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e013c320 con 0x7fd1e00cef30 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 0x7fd1e013a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 0x7fd1e013a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55260/0 (socket says 172.21.15.16:55260) 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 -- 172.21.15.16:0/3642919956 learned_addr learned my addr 172.21.15.16:0/3642919956 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e590d640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e00cef30 0x7fd1e0143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e690f640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e0144c80 0x7fd1e0137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 -- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e00cef30 msgr2=0x7fd1e0143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e00cef30 0x7fd1e0143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 -- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e0144c80 msgr2=0x7fd1e0137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e0144c80 0x7fd1e0137880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 -- 172.21.15.16:0/3642919956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00094d0 con 0x7fd1e0070dd0 2023-11-28T17:40:08.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e610e640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 0x7fd1e013a5f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c500 tx=0x7fd1dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc005220 con 0x7fd1e0070dd0 2023-11-28T17:40:08.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1dc005380 con 0x7fd1e0070dd0 2023-11-28T17:40:08.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e013c600 con 0x7fd1e0070dd0 2023-11-28T17:40:08.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc007270 con 0x7fd1e0070dd0 2023-11-28T17:40:08.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.403+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e013cbc0 con 0x7fd1e0070dd0 2023-11-28T17:40:08.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.407+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0068860 con 0x7fd1e0070dd0 2023-11-28T17:40:08.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.407+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd1dc0073d0 con 0x7fd1e0070dd0 2023-11-28T17:40:08.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.407+0000 7fd1d6ffd640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1c40668d0 0x7fd1c4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.407+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1dc083c90 con 0x7fd1e0070dd0 2023-11-28T17:40:08.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.407+0000 7fd1e590d640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1c40668d0 0x7fd1c4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.407+0000 7fd1e590d640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1c40668d0 0x7fd1c4068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ad000 tx=0x7fd1d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.411+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1dc050ef0 con 0x7fd1e0070dd0 2023-11-28T17:40:08.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.567+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd1e006ab20 con 0x7fd1e0070dd0 2023-11-28T17:40:08.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.567+0000 7fd1d6ffd640 1 -- 172.21.15.16:0/3642919956 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd1dc054510 con 0x7fd1e0070dd0 2023-11-28T17:40:08.571 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1c40668d0 msgr2=0x7fd1c4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1c40668d0 0x7fd1c4068d90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ad000 tx=0x7fd1d0008040 comp rx=0 tx=0).stop 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 msgr2=0x7fd1e013a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 0x7fd1e013a5f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c500 tx=0x7fd1dc00c9c0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 shutdown_connections 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1c40668d0 0x7fd1c4068d90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e0144c80 0x7fd1e0137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e00cef30 0x7fd1e0143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 --2- 172.21.15.16:0/3642919956 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0070dd0 0x7fd1e013a5f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 >> 172.21.15.16:0/3642919956 conn(0x7fd1e006a5a0 msgr2=0x7fd1e013d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 shutdown_connections 2023-11-28T17:40:08.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.571+0000 7fd1e8372640 1 -- 172.21.15.16:0/3642919956 wait complete. 2023-11-28T17:40:08.593 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T17:40:08.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.731+0000 7f9a7d19d640 1 Processor -- start 2023-11-28T17:40:08.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.731+0000 7f9a7d19d640 1 -- start start 2023-11-28T17:40:08.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7d19d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9a780cef30 0x7f9a780cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7d19d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780ce4f0 con 0x7f9a78070dd0 2023-11-28T17:40:08.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7d19d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a780ce7d0 con 0x7f9a78144c80 2023-11-28T17:40:08.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7d19d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a780709b0 con 0x7f9a780cef30 2023-11-28T17:40:08.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a6ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9a780cef30 0x7f9a780cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7759e640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f9a78070dd0 0x7f9a78071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43910/0 (socket says 172.21.15.16:43910) 2023-11-28T17:40:08.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7759e640 1 -- 172.21.15.16:0/36813157 learned_addr learned my addr 172.21.15.16:0/36813157 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:08.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a6ffff640 1 -- 172.21.15.16:0/36813157 >> v1:172.21.15.64:6789/0 conn(0x7f9a78144c80 legacy=0x7f9a780cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a6ffff640 1 -- 172.21.15.16:0/36813157 >> v1:172.21.15.16:6789/0 conn(0x7f9a78070dd0 legacy=0x7f9a78071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a6ffff640 1 -- 172.21.15.16:0/36813157 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780ceab0 con 0x7f9a780cef30 2023-11-28T17:40:08.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.735+0000 7f9a7659c640 1 -- 172.21.15.16:0/36813157 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916971357 0 0) 0x7f9a780ce4f0 con 0x7f9a78070dd0 2023-11-28T17:40:08.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a6ffff640 1 --2- 172.21.15.16:0/36813157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780cf3b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a600097c0 tx=0x7f9a6001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12958d3ce6815f59 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7659c640 1 -- 172.21.15.16:0/36813157 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600a8050 con 0x7f9a780cef30 2023-11-28T17:40:08.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7659c640 1 -- 172.21.15.16:0/36813157 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a600ac5f0 con 0x7f9a780cef30 2023-11-28T17:40:08.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7659c640 1 -- 172.21.15.16:0/36813157 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600ac980 con 0x7f9a780cef30 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 -- 172.21.15.16:0/36813157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 msgr2=0x7f9a780cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/36813157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780cf3b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f9a600097c0 tx=0x7f9a6001c480 comp rx=0 tx=0).stop 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 -- 172.21.15.16:0/36813157 shutdown_connections 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/36813157 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780cf3b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 -- 172.21.15.16:0/36813157 >> 172.21.15.16:0/36813157 conn(0x7f9a7806a5a0 msgr2=0x7f9a7806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 -- 172.21.15.16:0/36813157 shutdown_connections 2023-11-28T17:40:08.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 -- 172.21.15.16:0/36813157 wait complete. 2023-11-28T17:40:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 Processor -- start 2023-11-28T17:40:08.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.739+0000 7f9a7d19d640 1 -- start start 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a78070dd0 0x7f9a78158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9a78144c80 0x7f9a780afd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a78138b30 con 0x7f9a780cef30 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780ad6b0 con 0x7f9a78070dd0 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a780acb70 con 0x7f9a78144c80 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780af840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55284/0 (socket says 172.21.15.16:55284) 2023-11-28T17:40:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 -- 172.21.15.16:0/3961657872 learned_addr learned my addr 172.21.15.16:0/3961657872 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a76d9d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a78070dd0 0x7f9a78158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7759e640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9a78144c80 0x7f9a780afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 -- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9a78144c80 msgr2=0x7f9a780afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9a78144c80 0x7f9a780afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 -- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a78070dd0 msgr2=0x7f9a78158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a78070dd0 0x7f9a78158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 -- 172.21.15.16:0/3961657872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60009420 con 0x7f9a780cef30 2023-11-28T17:40:08.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6ffff640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780af840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a600af040 tx=0x7f9a60019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600a8040 con 0x7f9a780cef30 2023-11-28T17:40:08.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a600b45c0 con 0x7f9a780cef30 2023-11-28T17:40:08.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600b4990 con 0x7f9a780cef30 2023-11-28T17:40:08.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a780ad3d0 con 0x7f9a780cef30 2023-11-28T17:40:08.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a78138750 con 0x7f9a780cef30 2023-11-28T17:40:08.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.743+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a78138c70 con 0x7f9a780cef30 2023-11-28T17:40:08.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.747+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9a600b4af0 con 0x7f9a780cef30 2023-11-28T17:40:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.747+0000 7f9a6f7fe640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9a580668d0 0x7f9a58068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.747+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a6011e840 con 0x7f9a780cef30 2023-11-28T17:40:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.747+0000 7f9a76d9d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9a580668d0 0x7f9a58068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.747+0000 7f9a76d9d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9a580668d0 0x7f9a58068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a68007fd0 tx=0x7f9a68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:08.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.751+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a78138c70 con 0x7f9a780cef30 2023-11-28T17:40:08.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.919+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9a78138c70 con 0x7f9a780cef30 2023-11-28T17:40:08.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.919+0000 7f9a6f7fe640 1 -- 172.21.15.16:0/3961657872 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9a78138c70 con 0x7f9a780cef30 2023-11-28T17:40:08.924 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-11-28T17:40:08.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9a580668d0 msgr2=0x7f9a58068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9a580668d0 0x7f9a58068d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9a68007fd0 tx=0x7f9a68009040 comp rx=0 tx=0).stop 2023-11-28T17:40:08.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 msgr2=0x7f9a780af840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:08.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780af840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9a600af040 tx=0x7f9a60019220 comp rx=0 tx=0).stop 2023-11-28T17:40:08.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 shutdown_connections 2023-11-28T17:40:08.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9a78144c80 0x7f9a780afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9a780cef30 0x7f9a780af840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9a580668d0 0x7f9a58068d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 --2- 172.21.15.16:0/3961657872 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9a78070dd0 0x7f9a78158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:08.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 >> 172.21.15.16:0/3961657872 conn(0x7f9a7806a5a0 msgr2=0x7f9a780ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:08.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 shutdown_connections 2023-11-28T17:40:08.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:08.923+0000 7f9a7d19d640 1 -- 172.21.15.16:0/3961657872 wait complete. 2023-11-28T17:40:08.945 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-28T17:40:08.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:08.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-28T17:40:08.985 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:40:08.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:08.985 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-28T17:40:09.047 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:09.047 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:09.057 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:09.057 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:09.108 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:09.109 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:09.163 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:09.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 Processor -- start 2023-11-28T17:40:09.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 -- start start 2023-11-28T17:40:09.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc9940cef30 0x7fc9940cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994070dd0 0x7fc994071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9940ce4f0 con 0x7fc994144c80 2023-11-28T17:40:09.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9940709b0 con 0x7fc9940cef30 2023-11-28T17:40:09.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.343+0000 7fc99bd01640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc994145060 con 0x7fc994070dd0 2023-11-28T17:40:09.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc999a9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc994144c80 0x7fc9940cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43912/0 (socket says 172.21.15.16:43912) 2023-11-28T17:40:09.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc999a9d640 1 -- 172.21.15.16:0/1641851894 learned_addr learned my addr 172.21.15.16:0/1641851894 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:09.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99929c640 1 --2- 172.21.15.16:0/1641851894 >> v2:172.21.15.64:3300/0 conn(0x7fc9940cef30 0x7fc9940cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99a29e640 1 --2- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994070dd0 0x7fc994071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc998a9b640 1 -- 172.21.15.16:0/1641851894 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36794560 0 0) 0x7fc9940ce4f0 con 0x7fc994144c80 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc998a9b640 1 -- 172.21.15.16:0/1641851894 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc980003530 con 0x7fc994144c80 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99929c640 1 -- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994070dd0 msgr2=0x7fc994071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99929c640 1 --2- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994070dd0 0x7fc994071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99929c640 1 -- 172.21.15.16:0/1641851894 >> v1:172.21.15.16:6789/0 conn(0x7fc994144c80 legacy=0x7fc9940cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc998a9b640 1 -- 172.21.15.16:0/1641851894 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1203541586 0 0) 0x7fc980003530 con 0x7fc994144c80 2023-11-28T17:40:09.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99929c640 1 -- 172.21.15.16:0/1641851894 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9940ce7d0 con 0x7fc9940cef30 2023-11-28T17:40:09.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.347+0000 7fc99929c640 1 --2- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9940cef30 0x7fc9940cf3b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9840097c0 tx=0x7fc98401c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1ba0775f199fb8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:09.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc998a9b640 1 -- 172.21.15.16:0/1641851894 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990001680 con 0x7fc9940cef30 2023-11-28T17:40:09.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc998a9b640 1 -- 172.21.15.16:0/1641851894 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9840a7050 con 0x7fc9940cef30 2023-11-28T17:40:09.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc998a9b640 1 -- 172.21.15.16:0/1641851894 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840ab600 con 0x7fc9940cef30 2023-11-28T17:40:09.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9940cef30 msgr2=0x7fc9940cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 --2- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9940cef30 0x7fc9940cf3b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc9840097c0 tx=0x7fc98401c1c0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- 172.21.15.16:0/1641851894 shutdown_connections 2023-11-28T17:40:09.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 --2- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994070dd0 0x7fc994071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 --2- 172.21.15.16:0/1641851894 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc9940cef30 0x7fc9940cf3b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- 172.21.15.16:0/1641851894 >> 172.21.15.16:0/1641851894 conn(0x7fc99406a5a0 msgr2=0x7fc99406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:09.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- 172.21.15.16:0/1641851894 shutdown_connections 2023-11-28T17:40:09.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- 172.21.15.16:0/1641851894 wait complete. 2023-11-28T17:40:09.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 Processor -- start 2023-11-28T17:40:09.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- start start 2023-11-28T17:40:09.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc994070dd0 0x7fc9941379b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 0x7fc994159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994144c80 0x7fc994140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994141870 con 0x7fc9940cef30 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc994137ef0 con 0x7fc994070dd0 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99bd01640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9940ad5f0 con 0x7fc994144c80 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99929c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 0x7fc994159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99929c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 0x7fc994159cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55290/0 (socket says 172.21.15.16:55290) 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.351+0000 7fc99929c640 1 -- 172.21.15.16:0/157106228 learned_addr learned my addr 172.21.15.16:0/157106228 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc999a9d640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc994070dd0 0x7fc9941379b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99a29e640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994144c80 0x7fc994140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99929c640 1 -- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994144c80 msgr2=0x7fc994140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99929c640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994144c80 0x7fc994140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99929c640 1 -- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc994070dd0 msgr2=0x7fc9941379b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99929c640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc994070dd0 0x7fc9941379b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99929c640 1 -- 172.21.15.16:0/157106228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc984009420 con 0x7fc9940cef30 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99a29e640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994144c80 0x7fc994140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:09.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99929c640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 0x7fc994159cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc984000c10 tx=0x7fc984018f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840b4400 con 0x7fc9940cef30 2023-11-28T17:40:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9840b4560 con 0x7fc9940cef30 2023-11-28T17:40:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9840b48d0 con 0x7fc9940cef30 2023-11-28T17:40:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9940ad8d0 con 0x7fc9940cef30 2023-11-28T17:40:09.360 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99413b210 con 0x7fc9940cef30 2023-11-28T17:40:09.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99413b400 con 0x7fc9940cef30 2023-11-28T17:40:09.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc9840b2040 con 0x7fc9940cef30 2023-11-28T17:40:09.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.355+0000 7fc98a7fc640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc978066900 0x7fc978068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.359+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc98411de40 con 0x7fc9940cef30 2023-11-28T17:40:09.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.359+0000 7fc999a9d640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc978066900 0x7fc978068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.359+0000 7fc999a9d640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc978066900 0x7fc978068dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc994141700 tx=0x7fc990001dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:09.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.359+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9840eb110 con 0x7fc9940cef30 2023-11-28T17:40:09.523 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.519+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc994068860 con 0x7fc9940cef30 2023-11-28T17:40:09.524 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.519+0000 7fc98a7fc640 1 -- 172.21.15.16:0/157106228 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fc9840ee730 con 0x7fc9940cef30 2023-11-28T17:40:09.525 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:09.525 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc978066900 msgr2=0x7fc978068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc978066900 0x7fc978068dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc994141700 tx=0x7fc990001dd0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 msgr2=0x7fc994159cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 0x7fc994159cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc984000c10 tx=0x7fc984018f60 comp rx=0 tx=0).stop 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 shutdown_connections 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc994144c80 0x7fc994140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc9940cef30 0x7fc994159cb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.527 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc978066900 0x7fc978068dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 --2- 172.21.15.16:0/157106228 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc994070dd0 0x7fc9941379b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 >> 172.21.15.16:0/157106228 conn(0x7fc99406a5a0 msgr2=0x7fc99415bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:09.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 shutdown_connections 2023-11-28T17:40:09.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.523+0000 7fc99bd01640 1 -- 172.21.15.16:0/157106228 wait complete. 2023-11-28T17:40:09.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:09.546 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:09.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 Processor -- start 2023-11-28T17:40:09.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 -- start start 2023-11-28T17:40:09.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb98144c80 0x7feb980cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7feb980cf640 0x7feb98070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb980ce4f0 con 0x7feb980cdf00 2023-11-28T17:40:09.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb980709b0 con 0x7feb98144c80 2023-11-28T17:40:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9cf80640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb98145060 con 0x7feb980cf640 2023-11-28T17:40:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9659c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feb98144c80 0x7feb980cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb8ffff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7feb980cdf00 0x7feb980cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43916/0 (socket says 172.21.15.16:43916) 2023-11-28T17:40:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb8ffff640 1 -- 172.21.15.16:0/1793526600 learned_addr learned my addr 172.21.15.16:0/1793526600 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb96d9d640 1 --2- 172.21.15.16:0/1793526600 >> v2:172.21.15.64:3300/0 conn(0x7feb980cf640 0x7feb98070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9659c640 1 -- 172.21.15.16:0/1793526600 >> v2:172.21.15.64:3300/0 conn(0x7feb980cf640 msgr2=0x7feb98070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9659c640 1 --2- 172.21.15.16:0/1793526600 >> v2:172.21.15.64:3300/0 conn(0x7feb980cf640 0x7feb98070dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9659c640 1 -- 172.21.15.16:0/1793526600 >> v1:172.21.15.16:6789/0 conn(0x7feb980cdf00 legacy=0x7feb980cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb9659c640 1 -- 172.21.15.16:0/1793526600 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980ce7d0 con 0x7feb98144c80 2023-11-28T17:40:09.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.691+0000 7feb95d9b640 1 -- 172.21.15.16:0/1793526600 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240251952 0 0) 0x7feb980ce4f0 con 0x7feb980cdf00 2023-11-28T17:40:09.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9659c640 1 --2- 172.21.15.16:0/1793526600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980cd9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb9806b4e0 tx=0x7feb8801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20cc8feca8c844ce server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:09.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb95d9b640 1 -- 172.21.15.16:0/1793526600 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880ab600 con 0x7feb98144c80 2023-11-28T17:40:09.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb95d9b640 1 -- 172.21.15.16:0/1793526600 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880a7050 con 0x7feb98144c80 2023-11-28T17:40:09.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb95d9b640 1 -- 172.21.15.16:0/1793526600 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb880ab980 con 0x7feb98144c80 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 -- 172.21.15.16:0/1793526600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 msgr2=0x7feb980cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 --2- 172.21.15.16:0/1793526600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980cd9c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb9806b4e0 tx=0x7feb8801c460 comp rx=0 tx=0).stop 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 -- 172.21.15.16:0/1793526600 shutdown_connections 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 --2- 172.21.15.16:0/1793526600 >> v2:172.21.15.64:3300/0 conn(0x7feb980cf640 0x7feb98070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 --2- 172.21.15.16:0/1793526600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980cd9c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 -- 172.21.15.16:0/1793526600 >> 172.21.15.16:0/1793526600 conn(0x7feb9806a5a0 msgr2=0x7feb9806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 -- 172.21.15.16:0/1793526600 shutdown_connections 2023-11-28T17:40:09.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.695+0000 7feb9cf80640 1 -- 172.21.15.16:0/1793526600 wait complete. 2023-11-28T17:40:09.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 Processor -- start 2023-11-28T17:40:09.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- start start 2023-11-28T17:40:09.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feb980cdf00 0x7feb981f9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb980cf640 0x7feb98158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981f9870 con 0x7feb98144c80 2023-11-28T17:40:09.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981f9b50 con 0x7feb980cf640 2023-11-28T17:40:09.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb981f9e30 con 0x7feb980cdf00 2023-11-28T17:40:09.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55296/0 (socket says 172.21.15.16:55296) 2023-11-28T17:40:09.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 -- 172.21.15.16:0/4133327379 learned_addr learned my addr 172.21.15.16:0/4133327379 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:09.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb8ffff640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb980cf640 0x7feb98158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 -- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feb980cdf00 msgr2=0x7feb981f9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feb980cdf00 0x7feb981f9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 -- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb980cf640 msgr2=0x7feb98158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb980cf640 0x7feb98158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 -- 172.21.15.16:0/4133327379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009420 con 0x7feb98144c80 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb8ffff640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb980cf640 0x7feb98158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb96d9d640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980b01a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb90007e30 tx=0x7feb9000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90014620 con 0x7feb98144c80 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9000ee90 con 0x7feb98144c80 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9813be80 con 0x7feb98144c80 2023-11-28T17:40:09.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900149c0 con 0x7feb98144c80 2023-11-28T17:40:09.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb981f9580 con 0x7feb98144c80 2023-11-28T17:40:09.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.699+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb98068860 con 0x7feb98144c80 2023-11-28T17:40:09.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.703+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feb90014b20 con 0x7feb98144c80 2023-11-28T17:40:09.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.703+0000 7feb8effd640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb780668d0 0x7feb78068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:09.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.703+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb90084e10 con 0x7feb98144c80 2023-11-28T17:40:09.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.703+0000 7feb9659c640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb780668d0 0x7feb78068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:09.708 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.703+0000 7feb9659c640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb780668d0 0x7feb78068d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb880ad000 tx=0x7feb88004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:09.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.707+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb90088030 con 0x7feb98144c80 2023-11-28T17:40:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.867+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb980cf400 con 0x7feb98144c80 2023-11-28T17:40:09.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.867+0000 7feb8effd640 1 -- 172.21.15.16:0/4133327379 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb90052040 con 0x7feb98144c80 2023-11-28T17:40:09.871 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb780668d0 msgr2=0x7feb78068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb780668d0 0x7feb78068d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7feb880ad000 tx=0x7feb88004740 comp rx=0 tx=0).stop 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 msgr2=0x7feb980b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980b01a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb90007e30 tx=0x7feb9000e4b0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 shutdown_connections 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feb98144c80 0x7feb980b01a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7feb780668d0 0x7feb78068d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feb980cf640 0x7feb98158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 --2- 172.21.15.16:0/4133327379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feb980cdf00 0x7feb981f9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:09.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 >> 172.21.15.16:0/4133327379 conn(0x7feb9806a5a0 msgr2=0x7feb980ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:09.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 shutdown_connections 2023-11-28T17:40:09.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:09.871+0000 7feb9cf80640 1 -- 172.21.15.16:0/4133327379 wait complete. 2023-11-28T17:40:09.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:10.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e3301640 1 Processor -- start 2023-11-28T17:40:10.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e3301640 1 -- start start 2023-11-28T17:40:10.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e3301640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f41dc072090 0x7f41dc0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e3301640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc15a8b0 con 0x7f41dc1548e0 2023-11-28T17:40:10.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e3301640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41dc0cea50 con 0x7f41dc15b350 2023-11-28T17:40:10.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e3301640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41dc0ce860 con 0x7f41dc072090 2023-11-28T17:40:10.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e109d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f41dc1548e0 0x7f41dc0ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43920/0 (socket says 172.21.15.16:43920) 2023-11-28T17:40:10.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.035+0000 7f41e109d640 1 -- 172.21.15.16:0/2929014431 learned_addr learned my addr 172.21.15.16:0/2929014431 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:10.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e089c640 1 --2- 172.21.15.16:0/2929014431 >> v2:172.21.15.64:3300/0 conn(0x7f41dc072090 0x7f41dc0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614302323 0 0) 0x7f41dc15a8b0 con 0x7f41dc1548e0 2023-11-28T17:40:10.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c8003530 con 0x7f41dc1548e0 2023-11-28T17:40:10.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986153095 0 0) 0x7f41dc0cea50 con 0x7f41dc15b350 2023-11-28T17:40:10.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41dc15a8b0 con 0x7f41dc15b350 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241955361 0 0) 0x7f41c8003530 con 0x7f41dc1548e0 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 >> v2:172.21.15.64:3300/0 conn(0x7f41dc072090 msgr2=0x7f41dc0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 --2- 172.21.15.16:0/2929014431 >> v2:172.21.15.64:3300/0 conn(0x7f41dc072090 0x7f41dc0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 >> v1:172.21.15.64:6789/0 conn(0x7f41dc15b350 legacy=0x7f41dc0cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc15ab50 con 0x7f41dc1548e0 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f41d8001680 con 0x7f41dc1548e0 2023-11-28T17:40:10.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 >> v1:172.21.15.16:6789/0 conn(0x7f41dc1548e0 legacy=0x7f41dc0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8003b10 0x7f41c8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c80047d0 0x7f41c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41c8005190 0x7f41c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c800bfe0 con 0x7f41c8005190 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c800c150 con 0x7f41c80047d0 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c800c310 con 0x7f41c8003b10 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41c8005190 0x7f41c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e089c640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c80047d0 0x7f41c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e109d640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8003b10 0x7f41c8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 -- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8003b10 msgr2=0x7f41c8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:10.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8003b10 0x7f41c8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 -- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c80047d0 msgr2=0x7f41c8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:10.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41c80047d0 0x7f41c8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 -- 172.21.15.16:0/2929014431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c8003530 con 0x7f41c8005190 2023-11-28T17:40:10.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.039+0000 7f41e189e640 1 -- 172.21.15.16:0/2929014431 reap_dead start 2023-11-28T17:40:10.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e189e640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41c8005190 0x7f41c800b990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41d4001fd0 tx=0x7f41d401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f828d88ca3f5d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4003b80 con 0x7f41c8005190 2023-11-28T17:40:10.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d4003ce0 con 0x7f41c8005190 2023-11-28T17:40:10.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41d3fff640 1 -- 172.21.15.16:0/2929014431 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4005310 con 0x7f41c8005190 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- 172.21.15.16:0/2929014431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41c8005190 msgr2=0x7f41c800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41c8005190 0x7f41c800b990 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41d4001fd0 tx=0x7f41d401c8e0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- 172.21.15.16:0/2929014431 shutdown_connections 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 --2- 172.21.15.16:0/2929014431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41c8005190 0x7f41c800b990 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- 172.21.15.16:0/2929014431 >> 172.21.15.16:0/2929014431 conn(0x7f41dc06a5a0 msgr2=0x7f41dc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- 172.21.15.16:0/2929014431 shutdown_connections 2023-11-28T17:40:10.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- 172.21.15.16:0/2929014431 wait complete. 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 Processor -- start 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- start start 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8005190 0x7f41dc139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc13d7c0 0x7f41dc0ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 0x7f41dc14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc0cd9b0 con 0x7f41dc0cd520 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc13a030 con 0x7f41dc13d7c0 2023-11-28T17:40:10.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.043+0000 7f41e3301640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41dc143790 con 0x7f41c8005190 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 0x7f41dc14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 0x7f41dc14dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55320/0 (socket says 172.21.15.16:55320) 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e109d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8005190 0x7f41dc139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e089c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc13d7c0 0x7f41dc0ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 -- 172.21.15.16:0/3254677023 learned_addr learned my addr 172.21.15.16:0/3254677023 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 -- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8005190 msgr2=0x7f41dc139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8005190 0x7f41dc139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 -- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc13d7c0 msgr2=0x7f41dc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc13d7c0 0x7f41dc0ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 -- 172.21.15.16:0/3254677023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41dc143a70 con 0x7f41dc0cd520 2023-11-28T17:40:10.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e189e640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 0x7f41dc14dec0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f41d401d180 tx=0x7f41c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.054 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d4003b80 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d40a55d0 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40a5960 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41dc143d50 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41dc144310 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41dc0cff40 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.047+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41d40a5ac0 con 0x7f41dc0cd520 2023-11-28T17:40:10.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.051+0000 7f41d1ffb640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41c0066900 0x7f41c0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.051+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41d411dd20 con 0x7f41dc0cd520 2023-11-28T17:40:10.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.051+0000 7f41e109d640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41c0066900 0x7f41c0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.051+0000 7f41e109d640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41c0066900 0x7f41c0068dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41d80054e0 tx=0x7f41d8000bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.055+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41d40eaf50 con 0x7f41dc0cd520 2023-11-28T17:40:10.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.211+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f41dc068860 con 0x7f41dc0cd520 2023-11-28T17:40:10.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41d1ffb640 1 -- 172.21.15.16:0/3254677023 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41d40ee570 con 0x7f41dc0cd520 2023-11-28T17:40:10.217 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41c0066900 msgr2=0x7f41c0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41c0066900 0x7f41c0068dc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f41d80054e0 tx=0x7f41d8000bd0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 msgr2=0x7f41dc14dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 0x7f41dc14dec0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f41d401d180 tx=0x7f41c8005800 comp rx=0 tx=0).stop 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 shutdown_connections 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41dc0cd520 0x7f41dc14dec0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f41c0066900 0x7f41c0068dc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41dc13d7c0 0x7f41dc0ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 --2- 172.21.15.16:0/3254677023 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41c8005190 0x7f41dc139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 >> 172.21.15.16:0/3254677023 conn(0x7f41dc06a5a0 msgr2=0x7f41dc15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 shutdown_connections 2023-11-28T17:40:10.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.215+0000 7f41e3301640 1 -- 172.21.15.16:0/3254677023 wait complete. 2023-11-28T17:40:10.238 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.379+0000 7fd94aff8640 1 Processor -- start 2023-11-28T17:40:10.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.379+0000 7fd94aff8640 1 -- start start 2023-11-28T17:40:10.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd94aff8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440aed60 0x7fd944144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd94aff8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd9441616b0 0x7fd9440b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd94aff8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94406ae00 con 0x7fd9440b2b70 2023-11-28T17:40:10.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd94aff8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94406a5a0 con 0x7fd9441616b0 2023-11-28T17:40:10.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd94aff8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440b34f0 con 0x7fd9440aed60 2023-11-28T17:40:10.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd948d94640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440aed60 0x7fd944144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd948d94640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440aed60 0x7fd944144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:42852/0 (socket says 172.21.15.16:42852) 2023-11-28T17:40:10.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd948d94640 1 -- 172.21.15.16:0/2866894868 learned_addr learned my addr 172.21.15.16:0/2866894868 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:10.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd949595640 1 --2- 172.21.15.16:0/2866894868 >> v2:172.21.15.64:3300/0 conn(0x7fd9441616b0 0x7fd9440b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd949595640 1 -- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440aed60 msgr2=0x7fd944144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:10.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd949595640 1 --2- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440aed60 0x7fd944144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd949595640 1 -- 172.21.15.16:0/2866894868 >> v1:172.21.15.64:6789/0 conn(0x7fd9440b2b70 legacy=0x7fd944160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.383+0000 7fd949595640 1 -- 172.21.15.16:0/2866894868 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944161cd0 con 0x7fd9441616b0 2023-11-28T17:40:10.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd949595640 1 --2- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440b2fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009d90 tx=0x7fd93c01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b3758c7b08b19 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd9437fe640 1 -- 172.21.15.16:0/2866894868 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0a5870 con 0x7fd9441616b0 2023-11-28T17:40:10.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd9437fe640 1 -- 172.21.15.16:0/2866894868 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c0a59d0 con 0x7fd9441616b0 2023-11-28T17:40:10.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd9437fe640 1 -- 172.21.15.16:0/2866894868 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c0a5d60 con 0x7fd9441616b0 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 -- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 msgr2=0x7fd9440b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440b2fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009d90 tx=0x7fd93c01c8c0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 -- 172.21.15.16:0/2866894868 shutdown_connections 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440b2fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2866894868 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440aed60 0x7fd944144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 -- 172.21.15.16:0/2866894868 >> 172.21.15.16:0/2866894868 conn(0x7fd9440b1de0 msgr2=0x7fd9440cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 -- 172.21.15.16:0/2866894868 shutdown_connections 2023-11-28T17:40:10.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 -- 172.21.15.16:0/2866894868 wait complete. 2023-11-28T17:40:10.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 Processor -- start 2023-11-28T17:40:10.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.387+0000 7fd94aff8640 1 -- start start 2023-11-28T17:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 0x7fd9440ceb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440b2b70 0x7fd9440adae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440ae020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440ad650 con 0x7fd9440aed60 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9440ad040 con 0x7fd9441616b0 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd944156010 con 0x7fd9440b2b70 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 0x7fd9440ceb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 0x7fd9440ceb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55330/0 (socket says 172.21.15.16:55330) 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 -- 172.21.15.16:0/2984110376 learned_addr learned my addr 172.21.15.16:0/2984110376 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd949595640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd943fff640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440b2b70 0x7fd9440adae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 -- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440b2b70 msgr2=0x7fd9440adae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440b2b70 0x7fd9440adae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 -- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 msgr2=0x7fd9440ae020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440ae020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 -- 172.21.15.16:0/2984110376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c009a70 con 0x7fd9440aed60 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd949595640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd943fff640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440b2b70 0x7fd9440adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd948d94640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 0x7fd9440ceb80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd93800e7f0 tx=0x7fd93800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd938009580 con 0x7fd9440aed60 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93800c940 con 0x7fd9440aed60 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93800ccf0 con 0x7fd9440aed60 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9440ad2e0 con 0x7fd9440aed60 2023-11-28T17:40:10.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9441562f0 con 0x7fd9440aed60 2023-11-28T17:40:10.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.391+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd944068860 con 0x7fd9440aed60 2023-11-28T17:40:10.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.395+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd938013470 con 0x7fd9440aed60 2023-11-28T17:40:10.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.395+0000 7fd9417fa640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd928066920 0x7fd928068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.395+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd938084cb0 con 0x7fd9440aed60 2023-11-28T17:40:10.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.395+0000 7fd943fff640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd928066920 0x7fd928068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.395+0000 7fd943fff640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd928066920 0x7fd928068de0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9440cfeb0 tx=0x7fd930009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.399+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd938051f60 con 0x7fd9440aed60 2023-11-28T17:40:10.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.555+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd94415b9c0 con 0x7fd9440aed60 2023-11-28T17:40:10.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.555+0000 7fd9417fa640 1 -- 172.21.15.16:0/2984110376 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd9380210a0 con 0x7fd9440aed60 2023-11-28T17:40:10.560 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd928066920 msgr2=0x7fd928068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd928066920 0x7fd928068de0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd9440cfeb0 tx=0x7fd930009040 comp rx=0 tx=0).stop 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 msgr2=0x7fd9440ceb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 0x7fd9440ceb80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd93800e7f0 tx=0x7fd93800ecb0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 shutdown_connections 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd928066920 0x7fd928068de0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd9441616b0 0x7fd9440ae020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd9440b2b70 0x7fd9440adae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 --2- 172.21.15.16:0/2984110376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd9440aed60 0x7fd9440ceb80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 >> 172.21.15.16:0/2984110376 conn(0x7fd9440b1de0 msgr2=0x7fd94415f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:10.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 shutdown_connections 2023-11-28T17:40:10.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.559+0000 7fd94aff8640 1 -- 172.21.15.16:0/2984110376 wait complete. 2023-11-28T17:40:10.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T17:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.723+0000 7fe2f8f01640 1 Processor -- start 2023-11-28T17:40:10.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.723+0000 7fe2f8f01640 1 -- start start 2023-11-28T17:40:10.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.723+0000 7fe2f8f01640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2f4072090 0x7fe2f40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.723+0000 7fe2f8f01640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f415a8b0 con 0x7fe2f41548e0 2023-11-28T17:40:10.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f8f01640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2f40cea50 con 0x7fe2f415b350 2023-11-28T17:40:10.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f8f01640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2f40ce860 con 0x7fe2f4072090 2023-11-28T17:40:10.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f259c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe2f41548e0 0x7fe2f40ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43932/0 (socket says 172.21.15.16:43932) 2023-11-28T17:40:10.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f259c640 1 -- 172.21.15.16:0/2992758325 learned_addr learned my addr 172.21.15.16:0/2992758325 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2ebfff640 1 --2- 172.21.15.16:0/2992758325 >> v2:172.21.15.64:3300/0 conn(0x7fe2f4072090 0x7fe2f40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3844286087 0 0) 0x7fe2f415a8b0 con 0x7fe2f41548e0 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2e0003530 con 0x7fe2f41548e0 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475062350 0 0) 0x7fe2f40cea50 con 0x7fe2f415b350 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f415a8b0 con 0x7fe2f415b350 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2090549507 0 0) 0x7fe2e0003530 con 0x7fe2f41548e0 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2ebfff640 1 -- 172.21.15.16:0/2992758325 >> v1:172.21.15.64:6789/0 conn(0x7fe2f415b350 legacy=0x7fe2f40cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.730 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2ebfff640 1 -- 172.21.15.16:0/2992758325 >> v1:172.21.15.16:6789/0 conn(0x7fe2f41548e0 legacy=0x7fe2f40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2ebfff640 1 -- 172.21.15.16:0/2992758325 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f415ab50 con 0x7fe2f4072090 2023-11-28T17:40:10.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.727+0000 7fe2ebfff640 1 --2- 172.21.15.16:0/2992758325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f4072090 0x7fe2f40cef30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0097c0 tx=0x7fe2dc01c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80d0780469af0cd4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4001680 con 0x7fe2f4072090 2023-11-28T17:40:10.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc0a7050 con 0x7fe2f4072090 2023-11-28T17:40:10.733 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f1d9b640 1 -- 172.21.15.16:0/2992758325 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc0ab620 con 0x7fe2f4072090 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- 172.21.15.16:0/2992758325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f4072090 msgr2=0x7fe2f40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/2992758325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f4072090 0x7fe2f40cef30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc0097c0 tx=0x7fe2dc01c3a0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- 172.21.15.16:0/2992758325 shutdown_connections 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/2992758325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f4072090 0x7fe2f40cef30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- 172.21.15.16:0/2992758325 >> 172.21.15.16:0/2992758325 conn(0x7fe2f406a5a0 msgr2=0x7fe2f406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- 172.21.15.16:0/2992758325 shutdown_connections 2023-11-28T17:40:10.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- 172.21.15.16:0/2992758325 wait complete. 2023-11-28T17:40:10.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 Processor -- start 2023-11-28T17:40:10.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- start start 2023-11-28T17:40:10.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2f4072090 0x7fe2f4146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.737 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f41548e0 0x7fe2f4134680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 0x7fe2f4153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4142f40 con 0x7fe2f415b350 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4143220 con 0x7fe2f41548e0 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f8f01640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f4143500 con 0x7fe2f4072090 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.731+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 0x7fe2f4153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 0x7fe2f4153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55334/0 (socket says 172.21.15.16:55334) 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 -- 172.21.15.16:0/791670679 learned_addr learned my addr 172.21.15.16:0/791670679 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f259c640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2f4072090 0x7fe2f4146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2ebfff640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f41548e0 0x7fe2f4134680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 -- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2f4072090 msgr2=0x7fe2f4146dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2f4072090 0x7fe2f4146dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 -- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f41548e0 msgr2=0x7fe2f4134680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f41548e0 0x7fe2f4134680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 -- 172.21.15.16:0/791670679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2dc009420 con 0x7fe2f415b350 2023-11-28T17:40:10.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f2d9d640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 0x7fe2f4153710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c730 tx=0x7fe2ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec003b80 con 0x7fe2f415b350 2023-11-28T17:40:10.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec003ce0 con 0x7fe2f415b350 2023-11-28T17:40:10.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2f41437e0 con 0x7fe2f415b350 2023-11-28T17:40:10.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec00aa90 con 0x7fe2f415b350 2023-11-28T17:40:10.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2f4150f70 con 0x7fe2f415b350 2023-11-28T17:40:10.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2f4068860 con 0x7fe2f415b350 2023-11-28T17:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe2ec00abf0 con 0x7fe2f415b350 2023-11-28T17:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2eaffd640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe2d40668d0 0x7fe2d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.735+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2ec0843f0 con 0x7fe2f415b350 2023-11-28T17:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.739+0000 7fe2f259c640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe2d40668d0 0x7fe2d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.739+0000 7fe2f259c640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe2d40668d0 0x7fe2d4068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000f70 tx=0x7fe2e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:10.744 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.739+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe2ec051500 con 0x7fe2f415b350 2023-11-28T17:40:10.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.911+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe2f4143c90 con 0x7fe2f415b350 2023-11-28T17:40:10.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.911+0000 7fe2eaffd640 1 -- 172.21.15.16:0/791670679 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe2ec054b20 con 0x7fe2f415b350 2023-11-28T17:40:10.915 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-11-28T17:40:10.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe2d40668d0 msgr2=0x7fe2d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe2d40668d0 0x7fe2d4068d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000f70 tx=0x7fe2e4009040 comp rx=0 tx=0).stop 2023-11-28T17:40:10.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 msgr2=0x7fe2f4153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:10.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 0x7fe2f4153710 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec00c730 tx=0x7fe2ec00cbf0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 shutdown_connections 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe2f415b350 0x7fe2f4153710 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe2d40668d0 0x7fe2d4068d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2f41548e0 0x7fe2f4134680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 --2- 172.21.15.16:0/791670679 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe2f4072090 0x7fe2f4146dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 >> 172.21.15.16:0/791670679 conn(0x7fe2f406a5a0 msgr2=0x7fe2f414d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 shutdown_connections 2023-11-28T17:40:10.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:10.915+0000 7fe2f8f01640 1 -- 172.21.15.16:0/791670679 wait complete. 2023-11-28T17:40:10.936 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-28T17:40:10.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:10.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-28T17:40:10.961 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-11-28T17:40:10.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:10.961 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-28T17:40:11.013 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:40:11.013 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:11.024 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:40:11.024 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:11.077 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-28T17:40:11.078 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:11.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:11.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 Processor -- start 2023-11-28T17:40:11.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 -- start start 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f89800d1f50 0x7f89800d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f89800d34c0 0x7f89800cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898015d920 con 0x7f89800d34c0 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89800b32c0 con 0x7f89800d1f50 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f8985db8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89800b35a0 con 0x7f898015d540 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f89800d34c0 0x7f89800cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f89800d34c0 0x7f89800cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55344/0 (socket says 172.21.15.16:55344) 2023-11-28T17:40:11.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 -- 172.21.15.16:0/970159167 learned_addr learned my addr 172.21.15.16:0/970159167 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897effd640 1 --2- 172.21.15.16:0/970159167 >> v2:172.21.15.64:3300/0 conn(0x7f89800d1f50 0x7f89800d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897f7fe640 1 --2- 172.21.15.16:0/970159167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 -- 172.21.15.16:0/970159167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 msgr2=0x7f89800b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 --2- 172.21.15.16:0/970159167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 -- 172.21.15.16:0/970159167 >> v2:172.21.15.64:3300/0 conn(0x7f89800d1f50 msgr2=0x7f89800d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 --2- 172.21.15.16:0/970159167 >> v2:172.21.15.64:3300/0 conn(0x7f89800d1f50 0x7f89800d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897ffff640 1 -- 172.21.15.16:0/970159167 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89800b3880 con 0x7f89800d34c0 2023-11-28T17:40:11.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.275+0000 7f897effd640 1 --2- 172.21.15.16:0/970159167 >> v2:172.21.15.64:3300/0 conn(0x7f89800d1f50 0x7f89800d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:11.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f897ffff640 1 --2- 172.21.15.16:0/970159167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f89800cfbc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89800d0e80 tx=0x7f897801c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27d88b8b543a94a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f897e7fc640 1 -- 172.21.15.16:0/970159167 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780a5560 con 0x7f89800d34c0 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f897e7fc640 1 -- 172.21.15.16:0/970159167 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89780a56c0 con 0x7f89800d34c0 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f897e7fc640 1 -- 172.21.15.16:0/970159167 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780a5a50 con 0x7f89800d34c0 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 -- 172.21.15.16:0/970159167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 msgr2=0x7f89800cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 --2- 172.21.15.16:0/970159167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f89800cfbc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f89800d0e80 tx=0x7f897801c6e0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 -- 172.21.15.16:0/970159167 shutdown_connections 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 --2- 172.21.15.16:0/970159167 >> v2:172.21.15.64:3300/0 conn(0x7f89800d1f50 0x7f89800d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 --2- 172.21.15.16:0/970159167 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f89800cfbc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 --2- 172.21.15.16:0/970159167 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 -- 172.21.15.16:0/970159167 >> 172.21.15.16:0/970159167 conn(0x7f898008ccf0 msgr2=0x7f898009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:11.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 -- 172.21.15.16:0/970159167 shutdown_connections 2023-11-28T17:40:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 -- 172.21.15.16:0/970159167 wait complete. 2023-11-28T17:40:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.279+0000 7f8985db8640 1 Processor -- start 2023-11-28T17:40:11.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- start start 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89800d1f50 0x7f89800b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f898015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898015ce50 con 0x7f89800d34c0 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898015c5f0 con 0x7f89800d1f50 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898015c890 con 0x7f898015d540 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f898015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f898015c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55352/0 (socket says 172.21.15.16:55352) 2023-11-28T17:40:11.287 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 -- 172.21.15.16:0/2589639216 learned_addr learned my addr 172.21.15.16:0/2589639216 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897ffff640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897f7fe640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89800d1f50 0x7f89800b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 -- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 msgr2=0x7f89800b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 -- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89800d1f50 msgr2=0x7f89800b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89800d1f50 0x7f89800b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 -- 172.21.15.16:0/2589639216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8978009b30 con 0x7f89800d34c0 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897ffff640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:11.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f897effd640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f898015c0b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f897400e7e0 tx=0x7f897400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974004030 con 0x7f89800d34c0 2023-11-28T17:40:11.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8974004190 con 0x7f89800d34c0 2023-11-28T17:40:11.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974004500 con 0x7f89800d34c0 2023-11-28T17:40:11.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898015cb70 con 0x7f89800d34c0 2023-11-28T17:40:11.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89800b63e0 con 0x7f89800d34c0 2023-11-28T17:40:11.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.283+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89800b5f60 con 0x7f89800d34c0 2023-11-28T17:40:11.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.287+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f897400c6d0 con 0x7f89800d34c0 2023-11-28T17:40:11.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.287+0000 7f8967fff640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f896c0668d0 0x7f896c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.287+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8974084440 con 0x7f89800d34c0 2023-11-28T17:40:11.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.287+0000 7f897f7fe640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f896c0668d0 0x7f896c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.287+0000 7f897f7fe640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f896c0668d0 0x7f896c068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f897000b930 tx=0x7f8970008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.291+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89800b5f60 con 0x7f89800d34c0 2023-11-28T17:40:11.452 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.447+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89800b5f60 con 0x7f89800d34c0 2023-11-28T17:40:11.453 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8967fff640 1 -- 172.21.15.16:0/2589639216 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f89800b5f60 con 0x7f89800d34c0 2023-11-28T17:40:11.453 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:11.453 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:11.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f896c0668d0 msgr2=0x7f896c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f896c0668d0 0x7f896c068d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f897000b930 tx=0x7f8970008040 comp rx=0 tx=0).stop 2023-11-28T17:40:11.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 msgr2=0x7f898015c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f898015c0b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f897400e7e0 tx=0x7f897400eca0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 shutdown_connections 2023-11-28T17:40:11.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f898015d540 0x7f89800b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f89800d34c0 0x7f898015c0b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f896c0668d0 0x7f896c068d90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 --2- 172.21.15.16:0/2589639216 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89800d1f50 0x7f89800b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 >> 172.21.15.16:0/2589639216 conn(0x7f898008ccf0 msgr2=0x7f89800aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:11.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 shutdown_connections 2023-11-28T17:40:11.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.451+0000 7f8985db8640 1 -- 172.21.15.16:0/2589639216 wait complete. 2023-11-28T17:40:11.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:11.475 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:11.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 Processor -- start 2023-11-28T17:40:11.623 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 -- start start 2023-11-28T17:40:11.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f41ac15d540 0x7f41ac0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.624 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41ac0d1f50 0x7f41ac0d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41ac0b32c0 con 0x7f41ac0d34c0 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac15d920 con 0x7f41ac0d1f50 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.619+0000 7f41b3b1d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41ac0b35a0 con 0x7f41ac15d540 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41ac0d1f50 0x7f41ac0d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f41ac0d1f50 0x7f41ac0d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55354/0 (socket says 172.21.15.16:55354) 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 -- 172.21.15.16:0/3353603931 learned_addr learned my addr 172.21.15.16:0/3353603931 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:11.625 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b18b9640 1 --2- 172.21.15.16:0/3353603931 >> v2:172.21.15.64:3300/0 conn(0x7f41ac15d540 0x7f41ac0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 -- 172.21.15.16:0/3353603931 >> v2:172.21.15.64:3300/0 conn(0x7f41ac15d540 msgr2=0x7f41ac0b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:11.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 --2- 172.21.15.16:0/3353603931 >> v2:172.21.15.64:3300/0 conn(0x7f41ac15d540 0x7f41ac0b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 -- 172.21.15.16:0/3353603931 >> v1:172.21.15.64:6789/0 conn(0x7f41ac0d34c0 legacy=0x7f41ac0cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 -- 172.21.15.16:0/3353603931 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ac0b3880 con 0x7f41ac0d1f50 2023-11-28T17:40:11.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b18b9640 1 --2- 172.21.15.16:0/3353603931 >> v2:172.21.15.64:3300/0 conn(0x7f41ac15d540 0x7f41ac0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:11.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.623+0000 7f41b10b8640 1 --2- 172.21.15.16:0/3353603931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0d2f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41ac08cc80 tx=0x7f419c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99551a44df0d4fc5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b08b7640 1 -- 172.21.15.16:0/3353603931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0aa430 con 0x7f41ac0d1f50 2023-11-28T17:40:11.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b08b7640 1 -- 172.21.15.16:0/3353603931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c0aa590 con 0x7f41ac0d1f50 2023-11-28T17:40:11.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b08b7640 1 -- 172.21.15.16:0/3353603931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c0aa920 con 0x7f41ac0d1f50 2023-11-28T17:40:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- 172.21.15.16:0/3353603931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac0d1f50 msgr2=0x7f41ac0d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/3353603931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0d2f80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f41ac08cc80 tx=0x7f419c01c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.629 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- 172.21.15.16:0/3353603931 shutdown_connections 2023-11-28T17:40:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/3353603931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0d2f80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/3353603931 >> v2:172.21.15.64:3300/0 conn(0x7f41ac15d540 0x7f41ac0b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- 172.21.15.16:0/3353603931 >> 172.21.15.16:0/3353603931 conn(0x7f41ac08ccf0 msgr2=0x7f41ac09c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- 172.21.15.16:0/3353603931 shutdown_connections 2023-11-28T17:40:11.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- 172.21.15.16:0/3353603931 wait complete. 2023-11-28T17:40:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 Processor -- start 2023-11-28T17:40:11.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- start start 2023-11-28T17:40:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ac0d34c0 0x7f41ac1534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 0x7f41ac06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c73b0 con 0x7f41ac15d540 2023-11-28T17:40:11.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac0c8910 con 0x7f41ac0d1f50 2023-11-28T17:40:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.627+0000 7f41b3b1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41ac152010 con 0x7f41ac0d34c0 2023-11-28T17:40:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 0x7f41ac06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b10b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ac0d34c0 0x7f41ac1534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 0x7f41ac06c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55368/0 (socket says 172.21.15.16:55368) 2023-11-28T17:40:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 -- 172.21.15.16:0/1043948576 learned_addr learned my addr 172.21.15.16:0/1043948576 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:11.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b18b9640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 -- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ac0d34c0 msgr2=0x7f41ac1534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ac0d34c0 0x7f41ac1534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 -- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ac0d1f50 msgr2=0x7f41ac0c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 -- 172.21.15.16:0/1043948576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0094d0 con 0x7f41ac15d540 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b20ba640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 0x7f41ac06c640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c770 tx=0x7f41a400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a4003b80 con 0x7f41ac15d540 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41a4003ce0 con 0x7f41ac15d540 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41a400aa90 con 0x7f41ac15d540 2023-11-28T17:40:11.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41ac151a50 con 0x7f41ac15d540 2023-11-28T17:40:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41ac0c8bb0 con 0x7f41ac15d540 2023-11-28T17:40:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41ac0c8770 con 0x7f41ac15d540 2023-11-28T17:40:11.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.631+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f41a400abf0 con 0x7f41ac15d540 2023-11-28T17:40:11.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.635+0000 7f41a27fc640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4190066920 0x7f4190068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.635+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41a4084190 con 0x7f41ac15d540 2023-11-28T17:40:11.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.635+0000 7f41b18b9640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4190066920 0x7f4190068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.635+0000 7f41b18b9640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4190066920 0x7f4190068de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41a80045f0 tx=0x7f41a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.639+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f41ac0c8770 con 0x7f41ac15d540 2023-11-28T17:40:11.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f41ac0c8770 con 0x7f41ac15d540 2023-11-28T17:40:11.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41a27fc640 1 -- 172.21.15.16:0/1043948576 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f41ac0c8770 con 0x7f41ac15d540 2023-11-28T17:40:11.801 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4190066920 msgr2=0x7f4190068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4190066920 0x7f4190068de0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f41a80045f0 tx=0x7f41a8008040 comp rx=0 tx=0).stop 2023-11-28T17:40:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 msgr2=0x7f41ac06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 0x7f41ac06c640 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f41a400c770 tx=0x7f41a400cc30 comp rx=0 tx=0).stop 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 shutdown_connections 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f41ac15d540 0x7f41ac06c640 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f41ac0d34c0 0x7f41ac1534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4190066920 0x7f4190068de0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 --2- 172.21.15.16:0/1043948576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f41ac0d1f50 0x7f41ac0c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 >> 172.21.15.16:0/1043948576 conn(0x7f41ac08ccf0 msgr2=0x7f41ac0b4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 shutdown_connections 2023-11-28T17:40:11.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.799+0000 7f41b3b1d640 1 -- 172.21.15.16:0/1043948576 wait complete. 2023-11-28T17:40:11.823 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:11.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.963+0000 7f927aec9640 1 Processor -- start 2023-11-28T17:40:11.968 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.963+0000 7f927aec9640 1 -- start start 2023-11-28T17:40:11.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f927aec9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927415d620 0x7f92740cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f927aec9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f927406d300 0x7f9274161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f927aec9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92740cbcd0 con 0x7f927406e880 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f927aec9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9274161f70 con 0x7f927406d300 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f927aec9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740cee20 con 0x7f927415d620 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f927406d300 0x7f9274161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f927406d300 0x7f9274161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55374/0 (socket says 172.21.15.16:55374) 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 -- 172.21.15.16:0/1597726549 learned_addr learned my addr 172.21.15.16:0/1597726549 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:11.970 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9278c65640 1 --2- 172.21.15.16:0/1597726549 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927415d620 0x7f92740cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 -- 172.21.15.16:0/1597726549 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927415d620 msgr2=0x7f92740cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 --2- 172.21.15.16:0/1597726549 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927415d620 0x7f92740cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 -- 172.21.15.16:0/1597726549 >> v1:172.21.15.64:6789/0 conn(0x7f927406e880 legacy=0x7f92740d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.967+0000 7f9273fff640 1 -- 172.21.15.16:0/1597726549 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740cf100 con 0x7f927406d300 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f9273fff640 1 --2- 172.21.15.16:0/1597726549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927406d300 0x7f9274161a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9260009870 tx=0x7f926001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b325e6082ffa25 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f92737fe640 1 -- 172.21.15.16:0/1597726549 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600aa670 con 0x7f927406d300 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f92737fe640 1 -- 172.21.15.16:0/1597726549 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92600aa7d0 con 0x7f927406d300 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f92737fe640 1 -- 172.21.15.16:0/1597726549 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600aab60 con 0x7f927406d300 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 -- 172.21.15.16:0/1597726549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927406d300 msgr2=0x7f9274161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 --2- 172.21.15.16:0/1597726549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927406d300 0x7f9274161a30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9260009870 tx=0x7f926001c510 comp rx=0 tx=0).stop 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 -- 172.21.15.16:0/1597726549 shutdown_connections 2023-11-28T17:40:11.975 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 --2- 172.21.15.16:0/1597726549 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927406d300 0x7f9274161a30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 --2- 172.21.15.16:0/1597726549 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927415d620 0x7f92740cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 -- 172.21.15.16:0/1597726549 >> 172.21.15.16:0/1597726549 conn(0x7f927406a5a0 msgr2=0x7f927406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:11.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 -- 172.21.15.16:0/1597726549 shutdown_connections 2023-11-28T17:40:11.976 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 -- 172.21.15.16:0/1597726549 wait complete. 2023-11-28T17:40:11.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 Processor -- start 2023-11-28T17:40:11.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.971+0000 7f927aec9640 1 -- start start 2023-11-28T17:40:11.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f927406d300 0x7f9274155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927406e880 0x7f92740c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 0x7f92740ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740c9670 con 0x7f927415d620 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92740c8a60 con 0x7f927406d300 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92740c8d40 con 0x7f927406e880 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 0x7f92740ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 0x7f92740ca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55380/0 (socket says 172.21.15.16:55380) 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 -- 172.21.15.16:0/1709202826 learned_addr learned my addr 172.21.15.16:0/1709202826 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9278c65640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f927406d300 0x7f9274155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9273fff640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927406e880 0x7f92740c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 -- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927406e880 msgr2=0x7f92740c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927406e880 0x7f92740c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 -- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f927406d300 msgr2=0x7f9274155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:11.978 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f927406d300 0x7f9274155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:11.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 -- 172.21.15.16:0/1709202826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92600094d0 con 0x7f927415d620 2023-11-28T17:40:11.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f9279466640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 0x7f92740ca9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f926c00c770 tx=0x7f926c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.979 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c003b80 con 0x7f927415d620 2023-11-28T17:40:11.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c003ce0 con 0x7f927415d620 2023-11-28T17:40:11.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c00aa90 con 0x7f927415d620 2023-11-28T17:40:11.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927406f220 con 0x7f927415d620 2023-11-28T17:40:11.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92740c9300 con 0x7f927415d620 2023-11-28T17:40:11.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92740c97e0 con 0x7f927415d620 2023-11-28T17:40:11.980 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.975+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f926c00abf0 con 0x7f927415d620 2023-11-28T17:40:11.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.979+0000 7f92717fa640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:11.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.979+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f926c0840a0 con 0x7f927415d620 2023-11-28T17:40:11.981 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.979+0000 7f9278c65640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:11.982 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.979+0000 7f9278c65640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f92740c7830 tx=0x7f9268009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:11.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:11.983+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f926c051420 con 0x7f927415d620 2023-11-28T17:40:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.139+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9274068860 con 0x7f927415d620 2023-11-28T17:40:12.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.139+0000 7f92717fa640 1 -- 172.21.15.16:0/1709202826 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f926c054a40 con 0x7f927415d620 2023-11-28T17:40:12.143 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:12.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.139+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 msgr2=0x7f9258068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.139+0000 7f927aec9640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f92740c7830 tx=0x7f9268009190 comp rx=0 tx=0).stop 2023-11-28T17:40:12.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.139+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 msgr2=0x7f92740ca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.139+0000 7f927aec9640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 0x7f92740ca9e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f926c00c770 tx=0x7f926c00cc30 comp rx=0 tx=0).stop 2023-11-28T17:40:12.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 shutdown_connections 2023-11-28T17:40:12.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f927415d620 0x7f92740ca9e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f927406e880 0x7f92740c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 --2- 172.21.15.16:0/1709202826 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f927406d300 0x7f9274155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 >> 172.21.15.16:0/1709202826 conn(0x7f927406a5a0 msgr2=0x7f927415ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:12.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 shutdown_connections 2023-11-28T17:40:12.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.143+0000 7f927aec9640 1 -- 172.21.15.16:0/1709202826 wait complete. 2023-11-28T17:40:12.167 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:12.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 Processor -- start 2023-11-28T17:40:12.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 -- start start 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f42c41548e0 0x7f42c40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42c40cf640 0x7f42c40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c415a8b0 con 0x7f42c4072090 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c415a6a0 con 0x7f42c40cf640 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42cc52a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40ced30 con 0x7f42c41548e0 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42c40cf640 0x7f42c40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f42c40cf640 0x7f42c40cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55388/0 (socket says 172.21.15.16:55388) 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 -- 172.21.15.16:0/2358044089 learned_addr learned my addr 172.21.15.16:0/2358044089 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:12.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42ca2c6640 1 --2- 172.21.15.16:0/2358044089 >> v2:172.21.15.64:3300/0 conn(0x7f42c41548e0 0x7f42c40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 -- 172.21.15.16:0/2358044089 >> v2:172.21.15.64:3300/0 conn(0x7f42c41548e0 msgr2=0x7f42c40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 --2- 172.21.15.16:0/2358044089 >> v2:172.21.15.64:3300/0 conn(0x7f42c41548e0 0x7f42c40ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 -- 172.21.15.16:0/2358044089 >> v1:172.21.15.64:6789/0 conn(0x7f42c4072090 legacy=0x7f42c40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.311+0000 7f42caac7640 1 -- 172.21.15.16:0/2358044089 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40cea50 con 0x7f42c40cf640 2023-11-28T17:40:12.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42caac7640 1 --2- 172.21.15.16:0/2358044089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c40cf640 0x7f42c40cc970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f42c40744c0 tx=0x7f42bc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a602f7018143e269 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:12.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42c92c4640 1 -- 172.21.15.16:0/2358044089 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0a5860 con 0x7f42c40cf640 2023-11-28T17:40:12.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42c92c4640 1 -- 172.21.15.16:0/2358044089 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0a59c0 con 0x7f42c40cf640 2023-11-28T17:40:12.319 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42c92c4640 1 -- 172.21.15.16:0/2358044089 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0a5d50 con 0x7f42c40cf640 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 -- 172.21.15.16:0/2358044089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c40cf640 msgr2=0x7f42c40cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 --2- 172.21.15.16:0/2358044089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c40cf640 0x7f42c40cc970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f42c40744c0 tx=0x7f42bc01c9a0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 -- 172.21.15.16:0/2358044089 shutdown_connections 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 --2- 172.21.15.16:0/2358044089 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c40cf640 0x7f42c40cc970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 --2- 172.21.15.16:0/2358044089 >> v2:172.21.15.64:3300/0 conn(0x7f42c41548e0 0x7f42c40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 -- 172.21.15.16:0/2358044089 >> 172.21.15.16:0/2358044089 conn(0x7f42c406a5a0 msgr2=0x7f42c406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 -- 172.21.15.16:0/2358044089 shutdown_connections 2023-11-28T17:40:12.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.315+0000 7f42cc52a640 1 -- 172.21.15.16:0/2358044089 wait complete. 2023-11-28T17:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 Processor -- start 2023-11-28T17:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 -- start start 2023-11-28T17:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42c4072090 0x7f42c414d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42c40cf640 0x7f42c4155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 0x7f42c41566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4154d60 con 0x7f42c41548e0 2023-11-28T17:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4155600 con 0x7f42c4072090 2023-11-28T17:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41573a0 con 0x7f42c40cf640 2023-11-28T17:40:12.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 0x7f42c41566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42ca2c6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42c4072090 0x7f42c414d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 0x7f42c41566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55396/0 (socket says 172.21.15.16:55396) 2023-11-28T17:40:12.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 -- 172.21.15.16:0/756177621 learned_addr learned my addr 172.21.15.16:0/756177621 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:12.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42c9ac5640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42c40cf640 0x7f42c4155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 -- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42c40cf640 msgr2=0x7f42c4155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42c40cf640 0x7f42c4155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 -- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42c4072090 msgr2=0x7f42c414d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42c4072090 0x7f42c414d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 -- 172.21.15.16:0/756177621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc009b30 con 0x7f42c41548e0 2023-11-28T17:40:12.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42c9ac5640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42c40cf640 0x7f42c4155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42caac7640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 0x7f42c41566e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0af040 tx=0x7f42bc019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0b8670 con 0x7f42c41548e0 2023-11-28T17:40:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0b87d0 con 0x7f42c41548e0 2023-11-28T17:40:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0b8b80 con 0x7f42c41548e0 2023-11-28T17:40:12.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c41570c0 con 0x7f42c41548e0 2023-11-28T17:40:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.319+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4155220 con 0x7f42c41548e0 2023-11-28T17:40:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.323+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c4155740 con 0x7f42c41548e0 2023-11-28T17:40:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.323+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f42bc0b8ce0 con 0x7f42c41548e0 2023-11-28T17:40:12.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.323+0000 7f42baffd640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f42a8066920 0x7f42a8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.323+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42bc11f9a0 con 0x7f42c41548e0 2023-11-28T17:40:12.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.323+0000 7f42ca2c6640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f42a8066920 0x7f42a8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.323+0000 7f42ca2c6640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f42a8066920 0x7f42a8068de0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42c00079c0 tx=0x7f42c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:12.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.327+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42bc0ecd90 con 0x7f42c41548e0 2023-11-28T17:40:12.487 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.483+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42c4068860 con 0x7f42c41548e0 2023-11-28T17:40:12.488 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.483+0000 7f42baffd640 1 -- 172.21.15.16:0/756177621 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42bc0bc0a0 con 0x7f42c41548e0 2023-11-28T17:40:12.488 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:12.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f42a8066920 msgr2=0x7f42a8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f42a8066920 0x7f42a8068de0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f42c00079c0 tx=0x7f42c0008040 comp rx=0 tx=0).stop 2023-11-28T17:40:12.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 msgr2=0x7f42c41566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 0x7f42c41566e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0af040 tx=0x7f42bc019740 comp rx=0 tx=0).stop 2023-11-28T17:40:12.490 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 shutdown_connections 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f42c41548e0 0x7f42c41566e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f42c40cf640 0x7f42c4155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f42a8066920 0x7f42a8068de0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 --2- 172.21.15.16:0/756177621 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f42c4072090 0x7f42c414d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 >> 172.21.15.16:0/756177621 conn(0x7f42c406a5a0 msgr2=0x7f42c40b3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 shutdown_connections 2023-11-28T17:40:12.491 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.487+0000 7f42cc52a640 1 -- 172.21.15.16:0/756177621 wait complete. 2023-11-28T17:40:12.509 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T17:40:12.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dfc32640 1 Processor -- start 2023-11-28T17:40:12.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dfc32640 1 -- start start 2023-11-28T17:40:12.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dfc32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d806ca40 0x7fe8d815a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dfc32640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d8070700 con 0x7fe8d81574c0 2023-11-28T17:40:12.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dfc32640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d815ad80 con 0x7fe8d80cf8a0 2023-11-28T17:40:12.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dfc32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d8070950 con 0x7fe8d806ca40 2023-11-28T17:40:12.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dd9ce640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fe8d81574c0 0x7fe8d806c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43942/0 (socket says 172.21.15.16:43942) 2023-11-28T17:40:12.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dd9ce640 1 -- 172.21.15.16:0/1422747070 learned_addr learned my addr 172.21.15.16:0/1422747070 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:12.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dd1cd640 1 --2- 172.21.15.16:0/1422747070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d806ca40 0x7fe8d815a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502641750 0 0) 0x7fe8d8070700 con 0x7fe8d81574c0 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.651+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c4003530 con 0x7fe8d81574c0 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301149624 0 0) 0x7fe8d815ad80 con 0x7fe8d80cf8a0 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d8070700 con 0x7fe8d80cf8a0 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dd1cd640 1 -- 172.21.15.16:0/1422747070 >> v1:172.21.15.64:6789/0 conn(0x7fe8d80cf8a0 legacy=0x7fe8d80b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226056126 0 0) 0x7fe8c4003530 con 0x7fe8d81574c0 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dd1cd640 1 -- 172.21.15.16:0/1422747070 >> v1:172.21.15.16:6789/0 conn(0x7fe8d81574c0 legacy=0x7fe8d806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dd1cd640 1 -- 172.21.15.16:0/1422747070 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d8070c30 con 0x7fe8d806ca40 2023-11-28T17:40:12.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dd1cd640 1 --2- 172.21.15.16:0/1422747070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d806ca40 0x7fe8d815a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80097f0 tx=0x7fe8c801c3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=955ffe7a4cfaa3ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:12.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4001680 con 0x7fe8d806ca40 2023-11-28T17:40:12.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c80a7050 con 0x7fe8d806ca40 2023-11-28T17:40:12.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dc9cc640 1 -- 172.21.15.16:0/1422747070 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c80ab620 con 0x7fe8d806ca40 2023-11-28T17:40:12.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dfc32640 1 -- 172.21.15.16:0/1422747070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d806ca40 msgr2=0x7fe8d815a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.655+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/1422747070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d806ca40 0x7fe8d815a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80097f0 tx=0x7fe8c801c3b0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- 172.21.15.16:0/1422747070 shutdown_connections 2023-11-28T17:40:12.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/1422747070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d806ca40 0x7fe8d815a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- 172.21.15.16:0/1422747070 >> 172.21.15.16:0/1422747070 conn(0x7fe8d806a5a0 msgr2=0x7fe8d806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:12.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- 172.21.15.16:0/1422747070 shutdown_connections 2023-11-28T17:40:12.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- 172.21.15.16:0/1422747070 wait complete. 2023-11-28T17:40:12.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 Processor -- start 2023-11-28T17:40:12.662 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- start start 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 0x7fe8d814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d80cf8a0 0x7fe8d80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d81574c0 0x7fe8d80aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d814df70 con 0x7fe8d806ca40 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d814e250 con 0x7fe8d81574c0 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dfc32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d814e530 con 0x7fe8d80cf8a0 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 0x7fe8d814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 0x7fe8d814c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55412/0 (socket says 172.21.15.16:55412) 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 -- 172.21.15.16:0/4166445209 learned_addr learned my addr 172.21.15.16:0/4166445209 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd1cd640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d80cf8a0 0x7fe8d80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8de1cf640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d81574c0 0x7fe8d80aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 -- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d80cf8a0 msgr2=0x7fe8d80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d80cf8a0 0x7fe8d80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 -- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d81574c0 msgr2=0x7fe8d80aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d81574c0 0x7fe8d80aec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd9ce640 1 -- 172.21.15.16:0/4166445209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c8009420 con 0x7fe8d806ca40 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.659+0000 7fe8dd1cd640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d80cf8a0 0x7fe8d80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:12.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8dd9ce640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 0x7fe8d814c960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400c750 tx=0x7fe8d400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:12.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4005ae0 con 0x7fe8d806ca40 2023-11-28T17:40:12.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d4005c60 con 0x7fe8d806ca40 2023-11-28T17:40:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d814e810 con 0x7fe8d806ca40 2023-11-28T17:40:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4007070 con 0x7fe8d806ca40 2023-11-28T17:40:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d814cea0 con 0x7fe8d806ca40 2023-11-28T17:40:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d8068860 con 0x7fe8d806ca40 2023-11-28T17:40:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe8d40071d0 con 0x7fe8d806ca40 2023-11-28T17:40:12.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8ce7fc640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8bc066900 0x7fe8bc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8d40842c0 con 0x7fe8d806ca40 2023-11-28T17:40:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.663+0000 7fe8dd1cd640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8bc066900 0x7fe8bc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:12.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.667+0000 7fe8dd1cd640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8bc066900 0x7fe8bc068dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80ad000 tx=0x7fe8c80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:12.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.667+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe8d40513f0 con 0x7fe8d806ca40 2023-11-28T17:40:12.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.839+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8d815cf60 con 0x7fe8d806ca40 2023-11-28T17:40:12.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.839+0000 7fe8ce7fc640 1 -- 172.21.15.16:0/4166445209 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8d4054a10 con 0x7fe8d806ca40 2023-11-28T17:40:12.843 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8bc066900 msgr2=0x7fe8bc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8bc066900 0x7fe8bc068dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe8c80ad000 tx=0x7fe8c80a6000 comp rx=0 tx=0).stop 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 msgr2=0x7fe8d814c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 0x7fe8d814c960 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe8d400c750 tx=0x7fe8d400cc10 comp rx=0 tx=0).stop 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 shutdown_connections 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe8bc066900 0x7fe8bc068dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8d81574c0 0x7fe8d80aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe8d80cf8a0 0x7fe8d80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 --2- 172.21.15.16:0/4166445209 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe8d806ca40 0x7fe8d814c960 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:12.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 >> 172.21.15.16:0/4166445209 conn(0x7fe8d806a5a0 msgr2=0x7fe8d80b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:12.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 shutdown_connections 2023-11-28T17:40:12.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:12.843+0000 7fe8dfc32640 1 -- 172.21.15.16:0/4166445209 wait complete. 2023-11-28T17:40:12.864 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-28T17:40:12.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:12.864 DEBUG:teuthology.orchestra.run.smithi064:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-28T17:40:12.892 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-11-28T17:40:12.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:12.892 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-28T17:40:12.942 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-28T17:40:12.943 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:40:13.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 Processor -- start 2023-11-28T17:40:13.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 -- start start 2023-11-28T17:40:13.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1fd806d300 0x7f1fd8161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806e880 0x7f1fd806ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd8161f70 con 0x7f1fd815d620 2023-11-28T17:40:13.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd806f250 con 0x7f1fd806d300 2023-11-28T17:40:13.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.083+0000 7f1fdeaaa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80cee20 con 0x7f1fd806e880 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1fd806d300 0x7f1fd8161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1fd806d300 0x7f1fd8161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55418/0 (socket says 172.21.15.16:55418) 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 -- 172.21.15.16:0/3666447016 learned_addr learned my addr 172.21.15.16:0/3666447016 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fdd047640 1 --2- 172.21.15.16:0/3666447016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806e880 0x7f1fd806ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 -- 172.21.15.16:0/3666447016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806e880 msgr2=0x7f1fd806ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 --2- 172.21.15.16:0/3666447016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806e880 0x7f1fd806ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 -- 172.21.15.16:0/3666447016 >> v1:172.21.15.64:6789/0 conn(0x7f1fd815d620 legacy=0x7f1fd80cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 -- 172.21.15.16:0/3666447016 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd80cf100 con 0x7f1fd806d300 2023-11-28T17:40:13.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd7fff640 1 --2- 172.21.15.16:0/3666447016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd806d300 0x7f1fd8161a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40098a0 tx=0x7f1fc401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68365391ec799158 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd77fe640 1 -- 172.21.15.16:0/3666447016 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40aa650 con 0x7f1fd806d300 2023-11-28T17:40:13.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd77fe640 1 -- 172.21.15.16:0/3666447016 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40aa7b0 con 0x7f1fd806d300 2023-11-28T17:40:13.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.087+0000 7f1fd77fe640 1 -- 172.21.15.16:0/3666447016 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc40aab40 con 0x7f1fd806d300 2023-11-28T17:40:13.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/3666447016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd806d300 msgr2=0x7f1fd8161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/3666447016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd806d300 0x7f1fd8161a30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40098a0 tx=0x7f1fc401c4f0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/3666447016 shutdown_connections 2023-11-28T17:40:13.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/3666447016 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806e880 0x7f1fd806ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/3666447016 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd806d300 0x7f1fd8161a30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/3666447016 >> 172.21.15.16:0/3666447016 conn(0x7f1fd806a5a0 msgr2=0x7f1fd806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:13.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/3666447016 shutdown_connections 2023-11-28T17:40:13.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/3666447016 wait complete. 2023-11-28T17:40:13.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 Processor -- start 2023-11-28T17:40:13.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- start start 2023-11-28T17:40:13.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806d300 0x7f1fd80c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd806e880 0x7f1fd80af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 0x7f1fd80b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80c4920 con 0x7f1fd815d620 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80afde0 con 0x7f1fd806e880 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdeaaa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd80b00c0 con 0x7f1fd806d300 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdd047640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 0x7f1fd80b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdc846640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806d300 0x7f1fd80c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdd047640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 0x7f1fd80b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55430/0 (socket says 172.21.15.16:55430) 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fdd047640 1 -- 172.21.15.16:0/1173515840 learned_addr learned my addr 172.21.15.16:0/1173515840 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.091+0000 7f1fd7fff640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd806e880 0x7f1fd80af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdd047640 1 -- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806d300 msgr2=0x7f1fd80c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdd047640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806d300 0x7f1fd80c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdd047640 1 -- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd806e880 msgr2=0x7f1fd80af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdd047640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd806e880 0x7f1fd80af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdd047640 1 -- 172.21.15.16:0/1173515840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc40094d0 con 0x7f1fd815d620 2023-11-28T17:40:13.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdd047640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 0x7f1fd80b1e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000efc0 tx=0x7f1fd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0014480 con 0x7f1fd815d620 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd000f040 con 0x7f1fd815d620 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd0014820 con 0x7f1fd815d620 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd80b03a0 con 0x7f1fd815d620 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd80acb50 con 0x7f1fd815d620 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd80c4db0 con 0x7f1fd815d620 2023-11-28T17:40:13.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1fd0014980 con 0x7f1fd815d620 2023-11-28T17:40:13.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fd57fa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1fbc0668d0 0x7f1fbc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fd0084f70 con 0x7f1fd815d620 2023-11-28T17:40:13.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.095+0000 7f1fdc846640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1fbc0668d0 0x7f1fbc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.101 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.099+0000 7f1fdc846640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1fbc0668d0 0x7f1fbc068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007fd0 tx=0x7f1fcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.099+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1fd80c4db0 con 0x7f1fd815d620 2023-11-28T17:40:13.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fd80c4db0 con 0x7f1fd815d620 2023-11-28T17:40:13.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fd57fa640 1 -- 172.21.15.16:0/1173515840 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f1fd80c4db0 con 0x7f1fd815d620 2023-11-28T17:40:13.298 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:13.299 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:40:13.299 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:40:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1fbc0668d0 msgr2=0x7f1fbc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1fbc0668d0 0x7f1fbc068d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc007fd0 tx=0x7f1fcc009040 comp rx=0 tx=0).stop 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 msgr2=0x7f1fd80b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 0x7f1fd80b1e20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fd000efc0 tx=0x7f1fd000c490 comp rx=0 tx=0).stop 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 shutdown_connections 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1fd815d620 0x7f1fd80b1e20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1fbc0668d0 0x7f1fbc068d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1fd806e880 0x7f1fd80af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 --2- 172.21.15.16:0/1173515840 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1fd806d300 0x7f1fd80c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.295+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 >> 172.21.15.16:0/1173515840 conn(0x7f1fd806a5a0 msgr2=0x7f1fd815f100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.299+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 shutdown_connections 2023-11-28T17:40:13.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.299+0000 7f1fdeaaa640 1 -- 172.21.15.16:0/1173515840 wait complete. 2023-11-28T17:40:13.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 Processor -- start 2023-11-28T17:40:13.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 -- start start 2023-11-28T17:40:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fea60070460 0x7fea60071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60072230 0x7fea600cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea60072680 con 0x7fea6015d4e0 2023-11-28T17:40:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6015e8d0 con 0x7fea60070460 2023-11-28T17:40:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.459+0000 7fea66e32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b2fd0 con 0x7fea60072230 2023-11-28T17:40:13.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea64bce640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fea6015d4e0 0x7fea600b28c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43954/0 (socket says 172.21.15.16:43954) 2023-11-28T17:40:13.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea64bce640 1 -- 172.21.15.16:0/811283931 learned_addr learned my addr 172.21.15.16:0/811283931 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:13.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5ffff640 1 --2- 172.21.15.16:0/811283931 >> v2:172.21.15.64:3300/0 conn(0x7fea60070460 0x7fea60071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea653cf640 1 --2- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60072230 0x7fea600cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5f7fe640 1 -- 172.21.15.16:0/811283931 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027415115 0 0) 0x7fea54001120 con 0x7fea6015d4e0 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5f7fe640 1 -- 172.21.15.16:0/811283931 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea50003530 con 0x7fea6015d4e0 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5ffff640 1 -- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60072230 msgr2=0x7fea600cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5ffff640 1 --2- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60072230 0x7fea600cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5ffff640 1 -- 172.21.15.16:0/811283931 >> v1:172.21.15.16:6789/0 conn(0x7fea6015d4e0 legacy=0x7fea600b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5ffff640 1 -- 172.21.15.16:0/811283931 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6015dc50 con 0x7fea60070460 2023-11-28T17:40:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.463+0000 7fea5ffff640 1 --2- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60070460 0x7fea60071cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0097c0 tx=0x7fea4c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3a6aff6ba3d07de server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea5f7fe640 1 -- 172.21.15.16:0/811283931 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0ab650 con 0x7fea60070460 2023-11-28T17:40:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea5f7fe640 1 -- 172.21.15.16:0/811283931 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea4c0ab7b0 con 0x7fea60070460 2023-11-28T17:40:13.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea5f7fe640 1 -- 172.21.15.16:0/811283931 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c0abb20 con 0x7fea60070460 2023-11-28T17:40:13.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60070460 msgr2=0x7fea60071cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 --2- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60070460 0x7fea60071cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0097c0 tx=0x7fea4c01c450 comp rx=0 tx=0).stop 2023-11-28T17:40:13.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- 172.21.15.16:0/811283931 shutdown_connections 2023-11-28T17:40:13.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 --2- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60072230 0x7fea600cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 --2- 172.21.15.16:0/811283931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60070460 0x7fea60071cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- 172.21.15.16:0/811283931 >> 172.21.15.16:0/811283931 conn(0x7fea6006a5a0 msgr2=0x7fea6006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- 172.21.15.16:0/811283931 shutdown_connections 2023-11-28T17:40:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- 172.21.15.16:0/811283931 wait complete. 2023-11-28T17:40:13.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 Processor -- start 2023-11-28T17:40:13.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- start start 2023-11-28T17:40:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60070460 0x7fea60156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60072230 0x7fea60150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 0x7fea6014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60155dc0 con 0x7fea6015d4e0 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60167c50 con 0x7fea60072230 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.467+0000 7fea66e32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea60167970 con 0x7fea60070460 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 0x7fea6014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60072230 0x7fea60150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea64bce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60070460 0x7fea60156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 0x7fea6014dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55432/0 (socket says 172.21.15.16:55432) 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 -- 172.21.15.16:0/1162381730 learned_addr learned my addr 172.21.15.16:0/1162381730 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 -- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60070460 msgr2=0x7fea60156ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60070460 0x7fea60156ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 -- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60072230 msgr2=0x7fea60150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60072230 0x7fea60150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 -- 172.21.15.16:0/1162381730 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c009420 con 0x7fea6015d4e0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea653cf640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 0x7fea6014dad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea5800efc0 tx=0x7fea5800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58014480 con 0x7fea6015d4e0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5800f040 con 0x7fea6015d4e0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58014820 con 0x7fea6015d4e0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea60155ff0 con 0x7fea6015d4e0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea601565b0 con 0x7fea6015d4e0 2023-11-28T17:40:13.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea601567a0 con 0x7fea6015d4e0 2023-11-28T17:40:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.471+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fea58014980 con 0x7fea6015d4e0 2023-11-28T17:40:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.475+0000 7fea5d7fa640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea440668d0 0x7fea44068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.475+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea58085220 con 0x7fea6015d4e0 2023-11-28T17:40:13.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.475+0000 7fea64bce640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea440668d0 0x7fea44068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.475+0000 7fea64bce640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea440668d0 0x7fea44068d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea600b1b50 tx=0x7fea54007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.479+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fea58052470 con 0x7fea6015d4e0 2023-11-28T17:40:13.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.635+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea60068860 con 0x7fea6015d4e0 2023-11-28T17:40:13.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.635+0000 7fea5d7fa640 1 -- 172.21.15.16:0/1162381730 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7fea58055a90 con 0x7fea6015d4e0 2023-11-28T17:40:13.640 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:13.641 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:13.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea440668d0 msgr2=0x7fea44068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea440668d0 0x7fea44068d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea600b1b50 tx=0x7fea54007b80 comp rx=0 tx=0).stop 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 msgr2=0x7fea6014dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 0x7fea6014dad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fea5800efc0 tx=0x7fea5800c490 comp rx=0 tx=0).stop 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 shutdown_connections 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fea6015d4e0 0x7fea6014dad0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea440668d0 0x7fea44068d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea60072230 0x7fea60150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 --2- 172.21.15.16:0/1162381730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fea60070460 0x7fea60156ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 >> 172.21.15.16:0/1162381730 conn(0x7fea6006a5a0 msgr2=0x7fea6015f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 shutdown_connections 2023-11-28T17:40:13.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.639+0000 7fea66e32640 1 -- 172.21.15.16:0/1162381730 wait complete. 2023-11-28T17:40:13.662 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:39:32.985702+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:39:33.437949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:13.662 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.803+0000 7f7e20254640 1 Processor -- start 2023-11-28T17:40:13.808 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e20254640 1 -- start start 2023-11-28T17:40:13.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e20254640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e18144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e20254640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e1806ae00 con 0x7f7e180b2b70 2023-11-28T17:40:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e20254640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e18161cd0 con 0x7f7e181616b0 2023-11-28T17:40:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e20254640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1806a5a0 con 0x7f7e180aed60 2023-11-28T17:40:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1d7ef640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f7e180b2b70 0x7f7e18160fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43966/0 (socket says 172.21.15.16:43966) 2023-11-28T17:40:13.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1d7ef640 1 -- 172.21.15.16:0/1436035431 learned_addr learned my addr 172.21.15.16:0/1436035431 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:13.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e18144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 458429063 0 0) 0x7f7e1806ae00 con 0x7f7e180b2b70 2023-11-28T17:40:13.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e04003530 con 0x7f7e180b2b70 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388678175 0 0) 0x7f7e18161cd0 con 0x7f7e181616b0 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e1806ae00 con 0x7f7e181616b0 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1615820480 0 0) 0x7f7e04003530 con 0x7f7e180b2b70 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 msgr2=0x7f7e18144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e18144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 >> v1:172.21.15.64:6789/0 conn(0x7f7e181616b0 legacy=0x7f7e1806b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1806a7b0 con 0x7f7e180b2b70 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f7e08001680 con 0x7f7e180b2b70 2023-11-28T17:40:13.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 >> v1:172.21.15.16:6789/0 conn(0x7f7e180b2b70 legacy=0x7f7e18160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e04003b40 0x7f7e04003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04004d10 0x7f7e04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1806a5a0 con 0x7f7e04003b40 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0400ba90 con 0x7f7e04004d10 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0400bc50 con 0x7f7e180aed60 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e04003b40 0x7f7e04003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1e7f1640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04004d10 0x7f7e04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1d7ef640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 -- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 msgr2=0x7f7e040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:13.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 -- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04004d10 msgr2=0x7f7e04005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:13.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04004d10 0x7f7e04005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1dff0640 1 -- 172.21.15.16:0/1436035431 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e04003530 con 0x7f7e04003b40 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.807+0000 7f7e1d7ef640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e180aed60 0x7f7e040047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e04003b40 0x7f7e04003f40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009ae0 tx=0x7f7e1401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee448103ee0bb64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140a6430 con 0x7f7e04003b40 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140a6590 con 0x7f7e04003b40 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e1cfee640 1 -- 172.21.15.16:0/1436035431 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140a6940 con 0x7f7e04003b40 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e20254640 1 -- 172.21.15.16:0/1436035431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e04003b40 msgr2=0x7f7e04003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e20254640 1 --2- 172.21.15.16:0/1436035431 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e04003b40 0x7f7e04003f40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009ae0 tx=0x7f7e1401ca50 comp rx=0 tx=0).stop 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e1e7f1640 1 -- 172.21.15.16:0/1436035431 reap_dead start 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e20254640 1 -- 172.21.15.16:0/1436035431 shutdown_connections 2023-11-28T17:40:13.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e20254640 1 -- 172.21.15.16:0/1436035431 >> 172.21.15.16:0/1436035431 conn(0x7f7e180b1de0 msgr2=0x7f7e180cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e20254640 1 -- 172.21.15.16:0/1436035431 shutdown_connections 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.811+0000 7f7e20254640 1 -- 172.21.15.16:0/1436035431 wait complete. 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 Processor -- start 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 -- start start 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04003b40 0x7f7e18141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e1813c180 0x7f7e1813b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 0x7f7e181404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1806e2a0 con 0x7f7e18140070 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e18140a30 con 0x7f7e04003b40 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1813c910 con 0x7f7e1813c180 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 0x7f7e181404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 0x7f7e181404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55448/0 (socket says 172.21.15.16:55448) 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 -- 172.21.15.16:0/1602477634 learned_addr learned my addr 172.21.15.16:0/1602477634 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04003b40 0x7f7e18141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1d7ef640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e1813c180 0x7f7e1813b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 -- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e1813c180 msgr2=0x7f7e1813b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e1813c180 0x7f7e1813b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 -- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04003b40 msgr2=0x7f7e18141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04003b40 0x7f7e18141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 -- 172.21.15.16:0/1602477634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1806e9d0 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e1e7f1640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 0x7f7e181404f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7e10007fd0 tx=0x7f7e1000ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10006e30 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e10003980 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1813bf30 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e10003d30 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.815+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e180ad740 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.819+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e18068860 con 0x7f7e18140070 2023-11-28T17:40:13.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.819+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7e1000d770 con 0x7f7e18140070 2023-11-28T17:40:13.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.819+0000 7f7e0e7fc640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7dfc066900 0x7f7dfc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:13.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.819+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e100838b0 con 0x7f7e18140070 2023-11-28T17:40:13.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.819+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7dfc066900 0x7f7dfc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:13.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.819+0000 7f7e1dff0640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7dfc066900 0x7f7dfc068dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e140ad000 tx=0x7f7e140b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:13.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.823+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e10050b00 con 0x7f7e18140070 2023-11-28T17:40:13.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.979+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e180b4120 con 0x7f7e18140070 2023-11-28T17:40:13.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.979+0000 7f7e0e7fc640 1 -- 172.21.15.16:0/1602477634 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e10054120 con 0x7f7e18140070 2023-11-28T17:40:13.985 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7dfc066900 msgr2=0x7f7dfc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7dfc066900 0x7f7dfc068dc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7e140ad000 tx=0x7f7e140b3040 comp rx=0 tx=0).stop 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 msgr2=0x7f7e181404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 0x7f7e181404f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7e10007fd0 tx=0x7f7e1000ff70 comp rx=0 tx=0).stop 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 shutdown_connections 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7e18140070 0x7f7e181404f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7e1813c180 0x7f7e1813b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7dfc066900 0x7f7dfc068dc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 --2- 172.21.15.16:0/1602477634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7e04003b40 0x7f7e18141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:13.987 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 >> 172.21.15.16:0/1602477634 conn(0x7f7e180b1de0 msgr2=0x7f7e1815eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:13.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 shutdown_connections 2023-11-28T17:40:13.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:13.983+0000 7f7e20254640 1 -- 172.21.15.16:0/1602477634 wait complete. 2023-11-28T17:40:14.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T17:40:14.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 Processor -- start 2023-11-28T17:40:14.154 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 -- start start 2023-11-28T17:40:14.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c1548e0 0x7f406c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.155 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f406c072090 0x7f406c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f406c15a8b0 con 0x7f406c15b350 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f406c15a6a0 con 0x7f406c072090 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f407211d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0ced30 con 0x7f406c1548e0 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f406c072090 0x7f406c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406bfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f406c15b350 0x7f406c070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43978/0 (socket says 172.21.15.16:43978) 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406bfff640 1 -- 172.21.15.16:0/3602484245 learned_addr learned my addr 172.21.15.16:0/3602484245 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:14.156 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406b7fe640 1 --2- 172.21.15.16:0/3602484245 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c1548e0 0x7f406c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406affd640 1 -- 172.21.15.16:0/3602484245 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c1548e0 msgr2=0x7f406c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406affd640 1 --2- 172.21.15.16:0/3602484245 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c1548e0 0x7f406c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406affd640 1 -- 172.21.15.16:0/3602484245 >> v1:172.21.15.16:6789/0 conn(0x7f406c15b350 legacy=0x7f406c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.157 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.151+0000 7f406affd640 1 -- 172.21.15.16:0/3602484245 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c0cea50 con 0x7f406c072090 2023-11-28T17:40:14.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f406affd640 1 --2- 172.21.15.16:0/3602484245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c0cef30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40600097c0 tx=0x7f406001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b3c06c2f6f32c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f406a7fc640 1 -- 172.21.15.16:0/3602484245 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600ab600 con 0x7f406c072090 2023-11-28T17:40:14.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f406a7fc640 1 -- 172.21.15.16:0/3602484245 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40600a7050 con 0x7f406c072090 2023-11-28T17:40:14.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f406a7fc640 1 -- 172.21.15.16:0/3602484245 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40600ab980 con 0x7f406c072090 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 -- 172.21.15.16:0/3602484245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 msgr2=0x7f406c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 --2- 172.21.15.16:0/3602484245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c0cef30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f40600097c0 tx=0x7f406001c310 comp rx=0 tx=0).stop 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 -- 172.21.15.16:0/3602484245 shutdown_connections 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 --2- 172.21.15.16:0/3602484245 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c0cef30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 --2- 172.21.15.16:0/3602484245 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c1548e0 0x7f406c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 -- 172.21.15.16:0/3602484245 >> 172.21.15.16:0/3602484245 conn(0x7f406c06a5a0 msgr2=0x7f406c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 -- 172.21.15.16:0/3602484245 shutdown_connections 2023-11-28T17:40:14.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.155+0000 7f407211d640 1 -- 172.21.15.16:0/3602484245 wait complete. 2023-11-28T17:40:14.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 Processor -- start 2023-11-28T17:40:14.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 -- start start 2023-11-28T17:40:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c13dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f406c1548e0 0x7f406c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c15b350 0x7f406c06c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0b0cc0 con 0x7f406c072090 2023-11-28T17:40:14.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406c0b09e0 con 0x7f406c1548e0 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406c14e390 con 0x7f406c15b350 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c13dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c13dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55454/0 (socket says 172.21.15.16:55454) 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 -- 172.21.15.16:0/2340118938 learned_addr learned my addr 172.21.15.16:0/2340118938 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406affd640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f406c1548e0 0x7f406c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406bfff640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c15b350 0x7f406c06c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 -- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c15b350 msgr2=0x7f406c06c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c15b350 0x7f406c06c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 -- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f406c1548e0 msgr2=0x7f406c06c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f406c1548e0 0x7f406c06c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 -- 172.21.15.16:0/2340118938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4060009420 con 0x7f406c072090 2023-11-28T17:40:14.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f406b7fe640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c13dcd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f405c00e870 tx=0x7f405c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c009510 con 0x7f406c072090 2023-11-28T17:40:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c00eec0 con 0x7f406c072090 2023-11-28T17:40:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c00cb40 con 0x7f406c072090 2023-11-28T17:40:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f406c14e670 con 0x7f406c072090 2023-11-28T17:40:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.159+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c13b1a0 con 0x7f406c072090 2023-11-28T17:40:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.163+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f406c068860 con 0x7f406c072090 2023-11-28T17:40:14.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.163+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f405c00cca0 con 0x7f406c072090 2023-11-28T17:40:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.163+0000 7f4053fff640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f40580668d0 0x7f4058068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.163+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f405c084520 con 0x7f406c072090 2023-11-28T17:40:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.163+0000 7f406affd640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f40580668d0 0x7f4058068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.163+0000 7f406affd640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f40580668d0 0x7f4058068d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f40600ad000 tx=0x7f4060008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.167+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f405c051800 con 0x7f406c072090 2023-11-28T17:40:14.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.323+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f406c0cdc60 con 0x7f406c072090 2023-11-28T17:40:14.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f4053fff640 1 -- 172.21.15.16:0/2340118938 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f405c054e20 con 0x7f406c072090 2023-11-28T17:40:14.329 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-28T17:40:14.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f40580668d0 msgr2=0x7f4058068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f40580668d0 0x7f4058068d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f40600ad000 tx=0x7f4060008040 comp rx=0 tx=0).stop 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 msgr2=0x7f406c13dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c13dcd0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f405c00e870 tx=0x7f405c00ec70 comp rx=0 tx=0).stop 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 shutdown_connections 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f406c15b350 0x7f406c06c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f40580668d0 0x7f4058068d90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f406c1548e0 0x7f406c06c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 --2- 172.21.15.16:0/2340118938 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f406c072090 0x7f406c13dcd0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 >> 172.21.15.16:0/2340118938 conn(0x7f406c06a5a0 msgr2=0x7f406c0b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 shutdown_connections 2023-11-28T17:40:14.331 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.327+0000 7f407211d640 1 -- 172.21.15.16:0/2340118938 wait complete. 2023-11-28T17:40:14.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T17:40:14.496 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd247b55640 1 Processor -- start 2023-11-28T17:40:14.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd247b55640 1 -- start start 2023-11-28T17:40:14.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd247b55640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd2400708c0 0x7fd240145810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd247b55640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24006c6d0 con 0x7fd240161710 2023-11-28T17:40:14.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd247b55640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd24006c9b0 con 0x7fd240070460 2023-11-28T17:40:14.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd247b55640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd24006cc90 con 0x7fd2400708c0 2023-11-28T17:40:14.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2458f1640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fd240161710 0x7fd240165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:43986/0 (socket says 172.21.15.16:43986) 2023-11-28T17:40:14.499 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2458f1640 1 -- 172.21.15.16:0/2148845994 learned_addr learned my addr 172.21.15.16:0/2148845994 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:14.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754152522 0 0) 0x7fd24006c6d0 con 0x7fd240161710 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2460f2640 1 --2- 172.21.15.16:0/2148845994 >> v2:172.21.15.64:3300/0 conn(0x7fd2400708c0 0x7fd240145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd22c003530 con 0x7fd240161710 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022557359 0 0) 0x7fd22c003530 con 0x7fd240161710 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 >> v2:172.21.15.64:3300/0 conn(0x7fd2400708c0 msgr2=0x7fd240145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 --2- 172.21.15.16:0/2148845994 >> v2:172.21.15.64:3300/0 conn(0x7fd2400708c0 0x7fd240145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 >> v1:172.21.15.64:6789/0 conn(0x7fd240070460 legacy=0x7fd240145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24006cf70 con 0x7fd240161710 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7fd23c001680 con 0x7fd240161710 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 >> v1:172.21.15.16:6789/0 conn(0x7fd240161710 legacy=0x7fd240165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd22c003980 0x7fd22c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd22c0047d0 0x7fd22c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c005190 0x7fd22c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24006cc90 con 0x7fd22c0047d0 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00c030 con 0x7fd22c003980 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c00c1f0 con 0x7fd22c005190 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2450f0640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd22c0047d0 0x7fd22c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2460f2640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c005190 0x7fd22c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2458f1640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd22c003980 0x7fd22c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2450f0640 1 -- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c005190 msgr2=0x7fd22c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2450f0640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c005190 0x7fd22c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.502 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2450f0640 1 -- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd22c003980 msgr2=0x7fd22c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2450f0640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd22c003980 0x7fd22c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2450f0640 1 -- 172.21.15.16:0/2148845994 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c003530 con 0x7fd22c0047d0 2023-11-28T17:40:14.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2458f1640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd22c003980 0x7fd22c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:14.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.495+0000 7fd2460f2640 1 -- 172.21.15.16:0/2148845994 reap_dead start 2023-11-28T17:40:14.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd2450f0640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd22c0047d0 0x7fd22c004c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd230001780 tx=0x7fd23001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b9d3a8a709237e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2300052d0 con 0x7fd22c0047d0 2023-11-28T17:40:14.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2300a7050 con 0x7fd22c0047d0 2023-11-28T17:40:14.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd2448ef640 1 -- 172.21.15.16:0/2148845994 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230003600 con 0x7fd22c0047d0 2023-11-28T17:40:14.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 -- 172.21.15.16:0/2148845994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd22c0047d0 msgr2=0x7fd22c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd22c0047d0 0x7fd22c004c50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd230001780 tx=0x7fd23001c3e0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 -- 172.21.15.16:0/2148845994 shutdown_connections 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 --2- 172.21.15.16:0/2148845994 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd22c0047d0 0x7fd22c004c50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 -- 172.21.15.16:0/2148845994 >> 172.21.15.16:0/2148845994 conn(0x7fd24006a5a0 msgr2=0x7fd24006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 -- 172.21.15.16:0/2148845994 shutdown_connections 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.499+0000 7fd247b55640 1 -- 172.21.15.16:0/2148845994 wait complete. 2023-11-28T17:40:14.505 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 Processor -- start 2023-11-28T17:40:14.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 -- start start 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c0047d0 0x7fd2401f7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 0x7fd2401f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2400b29d0 0x7fd2400b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2400b3390 con 0x7fd2400b0830 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401f84b0 con 0x7fd2400b29d0 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2401f7330 con 0x7fd22c0047d0 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 0x7fd2401f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 0x7fd2401f6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55474/0 (socket says 172.21.15.16:55474) 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 -- 172.21.15.16:0/188598931 learned_addr learned my addr 172.21.15.16:0/188598931 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2458f1640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c0047d0 0x7fd2401f7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2460f2640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2400b29d0 0x7fd2400b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 -- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c0047d0 msgr2=0x7fd2401f7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c0047d0 0x7fd2401f7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 -- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2400b29d0 msgr2=0x7fd2400b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2400b29d0 0x7fd2400b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 -- 172.21.15.16:0/188598931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2400aedb0 con 0x7fd2400b0830 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2460f2640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2400b29d0 0x7fd2400b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2458f1640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c0047d0 0x7fd2401f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:14.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2450f0640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 0x7fd2401f6df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd230005040 tx=0x7fd22c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230003e40 con 0x7fd2400b0830 2023-11-28T17:40:14.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd230007a40 con 0x7fd2400b0830 2023-11-28T17:40:14.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd230007270 con 0x7fd2400b0830 2023-11-28T17:40:14.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2400af090 con 0x7fd2400b0830 2023-11-28T17:40:14.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.503+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2400af650 con 0x7fd2400b0830 2023-11-28T17:40:14.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.507+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd240068860 con 0x7fd2400b0830 2023-11-28T17:40:14.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.507+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd2300073d0 con 0x7fd2400b0830 2023-11-28T17:40:14.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.507+0000 7fd2367fc640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd2240668d0 0x7fd224068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.507+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd23011e800 con 0x7fd2400b0830 2023-11-28T17:40:14.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.507+0000 7fd2458f1640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd2240668d0 0x7fd224068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.507+0000 7fd2458f1640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd2240668d0 0x7fd224068d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd23c001210 tx=0x7fd23c001120 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.511+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2300ebb70 con 0x7fd2400b0830 2023-11-28T17:40:14.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.667+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd240149ef0 con 0x7fd2400b0830 2023-11-28T17:40:14.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd2367fc640 1 -- 172.21.15.16:0/188598931 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2300b2310 con 0x7fd2400b0830 2023-11-28T17:40:14.673 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-28T17:40:14.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd2240668d0 msgr2=0x7fd224068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd2240668d0 0x7fd224068d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd23c001210 tx=0x7fd23c001120 comp rx=0 tx=0).stop 2023-11-28T17:40:14.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 msgr2=0x7fd2401f6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 0x7fd2401f6df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd230005040 tx=0x7fd22c005800 comp rx=0 tx=0).stop 2023-11-28T17:40:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 shutdown_connections 2023-11-28T17:40:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd2240668d0 0x7fd224068d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd2400b29d0 0x7fd2400b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd2400b0830 0x7fd2401f6df0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 --2- 172.21.15.16:0/188598931 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd22c0047d0 0x7fd2401f7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 >> 172.21.15.16:0/188598931 conn(0x7fd24006a5a0 msgr2=0x7fd240146890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:14.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 shutdown_connections 2023-11-28T17:40:14.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.671+0000 7fd247b55640 1 -- 172.21.15.16:0/188598931 wait complete. 2023-11-28T17:40:14.694 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:40:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f8841add640 1 Processor -- start 2023-11-28T17:40:14.837 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f8841add640 1 -- start start 2023-11-28T17:40:14.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f8841add640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 0x7f883c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f8841add640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0cee20 con 0x7f883c06d300 2023-11-28T17:40:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f8841add640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c0cf100 con 0x7f883c15d620 2023-11-28T17:40:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f8841add640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c06f250 con 0x7f883c06e880 2023-11-28T17:40:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883affd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f883c06d300 0x7f883c161a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44000/0 (socket says 172.21.15.16:44000) 2023-11-28T17:40:14.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883affd640 1 -- 172.21.15.16:0/2183029596 learned_addr learned my addr 172.21.15.16:0/2183029596 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883bfff640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 0x7f883c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 295253727 0 0) 0x7f883c0cee20 con 0x7f883c06d300 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824003530 con 0x7f883c06d300 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979472964 0 0) 0x7f883c0cf100 con 0x7f883c15d620 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f883c0cee20 con 0x7f883c15d620 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2993805146 0 0) 0x7f8824003530 con 0x7f883c06d300 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 msgr2=0x7f883c06ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 0x7f883c06ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 >> v1:172.21.15.64:6789/0 conn(0x7f883c15d620 legacy=0x7f883c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0cf3e0 con 0x7f883c06d300 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f8830001680 con 0x7f883c06d300 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 >> v1:172.21.15.16:6789/0 conn(0x7f883c06d300 legacy=0x7f883c161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f8824003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88240047d0 0x7f8824004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 0x7f8824005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c06f250 con 0x7f8824003b40 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f882400ba40 con 0x7f88240047d0 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882400bbd0 con 0x7f883c06e880 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883b7fe640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f8824003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883affd640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88240047d0 0x7f8824004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.835+0000 7f883bfff640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 0x7f8824005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883b7fe640 1 -- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 msgr2=0x7f8824005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883b7fe640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c06e880 0x7f8824005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883b7fe640 1 -- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88240047d0 msgr2=0x7f8824004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883b7fe640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88240047d0 0x7f8824004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883b7fe640 1 -- 172.21.15.16:0/2183029596 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824003530 con 0x7f8824003b40 2023-11-28T17:40:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883b7fe640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f8824003f40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f882c0018d0 tx=0x7f882c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c055373233e3e03a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0052d0 con 0x7f8824003b40 2023-11-28T17:40:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0a7050 con 0x7f8824003b40 2023-11-28T17:40:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883a7fc640 1 -- 172.21.15.16:0/2183029596 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c003600 con 0x7f8824003b40 2023-11-28T17:40:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f8841add640 1 -- 172.21.15.16:0/2183029596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 msgr2=0x7f8824003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f8841add640 1 --2- 172.21.15.16:0/2183029596 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f8824003f40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f882c0018d0 tx=0x7f882c01c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f883bfff640 1 -- 172.21.15.16:0/2183029596 reap_dead start 2023-11-28T17:40:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f8841add640 1 -- 172.21.15.16:0/2183029596 shutdown_connections 2023-11-28T17:40:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f8841add640 1 -- 172.21.15.16:0/2183029596 >> 172.21.15.16:0/2183029596 conn(0x7f883c06a5a0 msgr2=0x7f883c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f8841add640 1 -- 172.21.15.16:0/2183029596 shutdown_connections 2023-11-28T17:40:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.839+0000 7f8841add640 1 -- 172.21.15.16:0/2183029596 wait complete. 2023-11-28T17:40:14.845 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 Processor -- start 2023-11-28T17:40:14.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 -- start start 2023-11-28T17:40:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f883c150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c154170 0x7f883c150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883c158060 0x7f883c14e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c158600 con 0x7f8824003b40 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c1588e0 con 0x7f883c158060 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f8841add640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c158bc0 con 0x7f883c154170 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f883c150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f883c150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55502/0 (socket says 172.21.15.16:55502) 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 -- 172.21.15.16:0/4155841876 learned_addr learned my addr 172.21.15.16:0/4155841876 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883affd640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c154170 0x7f883c150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883bfff640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883c158060 0x7f883c14e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 -- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c154170 msgr2=0x7f883c150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c154170 0x7f883c150dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 -- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883c158060 msgr2=0x7f883c14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883c158060 0x7f883c14e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 -- 172.21.15.16:0/4155841876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c158ea0 con 0x7f8824003b40 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883bfff640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883c158060 0x7f883c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883affd640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c154170 0x7f883c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.843+0000 7f883b7fe640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f883c150890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ad040 tx=0x7f8824005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c003940 con 0x7f8824003b40 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c003aa0 con 0x7f8824003b40 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c003e30 con 0x7f8824003b40 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c158600 con 0x7f8824003b40 2023-11-28T17:40:14.850 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c14e8c0 con 0x7f8824003b40 2023-11-28T17:40:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c0b0a10 con 0x7f8824003b40 2023-11-28T17:40:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f882c0b5430 con 0x7f8824003b40 2023-11-28T17:40:14.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8823fff640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88280668d0 0x7f8828068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:14.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f882c11e950 con 0x7f8824003b40 2023-11-28T17:40:14.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.847+0000 7f883affd640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88280668d0 0x7f8828068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:14.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.851+0000 7f883affd640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88280668d0 0x7f8828068d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8830000fe0 tx=0x7f8830009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:14.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:14.851+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f882c0ebc10 con 0x7f8824003b40 2023-11-28T17:40:15.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f883c068860 con 0x7f8824003b40 2023-11-28T17:40:15.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8823fff640 1 -- 172.21.15.16:0/4155841876 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f882c0c5020 con 0x7f8824003b40 2023-11-28T17:40:15.046 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:15.047 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:40:15.047 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88280668d0 msgr2=0x7f8828068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88280668d0 0x7f8828068d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8830000fe0 tx=0x7f8830009040 comp rx=0 tx=0).stop 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 msgr2=0x7f883c150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f883c150890 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ad040 tx=0x7f8824005800 comp rx=0 tx=0).stop 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 shutdown_connections 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88280668d0 0x7f8828068d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883c158060 0x7f883c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f883c154170 0x7f883c150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 --2- 172.21.15.16:0/4155841876 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8824003b40 0x7f883c150890 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 >> 172.21.15.16:0/4155841876 conn(0x7f883c06a5a0 msgr2=0x7f883c0b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:15.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 shutdown_connections 2023-11-28T17:40:15.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.043+0000 7f8841add640 1 -- 172.21.15.16:0/4155841876 wait complete. 2023-11-28T17:40:15.068 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:15.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 Processor -- start 2023-11-28T17:40:15.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 -- start start 2023-11-28T17:40:15.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a3415a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a340cf8a0 0x7f1a3406c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a34070700 con 0x7f1a3406c870 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3406cd00 con 0x7f1a340cf8a0 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3c46b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3415ad80 con 0x7f1a341574c0 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a39a06640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a340cf8a0 0x7f1a3406c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3aa08640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1a3406c870 0x7f1a3415d3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44016/0 (socket says 172.21.15.16:44016) 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3aa08640 1 -- 172.21.15.16:0/1761531973 learned_addr learned my addr 172.21.15.16:0/1761531973 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a3a207640 1 --2- 172.21.15.16:0/1761531973 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a3415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a39a06640 1 -- 172.21.15.16:0/1761531973 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 msgr2=0x7f1a3415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:15.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a39a06640 1 --2- 172.21.15.16:0/1761531973 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a3415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a39a06640 1 -- 172.21.15.16:0/1761531973 >> v1:172.21.15.16:6789/0 conn(0x7f1a3406c870 legacy=0x7f1a3415d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.211+0000 7f1a39a06640 1 -- 172.21.15.16:0/1761531973 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a340b3020 con 0x7f1a340cf8a0 2023-11-28T17:40:15.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a39a06640 1 --2- 172.21.15.16:0/1761531973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a340cf8a0 0x7f1a3406c330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a240097c0 tx=0x7f1a2401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632aaec381c63cfa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a39205640 1 -- 172.21.15.16:0/1761531973 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240ac630 con 0x7f1a340cf8a0 2023-11-28T17:40:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a39205640 1 -- 172.21.15.16:0/1761531973 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a240ac790 con 0x7f1a340cf8a0 2023-11-28T17:40:15.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a39205640 1 -- 172.21.15.16:0/1761531973 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240acb20 con 0x7f1a340cf8a0 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 -- 172.21.15.16:0/1761531973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a340cf8a0 msgr2=0x7f1a3406c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/1761531973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a340cf8a0 0x7f1a3406c330 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1a240097c0 tx=0x7f1a2401c450 comp rx=0 tx=0).stop 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 -- 172.21.15.16:0/1761531973 shutdown_connections 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/1761531973 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a340cf8a0 0x7f1a3406c330 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/1761531973 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a3415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 -- 172.21.15.16:0/1761531973 >> 172.21.15.16:0/1761531973 conn(0x7f1a3406a5a0 msgr2=0x7f1a3406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 -- 172.21.15.16:0/1761531973 shutdown_connections 2023-11-28T17:40:15.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 -- 172.21.15.16:0/1761531973 wait complete. 2023-11-28T17:40:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.215+0000 7f1a3c46b640 1 Processor -- start 2023-11-28T17:40:15.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- start start 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 0x7f1a34145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a340cf8a0 0x7f1a340ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a34146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340ae380 con 0x7f1a3406c870 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340addc0 con 0x7f1a340cf8a0 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a340ae0a0 con 0x7f1a341574c0 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 0x7f1a34145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 0x7f1a34145f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55518/0 (socket says 172.21.15.16:55518) 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 -- 172.21.15.16:0/3707158763 learned_addr learned my addr 172.21.15.16:0/3707158763 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a39a06640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a340cf8a0 0x7f1a340ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3aa08640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a34146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 -- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 msgr2=0x7f1a34146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a34146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 -- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a340cf8a0 msgr2=0x7f1a340ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a340cf8a0 0x7f1a340ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 -- 172.21.15.16:0/3707158763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a24009420 con 0x7f1a3406c870 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a39a06640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a340cf8a0 0x7f1a340ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:15.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3a207640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 0x7f1a34145f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000e930 tx=0x7f1a3000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a30009690 con 0x7f1a3406c870 2023-11-28T17:40:15.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3000ca00 con 0x7f1a3406c870 2023-11-28T17:40:15.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000cd70 con 0x7f1a3406c870 2023-11-28T17:40:15.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a340ac950 con 0x7f1a3406c870 2023-11-28T17:40:15.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a341464b0 con 0x7f1a3406c870 2023-11-28T17:40:15.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.219+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a340b4050 con 0x7f1a3406c870 2023-11-28T17:40:15.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.223+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a30013470 con 0x7f1a3406c870 2023-11-28T17:40:15.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.223+0000 7f1a2affd640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a180668d0 0x7f1a18068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.223+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a30084710 con 0x7f1a3406c870 2023-11-28T17:40:15.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.223+0000 7f1a39a06640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a180668d0 0x7f1a18068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.223+0000 7f1a39a06640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a180668d0 0x7f1a18068d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a240ae000 tx=0x7f1a240a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.227+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1a30051970 con 0x7f1a3406c870 2023-11-28T17:40:15.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.383+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a341664b0 con 0x7f1a3406c870 2023-11-28T17:40:15.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.383+0000 7f1a2affd640 1 -- 172.21.15.16:0/3707158763 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f1a30054f90 con 0x7f1a3406c870 2023-11-28T17:40:15.388 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:15.388 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":22,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:39:36.044721+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a180668d0 msgr2=0x7f1a18068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a180668d0 0x7f1a18068d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a240ae000 tx=0x7f1a240a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 msgr2=0x7f1a34145f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 0x7f1a34145f70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000e930 tx=0x7f1a3000edf0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 shutdown_connections 2023-11-28T17:40:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a341574c0 0x7f1a34146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a180668d0 0x7f1a18068d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a340cf8a0 0x7f1a340ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 --2- 172.21.15.16:0/3707158763 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a3406c870 0x7f1a34145f70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 >> 172.21.15.16:0/3707158763 conn(0x7f1a3406a5a0 msgr2=0x7f1a340b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 shutdown_connections 2023-11-28T17:40:15.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.387+0000 7f1a3c46b640 1 -- 172.21.15.16:0/3707158763 wait complete. 2023-11-28T17:40:15.410 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T17:40:15.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:40:15.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 Processor -- start 2023-11-28T17:40:15.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 -- start start 2023-11-28T17:40:15.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f892c15d620 0x7f892c0cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f892c06d300 0x7f892c161a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06e880 0x7f892c06ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c06f250 con 0x7f892c06d300 2023-11-28T17:40:15.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c0cbcd0 con 0x7f892c15d620 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f89321d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c161f70 con 0x7f892c06e880 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f892affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f892c06d300 0x7f892c161a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f892affd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f892c06d300 0x7f892c161a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55534/0 (socket says 172.21.15.16:55534) 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f892affd640 1 -- 172.21.15.16:0/1053055959 learned_addr learned my addr 172.21.15.16:0/1053055959 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f892bfff640 1 --2- 172.21.15.16:0/1053055959 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06e880 0x7f892c06ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.551+0000 7f892b7fe640 1 --2- 172.21.15.16:0/1053055959 >> v2:172.21.15.64:3300/0 conn(0x7f892c15d620 0x7f892c0cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892affd640 1 -- 172.21.15.16:0/1053055959 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06e880 msgr2=0x7f892c06ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892affd640 1 --2- 172.21.15.16:0/1053055959 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06e880 0x7f892c06ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892affd640 1 -- 172.21.15.16:0/1053055959 >> v2:172.21.15.64:3300/0 conn(0x7f892c15d620 msgr2=0x7f892c0cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892affd640 1 --2- 172.21.15.16:0/1053055959 >> v2:172.21.15.64:3300/0 conn(0x7f892c15d620 0x7f892c0cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892affd640 1 -- 172.21.15.16:0/1053055959 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c0cee20 con 0x7f892c06d300 2023-11-28T17:40:15.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892affd640 1 --2- 172.21.15.16:0/1053055959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c06d300 0x7f892c161a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8920009870 tx=0x7f892001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112cf4b97839fd64 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892a7fc640 1 -- 172.21.15.16:0/1053055959 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200aa5f0 con 0x7f892c06d300 2023-11-28T17:40:15.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892a7fc640 1 -- 172.21.15.16:0/1053055959 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89200aa750 con 0x7f892c06d300 2023-11-28T17:40:15.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f892a7fc640 1 -- 172.21.15.16:0/1053055959 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89200aaae0 con 0x7f892c06d300 2023-11-28T17:40:15.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 -- 172.21.15.16:0/1053055959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c06d300 msgr2=0x7f892c161a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 --2- 172.21.15.16:0/1053055959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c06d300 0x7f892c161a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8920009870 tx=0x7f892001c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 -- 172.21.15.16:0/1053055959 shutdown_connections 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 --2- 172.21.15.16:0/1053055959 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06e880 0x7f892c06ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 --2- 172.21.15.16:0/1053055959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c06d300 0x7f892c161a30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 --2- 172.21.15.16:0/1053055959 >> v2:172.21.15.64:3300/0 conn(0x7f892c15d620 0x7f892c0cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 -- 172.21.15.16:0/1053055959 >> 172.21.15.16:0/1053055959 conn(0x7f892c06a5a0 msgr2=0x7f892c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 -- 172.21.15.16:0/1053055959 shutdown_connections 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.555+0000 7f89321d1640 1 -- 172.21.15.16:0/1053055959 wait complete. 2023-11-28T17:40:15.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 Processor -- start 2023-11-28T17:40:15.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 -- start start 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06d300 0x7f892c154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892c06e880 0x7f892c156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 0x7f892c1573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c160140 con 0x7f892c15d620 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c160950 con 0x7f892c06e880 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f89321d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c155d50 con 0x7f892c06d300 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 0x7f892c1573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 0x7f892c1573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55536/0 (socket says 172.21.15.16:55536) 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 -- 172.21.15.16:0/1408669318 learned_addr learned my addr 172.21.15.16:0/1408669318 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892affd640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892c06e880 0x7f892c156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892b7fe640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06d300 0x7f892c154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 -- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06d300 msgr2=0x7f892c154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06d300 0x7f892c154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 -- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892c06e880 msgr2=0x7f892c156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892c06e880 0x7f892c156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 -- 172.21.15.16:0/1408669318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200094d0 con 0x7f892c15d620 2023-11-28T17:40:15.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.559+0000 7f892bfff640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 0x7f892c1573e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8924007e70 tx=0x7f892400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924014620 con 0x7f892c15d620 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89240147a0 con 0x7f892c15d620 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8924014b50 con 0x7f892c15d620 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892c1561e0 con 0x7f892c15d620 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c160670 con 0x7f892c15d620 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892c155ee0 con 0x7f892c15d620 2023-11-28T17:40:15.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8924014cb0 con 0x7f892c15d620 2023-11-28T17:40:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f8913fff640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f89180668d0 0x7f8918068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8924084d00 con 0x7f892c15d620 2023-11-28T17:40:15.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.563+0000 7f892b7fe640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f89180668d0 0x7f8918068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.567+0000 7f892b7fe640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f89180668d0 0x7f8918068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f892c15b0b0 tx=0x7f891c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.567+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8924051fc0 con 0x7f892c15d620 2023-11-28T17:40:15.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.755+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f892c068860 con 0x7f892c15d620 2023-11-28T17:40:15.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.755+0000 7f8913fff640 1 -- 172.21.15.16:0/1408669318 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7f89240555e0 con 0x7f892c15d620 2023-11-28T17:40:15.759 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:15.759 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:40:15.760 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:40:15.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f89180668d0 msgr2=0x7f8918068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f89180668d0 0x7f8918068d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f892c15b0b0 tx=0x7f891c008040 comp rx=0 tx=0).stop 2023-11-28T17:40:15.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 msgr2=0x7f892c1573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 0x7f892c1573e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8924007e70 tx=0x7f892400e4b0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 shutdown_connections 2023-11-28T17:40:15.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f892c15d620 0x7f892c1573e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f89180668d0 0x7f8918068d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892c06e880 0x7f892c156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 --2- 172.21.15.16:0/1408669318 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f892c06d300 0x7f892c154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 >> 172.21.15.16:0/1408669318 conn(0x7f892c06a5a0 msgr2=0x7f892c0c4130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:15.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 shutdown_connections 2023-11-28T17:40:15.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.759+0000 7f89321d1640 1 -- 172.21.15.16:0/1408669318 wait complete. 2023-11-28T17:40:15.781 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:40:15.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.919+0000 7fc24b0fe640 1 Processor -- start 2023-11-28T17:40:15.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.919+0000 7fc24b0fe640 1 -- start start 2023-11-28T17:40:15.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24b0fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2440cef30 0x7fc2440cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24b0fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc244070dd0 0x7fc244071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24b0fe640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440ce4f0 con 0x7fc244144c80 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24b0fe640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440709b0 con 0x7fc244070dd0 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24b0fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc244145060 con 0x7fc2440cef30 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc248e9a640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc244144c80 0x7fc2440cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44028/0 (socket says 172.21.15.16:44028) 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24969b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc244070dd0 0x7fc244071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc248e9a640 1 -- 172.21.15.16:0/3811448967 learned_addr learned my addr 172.21.15.16:0/3811448967 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:15.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc243fff640 1 --2- 172.21.15.16:0/3811448967 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2440cef30 0x7fc2440cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24969b640 1 -- 172.21.15.16:0/3811448967 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2440cef30 msgr2=0x7fc2440cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:15.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24969b640 1 --2- 172.21.15.16:0/3811448967 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2440cef30 0x7fc2440cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24969b640 1 -- 172.21.15.16:0/3811448967 >> v1:172.21.15.16:6789/0 conn(0x7fc244144c80 legacy=0x7fc2440cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24969b640 1 -- 172.21.15.16:0/3811448967 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440ce7d0 con 0x7fc244070dd0 2023-11-28T17:40:15.926 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc2437fe640 1 -- 172.21.15.16:0/3811448967 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078323177 0 0) 0x7fc2440ce4f0 con 0x7fc244144c80 2023-11-28T17:40:15.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc24969b640 1 --2- 172.21.15.16:0/3811448967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244070dd0 0x7fc244071260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009d90 tx=0x7fc23c01c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a98acdc709eec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc2437fe640 1 -- 172.21.15.16:0/3811448967 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0a5740 con 0x7fc244070dd0 2023-11-28T17:40:15.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc2437fe640 1 -- 172.21.15.16:0/3811448967 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0a58a0 con 0x7fc244070dd0 2023-11-28T17:40:15.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.923+0000 7fc2437fe640 1 -- 172.21.15.16:0/3811448967 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0a5c30 con 0x7fc244070dd0 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3811448967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244070dd0 msgr2=0x7fc244071260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3811448967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244070dd0 0x7fc244071260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fc23c009d90 tx=0x7fc23c01c770 comp rx=0 tx=0).stop 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3811448967 shutdown_connections 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3811448967 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244070dd0 0x7fc244071260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3811448967 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc2440cef30 0x7fc2440cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3811448967 >> 172.21.15.16:0/3811448967 conn(0x7fc24406a5a0 msgr2=0x7fc24406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:15.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3811448967 shutdown_connections 2023-11-28T17:40:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3811448967 wait complete. 2023-11-28T17:40:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 Processor -- start 2023-11-28T17:40:15.930 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- start start 2023-11-28T17:40:15.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc244070dd0 0x7fc2441420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2440cef30 0x7fc2441f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 0x7fc24415a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc244142620 con 0x7fc244144c80 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f7f80 con 0x7fc2440cef30 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24b0fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2441f79c0 con 0x7fc244070dd0 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24969b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 0x7fc24415a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24969b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 0x7fc24415a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55556/0 (socket says 172.21.15.16:55556) 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc24969b640 1 -- 172.21.15.16:0/3639013198 learned_addr learned my addr 172.21.15.16:0/3639013198 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc243fff640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2440cef30 0x7fc2441f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.927+0000 7fc248e9a640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc244070dd0 0x7fc2441420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24969b640 1 -- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc244070dd0 msgr2=0x7fc2441420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24969b640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc244070dd0 0x7fc2441420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24969b640 1 -- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2440cef30 msgr2=0x7fc2441f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24969b640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2440cef30 0x7fc2441f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24969b640 1 -- 172.21.15.16:0/3639013198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c009a70 con 0x7fc244144c80 2023-11-28T17:40:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc243fff640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2440cef30 0x7fc2441f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24969b640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 0x7fc24415a000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc23c01a3a0 tx=0x7fc23c019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0ad640 con 0x7fc244144c80 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c0ad7a0 con 0x7fc244144c80 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c0adb50 con 0x7fc244144c80 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2441f7ca0 con 0x7fc244144c80 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc244159ae0 con 0x7fc244144c80 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244159d00 con 0x7fc244144c80 2023-11-28T17:40:15.935 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.931+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc23c0b4070 con 0x7fc244144c80 2023-11-28T17:40:15.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.935+0000 7fc2417fa640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc2280668d0 0x7fc228068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:15.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.935+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc23c11ebf0 con 0x7fc244144c80 2023-11-28T17:40:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.935+0000 7fc248e9a640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc2280668d0 0x7fc228068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:15.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.935+0000 7fc248e9a640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc2280668d0 0x7fc228068d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc238000f70 tx=0x7fc238007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:15.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:15.939+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc23c0ebe80 con 0x7fc244144c80 2023-11-28T17:40:16.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc244068860 con 0x7fc244144c80 2023-11-28T17:40:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc2417fa640 1 -- 172.21.15.16:0/3639013198 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4907 (secure 0 0 0) 0x7fc23c0ef4a0 con 0x7fc244144c80 2023-11-28T17:40:16.130 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:16.130 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/2330232832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2330232832},{"type":"v1","addr":"172.21.15.64:6836","nonce":2330232832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4290,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2984216177","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2984216177},{"type":"v1","addr":"172.21.15.16:6834","nonce":2984216177}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/4140902530","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":4140902530},{"type":"v1","addr":"172.21.15.16:6835","nonce":4140902530}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:39:34.527033+0000","modified":"2023-11-28T17:39:37.774627+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6837/3552980398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3552980398},{"type":"v1","addr":"172.21.15.64:6837","nonce":3552980398}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T17:40:16.130 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 8 2023-11-28T17:40:16.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc2280668d0 msgr2=0x7fc228068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc2280668d0 0x7fc228068d90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc238000f70 tx=0x7fc238007b60 comp rx=0 tx=0).stop 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 msgr2=0x7fc24415a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 0x7fc24415a000 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc23c01a3a0 tx=0x7fc23c019510 comp rx=0 tx=0).stop 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 shutdown_connections 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc244144c80 0x7fc24415a000 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc2280668d0 0x7fc228068d90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc2440cef30 0x7fc2441f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 --2- 172.21.15.16:0/3639013198 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc244070dd0 0x7fc2441420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 >> 172.21.15.16:0/3639013198 conn(0x7fc24406a5a0 msgr2=0x7fc2440afb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 shutdown_connections 2023-11-28T17:40:16.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.127+0000 7fc24b0fe640 1 -- 172.21.15.16:0/3639013198 wait complete. 2023-11-28T17:40:16.151 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 Processor -- start 2023-11-28T17:40:16.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 -- start start 2023-11-28T17:40:16.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63f815d4e0 0x7f63f80b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f80b2e00 0x7f63f8071cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f815dc50 con 0x7f63f8070460 2023-11-28T17:40:16.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f815e8d0 con 0x7f63f815d4e0 2023-11-28T17:40:16.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63ffe9c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f815df30 con 0x7f63f80b2e00 2023-11-28T17:40:16.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63fdc38640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63f815d4e0 0x7f63f80b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63fdc38640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f63f815d4e0 0x7f63f80b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55570/0 (socket says 172.21.15.16:55570) 2023-11-28T17:40:16.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63fdc38640 1 -- 172.21.15.16:0/4123352394 learned_addr learned my addr 172.21.15.16:0/4123352394 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:16.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.291+0000 7f63fd437640 1 --2- 172.21.15.16:0/4123352394 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f80b2e00 0x7f63f8071cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fdc38640 1 -- 172.21.15.16:0/4123352394 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f80b2e00 msgr2=0x7f63f8071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:16.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fdc38640 1 --2- 172.21.15.16:0/4123352394 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f80b2e00 0x7f63f8071cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fdc38640 1 -- 172.21.15.16:0/4123352394 >> v1:172.21.15.64:6789/0 conn(0x7f63f8070460 legacy=0x7f63f806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:16.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fdc38640 1 -- 172.21.15.16:0/4123352394 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f815e210 con 0x7f63f815d4e0 2023-11-28T17:40:16.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fdc38640 1 --2- 172.21.15.16:0/4123352394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f815d4e0 0x7f63f80b28c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6f216c743b975a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:16.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fcc36640 1 -- 172.21.15.16:0/4123352394 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40ad640 con 0x7f63f815d4e0 2023-11-28T17:40:16.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fcc36640 1 -- 172.21.15.16:0/4123352394 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40ad7a0 con 0x7f63f815d4e0 2023-11-28T17:40:16.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63fcc36640 1 -- 172.21.15.16:0/4123352394 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40adb30 con 0x7f63f815d4e0 2023-11-28T17:40:16.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63ffe9c640 1 -- 172.21.15.16:0/4123352394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f815d4e0 msgr2=0x7f63f80b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/4123352394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f815d4e0 0x7f63f80b28c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f63f4009870 tx=0x7f63f401c480 comp rx=0 tx=0).stop 2023-11-28T17:40:16.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63ffe9c640 1 -- 172.21.15.16:0/4123352394 shutdown_connections 2023-11-28T17:40:16.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/4123352394 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f80b2e00 0x7f63f8071cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/4123352394 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f815d4e0 0x7f63f80b28c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.295+0000 7f63ffe9c640 1 -- 172.21.15.16:0/4123352394 >> 172.21.15.16:0/4123352394 conn(0x7f63f806a5a0 msgr2=0x7f63f806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:16.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 -- 172.21.15.16:0/4123352394 shutdown_connections 2023-11-28T17:40:16.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 -- 172.21.15.16:0/4123352394 wait complete. 2023-11-28T17:40:16.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 Processor -- start 2023-11-28T17:40:16.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 -- start start 2023-11-28T17:40:16.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 0x7f63f814bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.303 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f815d4e0 0x7f63f814d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 0x7f63f814bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 0x7f63f814bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55580/0 (socket says 172.21.15.16:55580) 2023-11-28T17:40:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fd437640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f815d4e0 0x7f63f814d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f814b6a0 0x7f63f814dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 -- 172.21.15.16:0/267936660 learned_addr learned my addr 172.21.15.16:0/267936660 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f814e6d0 con 0x7f63f8070460 2023-11-28T17:40:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f81611a0 con 0x7f63f815d4e0 2023-11-28T17:40:16.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f814e3f0 con 0x7f63f814b6a0 2023-11-28T17:40:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fe439640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f814b6a0 0x7f63f814dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 -- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f814b6a0 msgr2=0x7f63f814dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f814b6a0 0x7f63f814dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 -- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f815d4e0 msgr2=0x7f63f814d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f815d4e0 0x7f63f814d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f40094d0 con 0x7f63f8070460 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fe439640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f814b6a0 0x7f63f814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.299+0000 7f63fdc38640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 0x7f63f814bb60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63f40b0040 tx=0x7f63f4019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40b6830 con 0x7f63f8070460 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f40a6040 con 0x7f63f8070460 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f80af660 con 0x7f63f8070460 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40b6bb0 con 0x7f63f8070460 2023-11-28T17:40:16.309 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f80afb80 con 0x7f63f8070460 2023-11-28T17:40:16.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f8068860 con 0x7f63f8070460 2023-11-28T17:40:16.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f63f40b4070 con 0x7f63f8070460 2023-11-28T17:40:16.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ee7fc640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63dc0668d0 0x7f63dc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f63f411ec70 con 0x7f63f8070460 2023-11-28T17:40:16.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.303+0000 7f63fd437640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63dc0668d0 0x7f63dc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.307+0000 7f63fd437640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63dc0668d0 0x7f63dc068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63e8007a60 tx=0x7f63e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:16.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.307+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f63f40ebe80 con 0x7f63f8070460 2023-11-28T17:40:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.467+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63f80ae250 con 0x7f63f8070460 2023-11-28T17:40:16.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.467+0000 7f63ee7fc640 1 -- 172.21.15.16:0/267936660 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16510 (secure 0 0 0) 0x7f63f40b2070 con 0x7f63f8070460 2023-11-28T17:40:16.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:16.472 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":23,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:40:15.531253+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:39:32.985702+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T17:39:33.437949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63dc0668d0 msgr2=0x7f63dc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63dc0668d0 0x7f63dc068d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f63e8007a60 tx=0x7f63e8008040 comp rx=0 tx=0).stop 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 msgr2=0x7f63f814bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 0x7f63f814bb60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f63f40b0040 tx=0x7f63f4019220 comp rx=0 tx=0).stop 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 shutdown_connections 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f63f814b6a0 0x7f63f814dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f63dc0668d0 0x7f63dc068d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63f815d4e0 0x7f63f814d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 --2- 172.21.15.16:0/267936660 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f63f8070460 0x7f63f814bb60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 >> 172.21.15.16:0/267936660 conn(0x7f63f806a5a0 msgr2=0x7f63f80cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:16.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 shutdown_connections 2023-11-28T17:40:16.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.471+0000 7f63ffe9c640 1 -- 172.21.15.16:0/267936660 wait complete. 2023-11-28T17:40:16.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T17:40:16.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 Processor -- start 2023-11-28T17:40:16.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 -- start start 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c15d2c0 0x7efe4c0d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe4c0d0300 0x7efe4c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe4c0afdb0 con 0x7efe4c0d1d00 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe4c0b34b0 con 0x7efe4c0d0300 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe519d0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b2b80 con 0x7efe4c15d2c0 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe4c0d0300 0x7efe4c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efe4c0d0300 0x7efe4c0b3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55592/0 (socket says 172.21.15.16:55592) 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 -- 172.21.15.16:0/2062673652 learned_addr learned my addr 172.21.15.16:0/2062673652 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe509ce640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c15d2c0 0x7efe4c0d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 -- 172.21.15.16:0/2062673652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c15d2c0 msgr2=0x7efe4c0d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:16.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c15d2c0 0x7efe4c0d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 -- 172.21.15.16:0/2062673652 >> v1:172.21.15.64:6789/0 conn(0x7efe4c0d1d00 legacy=0x7efe4c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:16.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe511cf640 1 -- 172.21.15.16:0/2062673652 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c0b2e60 con 0x7efe4c0d0300 2023-11-28T17:40:16.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.635+0000 7efe509ce640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c15d2c0 0x7efe4c0d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:16.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe511cf640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c0d0300 0x7efe4c0b3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe44009e80 tx=0x7efe4401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb76f6961094d6d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:16.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe4b7fe640 1 -- 172.21.15.16:0/2062673652 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440a57c0 con 0x7efe4c0d0300 2023-11-28T17:40:16.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe4b7fe640 1 -- 172.21.15.16:0/2062673652 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe440a5920 con 0x7efe4c0d0300 2023-11-28T17:40:16.643 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe4b7fe640 1 -- 172.21.15.16:0/2062673652 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440a5cb0 con 0x7efe4c0d0300 2023-11-28T17:40:16.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 -- 172.21.15.16:0/2062673652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c0d0300 msgr2=0x7efe4c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c0d0300 0x7efe4c0b3940 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe44009e80 tx=0x7efe4401c980 comp rx=0 tx=0).stop 2023-11-28T17:40:16.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 -- 172.21.15.16:0/2062673652 shutdown_connections 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c0d0300 0x7efe4c0b3940 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 --2- 172.21.15.16:0/2062673652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c15d2c0 0x7efe4c0d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 -- 172.21.15.16:0/2062673652 >> 172.21.15.16:0/2062673652 conn(0x7efe4c09c550 msgr2=0x7efe4c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 -- 172.21.15.16:0/2062673652 shutdown_connections 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.639+0000 7efe519d0640 1 -- 172.21.15.16:0/2062673652 wait complete. 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 Processor -- start 2023-11-28T17:40:16.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 -- start start 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c0d0300 0x7efe4c146370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4c0d1d00 0x7efe4c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 0x7efe4c0b6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b6880 con 0x7efe4c15d2c0 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c0b8c80 con 0x7efe4c0d1d00 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe519d0640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe4c15e5b0 con 0x7efe4c0d0300 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 0x7efe4c0b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 0x7efe4c0b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55602/0 (socket says 172.21.15.16:55602) 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 -- 172.21.15.16:0/195436700 learned_addr learned my addr 172.21.15.16:0/195436700 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:16.648 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe509ce640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c0d0300 0x7efe4c146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe4bfff640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4c0d1d00 0x7efe4c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 -- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c0d0300 msgr2=0x7efe4c146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c0d0300 0x7efe4c146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 -- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4c0d1d00 msgr2=0x7efe4c0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4c0d1d00 0x7efe4c0b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 -- 172.21.15.16:0/195436700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe44009b30 con 0x7efe4c15d2c0 2023-11-28T17:40:16.649 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe511cf640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 0x7efe4c0b6340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe4401d220 tx=0x7efe44019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.643+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440b8670 con 0x7efe4c15d2c0 2023-11-28T17:40:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe440b87f0 con 0x7efe4c15d2c0 2023-11-28T17:40:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe440b8ba0 con 0x7efe4c15d2c0 2023-11-28T17:40:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe4c15dc80 con 0x7efe4c15d2c0 2023-11-28T17:40:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe4c15e240 con 0x7efe4c15d2c0 2023-11-28T17:40:16.650 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4c15e740 con 0x7efe4c15d2c0 2023-11-28T17:40:16.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efe440b8d00 con 0x7efe4c15d2c0 2023-11-28T17:40:16.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe497fa640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efe30066900 0x7efe30068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:16.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efe4411f4f0 con 0x7efe4c15d2c0 2023-11-28T17:40:16.651 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.647+0000 7efe509ce640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efe30066900 0x7efe30068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:16.652 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.651+0000 7efe509ce640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efe30066900 0x7efe30068dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe40006fd0 tx=0x7efe40008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:16.655 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.651+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe440f0360 con 0x7efe4c15d2c0 2023-11-28T17:40:16.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.847+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7efe4c15e740 con 0x7efe4c15d2c0 2023-11-28T17:40:16.853 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-28T17:40:16.851+0000 7fcd3014a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T17:40:16.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.851+0000 7efe497fa640 1 -- 172.21.15.16:0/195436700 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7efe440efef0 con 0x7efe4c15d2c0 2023-11-28T17:40:16.855 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T17:40:16.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efe30066900 msgr2=0x7efe30068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efe30066900 0x7efe30068dc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7efe40006fd0 tx=0x7efe40008040 comp rx=0 tx=0).stop 2023-11-28T17:40:16.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 msgr2=0x7efe4c0b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 0x7efe4c0b6340 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efe4401d220 tx=0x7efe44019720 comp rx=0 tx=0).stop 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 shutdown_connections 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efe4c15d2c0 0x7efe4c0b6340 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efe30066900 0x7efe30068dc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe4c0d1d00 0x7efe4c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 --2- 172.21.15.16:0/195436700 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efe4c0d0300 0x7efe4c146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 >> 172.21.15.16:0/195436700 conn(0x7efe4c09c550 msgr2=0x7efe4c1568d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 shutdown_connections 2023-11-28T17:40:16.858 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:16.855+0000 7efe519d0640 1 -- 172.21.15.16:0/195436700 wait complete. 2023-11-28T17:40:16.871 INFO:tasks.ceph.mds.b.smithi064.stderr: -6703> 2023-11-28T17:39:39.221+0000 7efcbb6c1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T17:40:16.877 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T17:40:16.924 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2023-11-28T17:40:17.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 Processor -- start 2023-11-28T17:40:17.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 -- start start 2023-11-28T17:40:17.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efcdc143600 0x7efcdc0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:17.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcdc0cc210 con 0x7efcdc06d5a0 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcdc0cec20 con 0x7efcdc143600 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce3009640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc0cd680 con 0x7efcdc0b3e30 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce2007640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efcdc143600 0x7efcdc0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce2007640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7efcdc143600 0x7efcdc0ce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60700/0 (socket says 172.21.15.16:60700) 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce2007640 1 -- 172.21.15.16:0/3905922112 learned_addr learned my addr 172.21.15.16:0/3905922112 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.019+0000 7efce1806640 1 --2- 172.21.15.16:0/3905922112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce2007640 1 -- 172.21.15.16:0/3905922112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 msgr2=0x7efcdc0cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce2007640 1 --2- 172.21.15.16:0/3905922112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc0cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce2007640 1 -- 172.21.15.16:0/3905922112 >> v1:172.21.15.64:6789/0 conn(0x7efcdc06d5a0 legacy=0x7efcdc070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce2007640 1 -- 172.21.15.16:0/3905922112 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc0cd920 con 0x7efcdc143600 2023-11-28T17:40:17.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce1005640 1 -- 172.21.15.16:0/3905922112 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776462757 0 0) 0x7efcdc0cc210 con 0x7efcdc06d5a0 2023-11-28T17:40:17.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce2007640 1 --2- 172.21.15.16:0/3905922112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc0ce6e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009870 tx=0x7efcd801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebeef33cf98e4ac7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:17.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce1005640 1 -- 172.21.15.16:0/3905922112 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80aa670 con 0x7efcdc143600 2023-11-28T17:40:17.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce1005640 1 -- 172.21.15.16:0/3905922112 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd80aa7d0 con 0x7efcdc143600 2023-11-28T17:40:17.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce1005640 1 -- 172.21.15.16:0/3905922112 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd80aab60 con 0x7efcdc143600 2023-11-28T17:40:17.028 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce3009640 1 -- 172.21.15.16:0/3905922112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 msgr2=0x7efcdc0ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.023+0000 7efce3009640 1 --2- 172.21.15.16:0/3905922112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc0ce6e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efcd8009870 tx=0x7efcd801c510 comp rx=0 tx=0).stop 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- 172.21.15.16:0/3905922112 shutdown_connections 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 --2- 172.21.15.16:0/3905922112 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc0cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 --2- 172.21.15.16:0/3905922112 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc0ce6e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- 172.21.15.16:0/3905922112 >> 172.21.15.16:0/3905922112 conn(0x7efcdc06aba0 msgr2=0x7efcdc0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- 172.21.15.16:0/3905922112 shutdown_connections 2023-11-28T17:40:17.029 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- 172.21.15.16:0/3905922112 wait complete. 2023-11-28T17:40:17.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 Processor -- start 2023-11-28T17:40:17.030 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- start start 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc06d5a0 0x7efcdc13b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc13c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc162d20 con 0x7efcdc143600 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc13bf20 con 0x7efcdc06d5a0 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce3009640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcdc1620a0 con 0x7efcdc0b3e30 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc13c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce1806640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:17.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc13c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60710/0 (socket says 172.21.15.16:60710) 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 -- 172.21.15.16:0/1373635109 learned_addr learned my addr 172.21.15.16:0/1373635109 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2007640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc06d5a0 0x7efcdc13b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 -- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 msgr2=0x7efcdc159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 -- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc06d5a0 msgr2=0x7efcdc13b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc06d5a0 0x7efcdc13b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 -- 172.21.15.16:0/1373635109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80094d0 con 0x7efcdc143600 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce1806640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:17.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.027+0000 7efce2808640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc13c9d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c780 tx=0x7efcd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:17.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4003db0 con 0x7efcdc143600 2023-11-28T17:40:17.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd400ce90 con 0x7efcdc143600 2023-11-28T17:40:17.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd40052b0 con 0x7efcdc143600 2023-11-28T17:40:17.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcdc162380 con 0x7efcdc143600 2023-11-28T17:40:17.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcdc162940 con 0x7efcdc143600 2023-11-28T17:40:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcdc0cca70 con 0x7efcdc143600 2023-11-28T17:40:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7efcd4005410 con 0x7efcdc143600 2023-11-28T17:40:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efcd2ffd640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efcc0066920 0x7efcc0068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5824+0+0 (secure 0 0 0) 0x7efcd4084070 con 0x7efcdc143600 2023-11-28T17:40:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.031+0000 7efce2007640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efcc0066920 0x7efcc0068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:17.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.035+0000 7efce2007640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efcc0066920 0x7efcc0068de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efcd80ae000 tx=0x7efcd80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:17.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.035+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efcd4051480 con 0x7efcdc143600 2023-11-28T17:40:17.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.227+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efcdc1f6710 con 0x7efcdc143600 2023-11-28T17:40:17.857 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efcd2ffd640 1 -- 172.21.15.16:0/1373635109 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7efcdc1f6710 con 0x7efcdc143600 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efcc0066920 msgr2=0x7efcc0068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efcc0066920 0x7efcc0068de0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efcd80ae000 tx=0x7efcd80a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 msgr2=0x7efcdc13c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc13c9d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efcd400c780 tx=0x7efcd400cc40 comp rx=0 tx=0).stop 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 shutdown_connections 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7efcdc143600 0x7efcdc13c9d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7efcdc0b3e30 0x7efcdc159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7efcc0066920 0x7efcc0068de0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 --2- 172.21.15.16:0/1373635109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efcdc06d5a0 0x7efcdc13b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:17.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 >> 172.21.15.16:0/1373635109 conn(0x7efcdc06aba0 msgr2=0x7efcdc15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:17.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 shutdown_connections 2023-11-28T17:40:17.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:17.855+0000 7efce3009640 1 -- 172.21.15.16:0/1373635109 wait complete. 2023-11-28T17:40:17.882 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T17:40:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d9d73e640 1 Processor -- start 2023-11-28T17:40:18.033 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d9d73e640 1 -- start start 2023-11-28T17:40:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d9d73e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3d980b59c0 0x7f3d980b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d9d73e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980b8720 con 0x7f3d9815d540 2023-11-28T17:40:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d9d73e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d980b7ba0 con 0x7f3d980d2950 2023-11-28T17:40:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d9d73e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980b7e80 con 0x7f3d980b59c0 2023-11-28T17:40:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3d9815d540 0x7f3d980b52b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44270/0 (socket says 172.21.15.16:44270) 2023-11-28T17:40:18.034 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 -- 172.21.15.16:0/3006419305 learned_addr learned my addr 172.21.15.16:0/3006419305 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d8ffff640 1 --2- 172.21.15.16:0/3006419305 >> v2:172.21.15.64:3300/0 conn(0x7f3d980b59c0 0x7f3d980b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876370106 0 0) 0x7f3d980b8720 con 0x7f3d9815d540 2023-11-28T17:40:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d84003530 con 0x7f3d9815d540 2023-11-28T17:40:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 966864286 0 0) 0x7f3d84003530 con 0x7f3d9815d540 2023-11-28T17:40:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 >> v2:172.21.15.64:3300/0 conn(0x7f3d980b59c0 msgr2=0x7f3d980b8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:18.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 --2- 172.21.15.16:0/3006419305 >> v2:172.21.15.64:3300/0 conn(0x7f3d980b59c0 0x7f3d980b8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 >> v1:172.21.15.64:6789/0 conn(0x7f3d980d2950 legacy=0x7f3d980b62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980b8160 con 0x7f3d9815d540 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f3d88001680 con 0x7f3d9815d540 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 >> v1:172.21.15.16:6789/0 conn(0x7f3d9815d540 legacy=0x7f3d980b52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d84003980 0x7f3d84003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d840047d0 0x7f3d84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84005190 0x7f3d8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980b7e80 con 0x7f3d84003980 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8400c030 con 0x7f3d840047d0 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8400c1f0 con 0x7f3d84005190 2023-11-28T17:40:18.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d84003980 0x7f3d84003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d8ffff640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d840047d0 0x7f3d84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d977fe640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84005190 0x7f3d8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 -- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84005190 msgr2=0x7f3d8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84005190 0x7f3d8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 -- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d840047d0 msgr2=0x7f3d84004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d840047d0 0x7f3d84004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d96ffd640 1 -- 172.21.15.16:0/3006419305 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d84003530 con 0x7f3d84003980 2023-11-28T17:40:18.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.031+0000 7f3d977fe640 1 -- 172.21.15.16:0/3006419305 reap_dead start 2023-11-28T17:40:18.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d84003980 0x7f3d84003da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c240 tx=0x7f3d8801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97241881a8fc0228 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88005ae0 con 0x7f3d84003980 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88005c40 con 0x7f3d84003980 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d967fc640 1 -- 172.21.15.16:0/3006419305 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880072b0 con 0x7f3d84003980 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 -- 172.21.15.16:0/3006419305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d84003980 msgr2=0x7f3d84003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d84003980 0x7f3d84003da0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3d8800c240 tx=0x7f3d8801cc40 comp rx=0 tx=0).stop 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 -- 172.21.15.16:0/3006419305 shutdown_connections 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/3006419305 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d84003980 0x7f3d84003da0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 -- 172.21.15.16:0/3006419305 >> 172.21.15.16:0/3006419305 conn(0x7f3d980720d0 msgr2=0x7f3d980724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 -- 172.21.15.16:0/3006419305 shutdown_connections 2023-11-28T17:40:18.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.035+0000 7f3d9d73e640 1 -- 172.21.15.16:0/3006419305 wait complete. 2023-11-28T17:40:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 Processor -- start 2023-11-28T17:40:18.042 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 -- start start 2023-11-28T17:40:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84003980 0x7f3d981f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d98156390 0x7f3d98156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 0x7f3d9815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d98156d50 con 0x7f3d9815f820 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981605a0 con 0x7f3d98156390 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d98158a20 con 0x7f3d84003980 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 0x7f3d9815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 0x7f3d9815fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60718/0 (socket says 172.21.15.16:60718) 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 -- 172.21.15.16:0/784531376 learned_addr learned my addr 172.21.15.16:0/784531376 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84003980 0x7f3d981f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d8ffff640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d98156390 0x7f3d98156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 -- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84003980 msgr2=0x7f3d981f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84003980 0x7f3d981f5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.045 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 -- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d98156390 msgr2=0x7f3d98156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d98156390 0x7f3d98156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 -- 172.21.15.16:0/784531376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d98158d00 con 0x7f3d9815f820 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d977fe640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 0x7f3d9815fca0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3d980b61d0 tx=0x7f3d9000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000eed0 con 0x7f3d9815f820 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d98158fe0 con 0x7f3d9815f820 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d90003980 con 0x7f3d9815f820 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90003d70 con 0x7f3d9815f820 2023-11-28T17:40:18.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.039+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d981601e0 con 0x7f3d9815f820 2023-11-28T17:40:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.043+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d98067a50 con 0x7f3d9815f820 2023-11-28T17:40:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.043+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3d900050d0 con 0x7f3d9815f820 2023-11-28T17:40:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.043+0000 7f3d8f7fe640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3d78066900 0x7f3d78068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.043+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f3d900841b0 con 0x7f3d9815f820 2023-11-28T17:40:18.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.043+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3d78066900 0x7f3d78068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:18.048 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.043+0000 7f3d96ffd640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3d78066900 0x7f3d78068dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ab000 tx=0x7f3d880b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:18.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.047+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d90051310 con 0x7f3d9815f820 2023-11-28T17:40:18.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.207+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3d98068860 con 0x7f3d9815f820 2023-11-28T17:40:18.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.855+0000 7f3d8f7fe640 1 -- 172.21.15.16:0/784531376 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3d90059e60 con 0x7f3d9815f820 2023-11-28T17:40:18.860 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2023-11-28T17:40:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3d78066900 msgr2=0x7f3d78068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3d78066900 0x7f3d78068dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3d880ab000 tx=0x7f3d880b1040 comp rx=0 tx=0).stop 2023-11-28T17:40:18.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 msgr2=0x7f3d9815fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 0x7f3d9815fca0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3d980b61d0 tx=0x7f3d9000eb90 comp rx=0 tx=0).stop 2023-11-28T17:40:18.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 shutdown_connections 2023-11-28T17:40:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3d9815f820 0x7f3d9815fca0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3d78066900 0x7f3d78068dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3d98156390 0x7f3d98156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 --2- 172.21.15.16:0/784531376 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3d84003980 0x7f3d981f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:18.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.859+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 >> 172.21.15.16:0/784531376 conn(0x7f3d980720d0 msgr2=0x7f3d980c8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.863+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 shutdown_connections 2023-11-28T17:40:18.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:18.863+0000 7f3d9d73e640 1 -- 172.21.15.16:0/784531376 wait complete. 2023-11-28T17:40:18.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T17:40:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 Processor -- start 2023-11-28T17:40:19.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 -- start start 2023-11-28T17:40:19.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6406d490 0x7f1c6415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1c6406e880 0x7f1c6406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6415def0 con 0x7f1c6415aff0 2023-11-28T17:40:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6406f250 con 0x7f1c6406e880 2023-11-28T17:40:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.043+0000 7f1c6bb2a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640d1060 con 0x7f1c6406d490 2023-11-28T17:40:19.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c6a0c7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1c6406e880 0x7f1c6406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:19.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c690c5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6406d490 0x7f1c6415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:19.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c698c6640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1c6415aff0 0x7f1c640ce5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:36070/0 (socket says 172.21.15.16:36070) 2023-11-28T17:40:19.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c6a0c7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1c6406e880 0x7f1c6406ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:49674/0 (socket says 172.21.15.16:49674) 2023-11-28T17:40:19.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c698c6640 1 -- 172.21.15.16:0/719751444 learned_addr learned my addr 172.21.15.16:0/719751444 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:19.051 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c690c5640 1 -- 172.21.15.16:0/719751444 >> v2:172.21.15.64:3300/0 conn(0x7f1c6406e880 msgr2=0x7f1c6406ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:19.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c690c5640 1 --2- 172.21.15.16:0/719751444 >> v2:172.21.15.64:3300/0 conn(0x7f1c6406e880 0x7f1c6406ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c690c5640 1 -- 172.21.15.16:0/719751444 >> v1:172.21.15.64:6789/0 conn(0x7f1c6415aff0 legacy=0x7f1c640ce5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:19.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c690c5640 1 -- 172.21.15.16:0/719751444 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640d1320 con 0x7f1c6406d490 2023-11-28T17:40:19.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c688c4640 1 -- 172.21.15.16:0/719751444 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967718338 0 0) 0x7f1c6415def0 con 0x7f1c6415aff0 2023-11-28T17:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c690c5640 1 --2- 172.21.15.16:0/719751444 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6406d490 0x7f1c6415d9b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097c0 tx=0x7f1c5401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec82b945429f7a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c688c4640 1 -- 172.21.15.16:0/719751444 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540ab600 con 0x7f1c6406d490 2023-11-28T17:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c688c4640 1 -- 172.21.15.16:0/719751444 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c540a7050 con 0x7f1c6406d490 2023-11-28T17:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.047+0000 7f1c688c4640 1 -- 172.21.15.16:0/719751444 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540ab980 con 0x7f1c6406d490 2023-11-28T17:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/719751444 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6406d490 msgr2=0x7f1c6415d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:19.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/719751444 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6406d490 0x7f1c6415d9b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1c540097c0 tx=0x7f1c5401c330 comp rx=0 tx=0).stop 2023-11-28T17:40:19.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/719751444 shutdown_connections 2023-11-28T17:40:19.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/719751444 >> v2:172.21.15.64:3300/0 conn(0x7f1c6406e880 0x7f1c6406ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/719751444 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6406d490 0x7f1c6415d9b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/719751444 >> 172.21.15.16:0/719751444 conn(0x7f1c6406a5a0 msgr2=0x7f1c6406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:19.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/719751444 shutdown_connections 2023-11-28T17:40:19.056 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/719751444 wait complete. 2023-11-28T17:40:19.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 Processor -- start 2023-11-28T17:40:19.057 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- start start 2023-11-28T17:40:19.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6406d490 0x7f1c64155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:19.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 0x7f1c640c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:19.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6415aff0 0x7f1c64159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:19.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64156230 con 0x7f1c6406e880 2023-11-28T17:40:19.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640c8750 con 0x7f1c6406d490 2023-11-28T17:40:19.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6bb2a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641598a0 con 0x7f1c6415aff0 2023-11-28T17:40:19.061 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c690c5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 0x7f1c640c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:19.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c690c5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 0x7f1c640c8210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60726/0 (socket says 172.21.15.16:60726) 2023-11-28T17:40:19.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c690c5640 1 -- 172.21.15.16:0/4173661351 learned_addr learned my addr 172.21.15.16:0/4173661351 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:19.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c698c6640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6406d490 0x7f1c64155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:19.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.051+0000 7f1c6a0c7640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6415aff0 0x7f1c64159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:19.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c690c5640 1 -- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6415aff0 msgr2=0x7f1c64159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:19.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c690c5640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6415aff0 0x7f1c64159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c690c5640 1 -- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6406d490 msgr2=0x7f1c64155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:19.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c690c5640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6406d490 0x7f1c64155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c690c5640 1 -- 172.21.15.16:0/4173661351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54009420 con 0x7f1c6406e880 2023-11-28T17:40:19.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c690c5640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 0x7f1c640c8210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1c54019f60 tx=0x7f1c540190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:19.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540b4410 con 0x7f1c6406e880 2023-11-28T17:40:19.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c540b4570 con 0x7f1c6406e880 2023-11-28T17:40:19.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540b4920 con 0x7f1c6406e880 2023-11-28T17:40:19.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c640c8980 con 0x7f1c6406e880 2023-11-28T17:40:19.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640c8f40 con 0x7f1c6406e880 2023-11-28T17:40:19.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c64068860 con 0x7f1c6406e880 2023-11-28T17:40:19.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c540b2040 con 0x7f1c6406e880 2023-11-28T17:40:19.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.055+0000 7f1c5a7fc640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c480668d0 0x7f1c48068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:19.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.059+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f1c5411e3d0 con 0x7f1c6406e880 2023-11-28T17:40:19.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.059+0000 7f1c698c6640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c480668d0 0x7f1c48068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:19.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.059+0000 7f1c698c6640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c480668d0 0x7f1c48068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000f70 tx=0x7f1c60007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:19.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.063+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c540eb7f0 con 0x7f1c6406e880 2023-11-28T17:40:19.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.231+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1c640d0a60 con 0x7f1c6406e880 2023-11-28T17:40:19.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.859+0000 7f1c5a7fc640 1 -- 172.21.15.16:0/4173661351 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1c540eee10 con 0x7f1c6406e880 2023-11-28T17:40:19.862 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2023-11-28T17:40:19.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c480668d0 msgr2=0x7f1c48068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:19.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c480668d0 0x7f1c48068d90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c60000f70 tx=0x7f1c60007df0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 msgr2=0x7f1c640c8210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:19.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 0x7f1c640c8210 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1c54019f60 tx=0x7f1c540190d0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 shutdown_connections 2023-11-28T17:40:19.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c6415aff0 0x7f1c64159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c6406e880 0x7f1c640c8210 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1c54019f60 tx=0x7f1c540190d0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c480668d0 0x7f1c48068d90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 --2- 172.21.15.16:0/4173661351 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c6406d490 0x7f1c64155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:19.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 >> 172.21.15.16:0/4173661351 conn(0x7f1c6406a5a0 msgr2=0x7f1c640ce5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:19.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 shutdown_connections 2023-11-28T17:40:19.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:19.863+0000 7f1c6bb2a640 1 -- 172.21.15.16:0/4173661351 wait complete. 2023-11-28T17:40:19.895 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T17:40:19.895 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T17:40:19.895 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T17:40:19.895 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:40:19.895 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T17:40:19.895 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T17:40:19.896 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T17:40:19.896 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:40:19.896 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T17:40:19.896 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T17:40:19.896 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T17:40:19.896 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:40:19.897 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-28T17:40:19.897 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-28T17:40:19.897 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-28T17:40:19.897 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T17:40:19.912 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T17:40:19.912 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T17:40:19.914 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T17:40:19.914 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T17:40:19.915 INFO:tasks.ceph.mds.d:Stopped 2023-11-28T17:40:19.915 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-28T17:40:19.916 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T17:40:19.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T17:40:19.960 INFO:tasks.ceph.mds.d:Started 2023-11-28T17:40:19.960 DEBUG:teuthology.parallel:result is None 2023-11-28T17:40:19.962 INFO:tasks.ceph.mds.b:Started 2023-11-28T17:40:19.962 DEBUG:teuthology.parallel:result is None 2023-11-28T17:40:19.963 INFO:tasks.ceph.mds.a:Started 2023-11-28T17:40:19.963 DEBUG:teuthology.parallel:result is None 2023-11-28T17:40:19.965 INFO:tasks.ceph.mds.c:Started 2023-11-28T17:40:19.965 DEBUG:teuthology.parallel:result is None 2023-11-28T17:40:19.966 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T17:40:20.064 INFO:tasks.ceph.mds.d.smithi064.stdout:starting mds.d at 2023-11-28T17:40:20.065 INFO:tasks.ceph.mds.b.smithi064.stdout:starting mds.b at 2023-11-28T17:40:20.072 INFO:tasks.ceph.mds.a.smithi016.stdout:starting mds.a at 2023-11-28T17:40:20.073 INFO:tasks.ceph.mds.c.smithi016.stdout:starting mds.c at 2023-11-28T17:40:20.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 Processor -- start 2023-11-28T17:40:20.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 -- start start 2023-11-28T17:40:20.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00cfca0 0x7f46a00d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:20.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f46a00b8b80 0x7f46a00b7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:20.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a015d870 con 0x7f46a00d1b10 2023-11-28T17:40:20.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a00b6d20 con 0x7f46a00b8b80 2023-11-28T17:40:20.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a6d1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00b7000 con 0x7f46a00cfca0 2023-11-28T17:40:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a52ba640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f46a00b8b80 0x7f46a00b7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.127+0000 7f46a52ba640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f46a00b8b80 0x7f46a00b7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60752/0 (socket says 172.21.15.16:60752) 2023-11-28T17:40:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a52ba640 1 -- 172.21.15.16:0/371161117 learned_addr learned my addr 172.21.15.16:0/371161117 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a4ab9640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00cfca0 0x7f46a00d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a52ba640 1 -- 172.21.15.16:0/371161117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00cfca0 msgr2=0x7f46a00d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:20.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a52ba640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00cfca0 0x7f46a00d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a52ba640 1 -- 172.21.15.16:0/371161117 >> v1:172.21.15.64:6789/0 conn(0x7f46a00d1b10 legacy=0x7f46a00b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:20.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a52ba640 1 -- 172.21.15.16:0/371161117 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a00b72e0 con 0x7f46a00b8b80 2023-11-28T17:40:20.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f469f7fe640 1 -- 172.21.15.16:0/371161117 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666579939 0 0) 0x7f46a015d870 con 0x7f46a00d1b10 2023-11-28T17:40:20.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a4ab9640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00cfca0 0x7f46a00d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:20.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f46a52ba640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00b8b80 0x7f46a00b7dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4698009e50 tx=0x7f469801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d8e305aee13b53 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:20.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f469f7fe640 1 -- 172.21.15.16:0/371161117 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980af400 con 0x7f46a00b8b80 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f469f7fe640 1 -- 172.21.15.16:0/371161117 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46980ab050 con 0x7f46a00b8b80 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.131+0000 7f469f7fe640 1 -- 172.21.15.16:0/371161117 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46980af780 con 0x7f46a00b8b80 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- 172.21.15.16:0/371161117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00b8b80 msgr2=0x7f46a00b7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00b8b80 0x7f46a00b7dc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4698009e50 tx=0x7f469801f1f0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- 172.21.15.16:0/371161117 shutdown_connections 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00b8b80 0x7f46a00b7dc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/371161117 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00cfca0 0x7f46a00d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- 172.21.15.16:0/371161117 >> 172.21.15.16:0/371161117 conn(0x7f46a00720d0 msgr2=0x7f46a00724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- 172.21.15.16:0/371161117 shutdown_connections 2023-11-28T17:40:20.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- 172.21.15.16:0/371161117 wait complete. 2023-11-28T17:40:20.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 Processor -- start 2023-11-28T17:40:20.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- start start 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00b8b80 0x7f46a015db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 0x7f46a015e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46a00d1b10 0x7f46a014e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00abbb0 con 0x7f46a00cfca0 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00aad00 con 0x7f46a00d1b10 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a6d1d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a00aafa0 con 0x7f46a00b8b80 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 0x7f46a015e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 0x7f46a015e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60758/0 (socket says 172.21.15.16:60758) 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 -- 172.21.15.16:0/3953517837 learned_addr learned my addr 172.21.15.16:0/3953517837 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:20.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a52ba640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46a00d1b10 0x7f46a014e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f46a4ab9640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00b8b80 0x7f46a015db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 -- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00b8b80 msgr2=0x7f46a015db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00b8b80 0x7f46a015db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 -- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46a00d1b10 msgr2=0x7f46a014e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46a00d1b10 0x7f46a014e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.135+0000 7f469ffff640 1 -- 172.21.15.16:0/3953517837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009420 con 0x7f46a00cfca0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469ffff640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 0x7f46a015e0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c3f0 tx=0x7f468c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0054e0 con 0x7f46a00cfca0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c003600 con 0x7f46a00cfca0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4698009b30 con 0x7f46a00cfca0 2023-11-28T17:40:20.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c003990 con 0x7f46a00cfca0 2023-11-28T17:40:20.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a00ab560 con 0x7f46a00cfca0 2023-11-28T17:40:20.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a0068860 con 0x7f46a00cfca0 2023-11-28T17:40:20.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f468c003af0 con 0x7f46a00cfca0 2023-11-28T17:40:20.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469d7fa640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f46840668d0 0x7f4684068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:20.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.139+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f468c083690 con 0x7f46a00cfca0 2023-11-28T17:40:20.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.143+0000 7f46a4ab9640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f46840668d0 0x7f4684068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:20.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.143+0000 7f46a4ab9640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f46840668d0 0x7f4684068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4694009cf0 tx=0x7f4694009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:20.148 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.147+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f468c050c80 con 0x7f46a00cfca0 2023-11-28T17:40:20.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.315+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f46a00d3520 con 0x7f46a00cfca0 2023-11-28T17:40:20.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.883+0000 7f469d7fa640 1 -- 172.21.15.16:0/3953517837 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f468c017080 con 0x7f46a00cfca0 2023-11-28T17:40:20.887 INFO:teuthology.orchestra.run.smithi016.stderr: removed all blocklist entries 2023-11-28T17:40:20.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f46840668d0 msgr2=0x7f4684068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f46840668d0 0x7f4684068d90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4694009cf0 tx=0x7f4694009190 comp rx=0 tx=0).stop 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 msgr2=0x7f46a015e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 0x7f46a015e0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f468c00c3f0 tx=0x7f468c00c8b0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 shutdown_connections 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f46840668d0 0x7f4684068d90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46a00d1b10 0x7f46a014e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f46a00cfca0 0x7f46a015e0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 --2- 172.21.15.16:0/3953517837 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f46a00b8b80 0x7f46a015db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 >> 172.21.15.16:0/3953517837 conn(0x7f46a00720d0 msgr2=0x7f46a00724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 shutdown_connections 2023-11-28T17:40:20.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:20.887+0000 7f46a6d1d640 1 -- 172.21.15.16:0/3953517837 wait complete. 2023-11-28T17:40:20.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T17:40:21.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29ad757640 1 Processor -- start 2023-11-28T17:40:21.062 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29ad757640 1 -- start start 2023-11-28T17:40:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29ad757640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a8072090 0x7f29a80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29ad757640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a815a8b0 con 0x7f29a815b350 2023-11-28T17:40:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29ad757640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29a80cea50 con 0x7f29a81548e0 2023-11-28T17:40:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29ad757640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80ce860 con 0x7f29a8072090 2023-11-28T17:40:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29a77fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f29a815b350 0x7f29a80cc970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44300/0 (socket says 172.21.15.16:44300) 2023-11-28T17:40:21.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29a77fe640 1 -- 172.21.15.16:0/14485361 learned_addr learned my addr 172.21.15.16:0/14485361 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:21.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f299e7fc640 1 --2- 172.21.15.16:0/14485361 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a8072090 0x7f29a80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291102636 0 0) 0x7f29a815a8b0 con 0x7f29a815b350 2023-11-28T17:40:21.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2988003530 con 0x7f29a815b350 2023-11-28T17:40:21.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377573012 0 0) 0x7f29a80cea50 con 0x7f29a81548e0 2023-11-28T17:40:21.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a815a8b0 con 0x7f29a81548e0 2023-11-28T17:40:21.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f299e7fc640 1 -- 172.21.15.16:0/14485361 >> v1:172.21.15.64:6789/0 conn(0x7f29a81548e0 legacy=0x7f29a80ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f299e7fc640 1 -- 172.21.15.16:0/14485361 >> v1:172.21.15.16:6789/0 conn(0x7f29a815b350 legacy=0x7f29a80cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.059+0000 7f299e7fc640 1 -- 172.21.15.16:0/14485361 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a815ab50 con 0x7f29a8072090 2023-11-28T17:40:21.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f299e7fc640 1 --2- 172.21.15.16:0/14485361 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a8072090 0x7f29a80cef30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29900097f0 tx=0x7f299001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dc3b0389dc036ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ab600 con 0x7f29a8072090 2023-11-28T17:40:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29900a7050 con 0x7f29a8072090 2023-11-28T17:40:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29a67fc640 1 -- 172.21.15.16:0/14485361 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ab960 con 0x7f29a8072090 2023-11-28T17:40:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 -- 172.21.15.16:0/14485361 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a8072090 msgr2=0x7f29a80cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 --2- 172.21.15.16:0/14485361 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a8072090 0x7f29a80cef30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f29900097f0 tx=0x7f299001c4c0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 -- 172.21.15.16:0/14485361 shutdown_connections 2023-11-28T17:40:21.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 --2- 172.21.15.16:0/14485361 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a8072090 0x7f29a80cef30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 -- 172.21.15.16:0/14485361 >> 172.21.15.16:0/14485361 conn(0x7f29a806a5a0 msgr2=0x7f29a806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:21.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 -- 172.21.15.16:0/14485361 shutdown_connections 2023-11-28T17:40:21.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.063+0000 7f29ad757640 1 -- 172.21.15.16:0/14485361 wait complete. 2023-11-28T17:40:21.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 Processor -- start 2023-11-28T17:40:21.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 -- start start 2023-11-28T17:40:21.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 0x7f29a8141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a81548e0 0x7f29a80cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a815b350 0x7f29a80cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8150260 con 0x7f29a8072090 2023-11-28T17:40:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a81417a0 con 0x7f29a81548e0 2023-11-28T17:40:21.075 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29ad757640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a814d6a0 con 0x7f29a815b350 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 0x7f29a8141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 0x7f29a8141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60768/0 (socket says 172.21.15.16:60768) 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 -- 172.21.15.16:0/2335366477 learned_addr learned my addr 172.21.15.16:0/2335366477 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f299e7fc640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a81548e0 0x7f29a80cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a77fe640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a815b350 0x7f29a80cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 -- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a815b350 msgr2=0x7f29a80cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a815b350 0x7f29a80cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 -- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a81548e0 msgr2=0x7f29a80cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a81548e0 0x7f29a80cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 -- 172.21.15.16:0/2335366477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009420 con 0x7f29a8072090 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a77fe640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a815b350 0x7f29a80cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f29a6ffd640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 0x7f29a8141260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f299800c4c0 tx=0x7f299800c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29980052d0 con 0x7f29a8072090 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2998005430 con 0x7f29a8072090 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.067+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2998012870 con 0x7f29a8072090 2023-11-28T17:40:21.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a814dc60 con 0x7f29a8072090 2023-11-28T17:40:21.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a80b1a40 con 0x7f29a8072090 2023-11-28T17:40:21.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a8068860 con 0x7f29a8072090 2023-11-28T17:40:21.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f29980129d0 con 0x7f29a8072090 2023-11-28T17:40:21.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f299ffff640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f298c0668d0 0x7f298c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2998083c50 con 0x7f29a8072090 2023-11-28T17:40:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.071+0000 7f299e7fc640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f298c0668d0 0x7f298c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.075+0000 7f299e7fc640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f298c0668d0 0x7f298c068d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29900ad000 tx=0x7f29900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.075+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2998051140 con 0x7f29a8072090 2023-11-28T17:40:21.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.286+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f29a8153c90 con 0x7f29a8072090 2023-11-28T17:40:21.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.286+0000 7f299ffff640 1 -- 172.21.15.16:0/2335366477 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2998054760 con 0x7f29a8072090 2023-11-28T17:40:21.291 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "auth_dump": [ 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.a", 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZlP73dJRAAAa1aYMhumrD3cP7e3ks4TQ==", 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.292 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.b", 2023-11-28T17:40:21.293 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZlZ2NyMhAAHVvtXZmIxccpUgsXohapGQ==", 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.294 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.c", 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZlQj86LRAAzEnq6oQ0tCGjuaj7P8UmzA==", 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-11-28T17:40:21.295 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mds.d", 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZlA4VbOhAAIG4Qk+u9biQLkWHMNfopuw==", 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.296 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.0", 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCeJWZluRp6JxAAmngG2pcuvJ8gAf6IQ6TryQ==", 2023-11-28T17:40:21.297 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.1", 2023-11-28T17:40:21.298 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQChJWZlxSETLhAArV76ilhRqnGZECWrlfohGQ==", 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.299 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.2", 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCkJWZlbELPNBAAbQ5oL6nlhP6EDgy4rL0/kQ==", 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.3", 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCoJWZl1C1HABAA4h+OOFdUslTuQSsGR4v7WQ==", 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.301 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.4", 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCuJWZlHEmsBxAA0U4qJLjWgA+ZtskGzU/oPw==", 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.302 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.5", 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCxJWZl2XPEDhAAozvw7FCAHthluVmiCoZsYw==", 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.303 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.6", 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC0JWZlz0nUFBAAM1p74cHGh2XYbJYWbLYYIw==", 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.304 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "osd.7", 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC3JWZlwIzHHBAAQiosgm9XIUg2mvwl1hVGmQ==", 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.305 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow profile osd", 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile osd", 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.0", 2023-11-28T17:40:21.306 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCdJWZlpXX7AhAAyFkBG56tVWNiwFf2q9XkoA==", 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.307 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.1", 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCdJWZlixvcDBAAMhQyCeaFcwJzJYgYdap7ow==", 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-11-28T17:40:21.308 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.2", 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCdJWZlpNkZCRAAhOKKhy4fl92pbOweVqDy1A==", 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-11-28T17:40:21.309 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.3", 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCdJWZl0vpsExAASf13ZxjGr/k6mj0DjVAjSA==", 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.310 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow", 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow r", 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow rw", 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow rwx" 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.admin", 2023-11-28T17:40:21.311 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw==", 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "mgr": "allow *", 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow *", 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.312 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mds", 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC9JWZlRMpQIxAAlg9oXmJkjnVmopDvj1mP+A==", 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.313 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T17:40:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC9JWZl49RQIxAA5znznCTJ30xui0U7L5LNJg==", 2023-11-28T17:40:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T17:40:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.314 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-osd", 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC9JWZlVN1QIxAA3NVkVFtrJas6KcT0jYLaVQ==", 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.315 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC9JWZlo+VQIxAAfdk9gPL0k7zPYrkryVe4oA==", 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.316 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC9JWZl5+1QIxAAHZHeb2BHWpvXatEeRFvnvQ==", 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T17:40:21.317 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQC9JWZliPZQIxAA1+/aR+lBYFCpxOD7+mM8Xg==", 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.x", 2023-11-28T17:40:21.318 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZl2X09HRAA9dgiAzDEMgxeUuTerF1pww==", 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: }, 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "entity": "mgr.y", 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "key": "AQCcJWZlbW5JGRAAXbRZD0jOQd/Hbiobm3VU2g==", 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "caps": { 2023-11-28T17:40:21.319 INFO:teuthology.orchestra.run.smithi016.stdout: "mds": "allow *", 2023-11-28T17:40:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "mon": "allow profile mgr", 2023-11-28T17:40:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: "osd": "allow *" 2023-11-28T17:40:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:21.320 INFO:teuthology.orchestra.run.smithi016.stdout: ] 2023-11-28T17:40:21.320 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-28T17:40:21.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f298c0668d0 msgr2=0x7f298c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f298c0668d0 0x7f298c068d90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f29900ad000 tx=0x7f29900a6000 comp rx=0 tx=0).stop 2023-11-28T17:40:21.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 msgr2=0x7f29a8141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 0x7f29a8141260 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f299800c4c0 tx=0x7f299800c980 comp rx=0 tx=0).stop 2023-11-28T17:40:21.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 shutdown_connections 2023-11-28T17:40:21.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f29a815b350 0x7f29a80cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f298c0668d0 0x7f298c068d90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29a81548e0 0x7f29a80cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 --2- 172.21.15.16:0/2335366477 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f29a8072090 0x7f29a8141260 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 >> 172.21.15.16:0/2335366477 conn(0x7f29a806a5a0 msgr2=0x7f29a80cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:21.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 shutdown_connections 2023-11-28T17:40:21.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.290+0000 7f29ad757640 1 -- 172.21.15.16:0/2335366477 wait complete. 2023-11-28T17:40:21.324 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T17:40:21.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.462+0000 7ff5b2e5a640 1 Processor -- start 2023-11-28T17:40:21.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.462+0000 7ff5b2e5a640 1 -- start start 2023-11-28T17:40:21.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.462+0000 7ff5b2e5a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5ac0cf640 0x7ff5ac164cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.462+0000 7ff5b2e5a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac15a8b0 con 0x7ff5ac1548e0 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b2e5a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0cea50 con 0x7ff5ac072090 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b2e5a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0ce860 con 0x7ff5ac0cf640 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b13f7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5ac0cf640 0x7ff5ac164cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b0bf6640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff5ac1548e0 0x7ff5ac0ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44304/0 (socket says 172.21.15.16:44304) 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b0bf6640 1 -- 172.21.15.16:0/3383531765 learned_addr learned my addr 172.21.15.16:0/3383531765 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:21.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b13f7640 1 -- 172.21.15.16:0/3383531765 >> v1:172.21.15.64:6789/0 conn(0x7ff5ac072090 legacy=0x7ff5ac0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b13f7640 1 -- 172.21.15.16:0/3383531765 >> v1:172.21.15.16:6789/0 conn(0x7ff5ac1548e0 legacy=0x7ff5ac0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b13f7640 1 -- 172.21.15.16:0/3383531765 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac15ab50 con 0x7ff5ac0cf640 2023-11-28T17:40:21.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5b13f7640 1 --2- 172.21.15.16:0/3383531765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac164cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db90d52b14f652c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5ab7fe640 1 -- 172.21.15.16:0/3383531765 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40a5810 con 0x7ff5ac0cf640 2023-11-28T17:40:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5ab7fe640 1 -- 172.21.15.16:0/3383531765 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a40a5970 con 0x7ff5ac0cf640 2023-11-28T17:40:21.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.466+0000 7ff5ab7fe640 1 -- 172.21.15.16:0/3383531765 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a40a5d00 con 0x7ff5ac0cf640 2023-11-28T17:40:21.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/3383531765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac0cf640 msgr2=0x7ff5ac164cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/3383531765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac164cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4009d90 tx=0x7ff5a401c950 comp rx=0 tx=0).stop 2023-11-28T17:40:21.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/3383531765 shutdown_connections 2023-11-28T17:40:21.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/3383531765 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac164cd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/3383531765 >> 172.21.15.16:0/3383531765 conn(0x7ff5ac06a5a0 msgr2=0x7ff5ac06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:21.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/3383531765 shutdown_connections 2023-11-28T17:40:21.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/3383531765 wait complete. 2023-11-28T17:40:21.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 Processor -- start 2023-11-28T17:40:21.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- start start 2023-11-28T17:40:21.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 0x7ff5ac15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac14a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5ac1548e0 0x7ff5ac14de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15c3e0 con 0x7ff5ac072090 2023-11-28T17:40:21.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15cd40 con 0x7ff5ac0cf640 2023-11-28T17:40:21.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b2e5a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15b7f0 con 0x7ff5ac1548e0 2023-11-28T17:40:21.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b0bf6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 0x7ff5ac15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b0bf6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 0x7ff5ac15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60786/0 (socket says 172.21.15.16:60786) 2023-11-28T17:40:21.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b0bf6640 1 -- 172.21.15.16:0/9238489 learned_addr learned my addr 172.21.15.16:0/9238489 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:21.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5abfff640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac14a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.470+0000 7ff5b13f7640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5ac1548e0 0x7ff5ac14de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b0bf6640 1 -- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5ac1548e0 msgr2=0x7ff5ac14de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b0bf6640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5ac1548e0 0x7ff5ac14de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b0bf6640 1 -- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5ac0cf640 msgr2=0x7ff5ac14a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b0bf6640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac14a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b0bf6640 1 -- 172.21.15.16:0/9238489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009a70 con 0x7ff5ac072090 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b0bf6640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 0x7ff5ac15c800 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c400 tx=0x7ff5a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0005cf0 con 0x7ff5ac072090 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5a0005e50 con 0x7ff5ac072090 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5a00072d0 con 0x7ff5ac072090 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac15ba40 con 0x7ff5ac072090 2023-11-28T17:40:21.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac15c000 con 0x7ff5ac072090 2023-11-28T17:40:21.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac068860 con 0x7ff5ac072090 2023-11-28T17:40:21.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5a0007430 con 0x7ff5ac072090 2023-11-28T17:40:21.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5a97fa640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff5900668d0 0x7ff590068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.474+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5a0083640 con 0x7ff5ac072090 2023-11-28T17:40:21.482 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.478+0000 7ff5abfff640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff5900668d0 0x7ff590068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.483 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.478+0000 7ff5abfff640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff5900668d0 0x7ff590068d90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac14d830 tx=0x7ff598009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.478+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5a0050c80 con 0x7ff5ac072090 2023-11-28T17:40:21.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.694+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff5ac1540a0 con 0x7ff5ac072090 2023-11-28T17:40:21.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.694+0000 7ff5a97fa640 1 -- 172.21.15.16:0/9238489 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff5a00542a0 con 0x7ff5ac072090 2023-11-28T17:40:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff5900668d0 msgr2=0x7ff590068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff5900668d0 0x7ff590068d90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac14d830 tx=0x7ff598009040 comp rx=0 tx=0).stop 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 msgr2=0x7ff5ac15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 0x7ff5ac15c800 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c400 tx=0x7ff5a000c8c0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 shutdown_connections 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5ac1548e0 0x7ff5ac14de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff5900668d0 0x7ff590068d90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff5ac0cf640 0x7ff5ac14a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 --2- 172.21.15.16:0/9238489 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5ac072090 0x7ff5ac15c800 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 >> 172.21.15.16:0/9238489 conn(0x7ff5ac06a5a0 msgr2=0x7ff5ac070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:21.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 shutdown_connections 2023-11-28T17:40:21.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.698+0000 7ff5b2e5a640 1 -- 172.21.15.16:0/9238489 wait complete. 2023-11-28T17:40:21.722 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T17:40:21.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 Processor -- start 2023-11-28T17:40:21.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 -- start start 2023-11-28T17:40:21.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe174146ec0 0x7fe17406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1740ccae0 0x7fe174071570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe174071dc0 con 0x7fe1740b3430 2023-11-28T17:40:21.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17406ecd0 con 0x7fe1740ccae0 2023-11-28T17:40:21.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe17b032640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe174072660 con 0x7fe174146ec0 2023-11-28T17:40:21.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.862+0000 7fe173fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1740ccae0 0x7fe174071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fe1740ccae0 0x7fe174071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60800/0 (socket says 172.21.15.16:60800) 2023-11-28T17:40:21.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 -- 172.21.15.16:0/1405651649 learned_addr learned my addr 172.21.15.16:0/1405651649 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:21.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 -- 172.21.15.16:0/1405651649 >> v2:172.21.15.64:3300/0 conn(0x7fe174146ec0 msgr2=0x7fe17406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe178dce640 1 --2- 172.21.15.16:0/1405651649 >> v2:172.21.15.64:3300/0 conn(0x7fe174146ec0 0x7fe17406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 --2- 172.21.15.16:0/1405651649 >> v2:172.21.15.64:3300/0 conn(0x7fe174146ec0 0x7fe17406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 -- 172.21.15.16:0/1405651649 >> v1:172.21.15.64:6789/0 conn(0x7fe1740b3430 legacy=0x7fe17406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 -- 172.21.15.16:0/1405651649 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740720a0 con 0x7fe1740ccae0 2023-11-28T17:40:21.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe178dce640 1 --2- 172.21.15.16:0/1405651649 >> v2:172.21.15.64:3300/0 conn(0x7fe174146ec0 0x7fe17406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:21.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe173fff640 1 --2- 172.21.15.16:0/1405651649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe174071570 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe174074420 tx=0x7fe16001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fef66efbd1792f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe1737fe640 1 -- 172.21.15.16:0/1405651649 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600ab600 con 0x7fe1740ccae0 2023-11-28T17:40:21.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe1737fe640 1 -- 172.21.15.16:0/1405651649 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600a7050 con 0x7fe1740ccae0 2023-11-28T17:40:21.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.866+0000 7fe1737fe640 1 -- 172.21.15.16:0/1405651649 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600ab980 con 0x7fe1740ccae0 2023-11-28T17:40:21.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- 172.21.15.16:0/1405651649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 msgr2=0x7fe174071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 --2- 172.21.15.16:0/1405651649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe174071570 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe174074420 tx=0x7fe16001c4c0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- 172.21.15.16:0/1405651649 shutdown_connections 2023-11-28T17:40:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 --2- 172.21.15.16:0/1405651649 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe174071570 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 --2- 172.21.15.16:0/1405651649 >> v2:172.21.15.64:3300/0 conn(0x7fe174146ec0 0x7fe17406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- 172.21.15.16:0/1405651649 >> 172.21.15.16:0/1405651649 conn(0x7fe1740d00b0 msgr2=0x7fe1740d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- 172.21.15.16:0/1405651649 shutdown_connections 2023-11-28T17:40:21.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- 172.21.15.16:0/1405651649 wait complete. 2023-11-28T17:40:21.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 Processor -- start 2023-11-28T17:40:21.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- start start 2023-11-28T17:40:21.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1740b3430 0x7fe17415c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe17415ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe174146ec0 0x7fe1740ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe174137b20 con 0x7fe1740ccae0 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1741333d0 con 0x7fe174146ec0 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe17b032640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe174133c30 con 0x7fe1740b3430 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe17415ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe17415ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60804/0 (socket says 172.21.15.16:60804) 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 -- 172.21.15.16:0/1907005003 learned_addr learned my addr 172.21.15.16:0/1907005003 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe178dce640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1740b3430 0x7fe17415c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe1795cf640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe174146ec0 0x7fe1740ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 -- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1740b3430 msgr2=0x7fe17415c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1740b3430 0x7fe17415c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 -- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe174146ec0 msgr2=0x7fe1740ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe174146ec0 0x7fe1740ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe173fff640 1 -- 172.21.15.16:0/1907005003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1600094d0 con 0x7fe1740ccae0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.870+0000 7fe1795cf640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe174146ec0 0x7fe1740ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe173fff640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe17415ded0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe16001a0f0 tx=0x7fe160019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600b37d0 con 0x7fe1740ccae0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1600b3930 con 0x7fe1740ccae0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe174137840 con 0x7fe1740ccae0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1600b3ce0 con 0x7fe1740ccae0 2023-11-28T17:40:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1741338c0 con 0x7fe1740ccae0 2023-11-28T17:40:21.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe174133dc0 con 0x7fe1740ccae0 2023-11-28T17:40:21.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fe1600b2070 con 0x7fe1740ccae0 2023-11-28T17:40:21.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe1717fa640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe1580668d0 0x7fe158068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:21.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe16011e3b0 con 0x7fe1740ccae0 2023-11-28T17:40:21.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.874+0000 7fe178dce640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe1580668d0 0x7fe158068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:21.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.878+0000 7fe178dce640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe1580668d0 0x7fe158068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe174136900 tx=0x7fe168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:21.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:21.878+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1600eb940 con 0x7fe1740ccae0 2023-11-28T17:40:22.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.094+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fe174068860 con 0x7fe1740ccae0 2023-11-28T17:40:22.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.094+0000 7fe1717fa640 1 -- 172.21.15.16:0/1907005003 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe1600eef60 con 0x7fe1740ccae0 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe1580668d0 msgr2=0x7fe158068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe1580668d0 0x7fe158068d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe174136900 tx=0x7fe168008040 comp rx=0 tx=0).stop 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 msgr2=0x7fe17415ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe17415ded0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe16001a0f0 tx=0x7fe160019260 comp rx=0 tx=0).stop 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 shutdown_connections 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fe1580668d0 0x7fe158068d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe174146ec0 0x7fe1740ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fe1740ccae0 0x7fe17415ded0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 --2- 172.21.15.16:0/1907005003 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fe1740b3430 0x7fe17415c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 >> 172.21.15.16:0/1907005003 conn(0x7fe1740d00b0 msgr2=0x7fe1741601c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:22.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 shutdown_connections 2023-11-28T17:40:22.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.098+0000 7fe17b032640 1 -- 172.21.15.16:0/1907005003 wait complete. 2023-11-28T17:40:22.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T17:40:22.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 Processor -- start 2023-11-28T17:40:22.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 -- start start 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7cf4161710 0x7f7cf4165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7cf4146110 0x7f7cf40708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf4070e00 con 0x7f7cf4070460 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf41662d0 con 0x7f7cf4146110 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cfa65a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf406c6d0 con 0x7f7cf4161710 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7cf4146110 0x7f7cf40708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7cf4146110 0x7f7cf40708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60808/0 (socket says 172.21.15.16:60808) 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/907336594 learned_addr learned my addr 172.21.15.16:0/907336594 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:22.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf3fff640 1 --2- 172.21.15.16:0/907336594 >> v2:172.21.15.64:3300/0 conn(0x7f7cf4161710 0x7f7cf4165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/907336594 >> v2:172.21.15.64:3300/0 conn(0x7f7cf4161710 msgr2=0x7f7cf4165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:22.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 --2- 172.21.15.16:0/907336594 >> v2:172.21.15.64:3300/0 conn(0x7f7cf4161710 0x7f7cf4165d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/907336594 >> v1:172.21.15.64:6789/0 conn(0x7f7cf4070460 legacy=0x7f7cf4146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:22.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/907336594 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf406c9b0 con 0x7f7cf4146110 2023-11-28T17:40:22.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.262+0000 7f7cf3fff640 1 --2- 172.21.15.16:0/907336594 >> v2:172.21.15.64:3300/0 conn(0x7f7cf4161710 0x7f7cf4165d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:22.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cf8bf7640 1 --2- 172.21.15.16:0/907336594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4146110 0x7f7cf40708c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40700e0 tx=0x7f7cec01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31f800265a013be server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:22.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cf2ffd640 1 -- 172.21.15.16:0/907336594 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0a5820 con 0x7f7cf4146110 2023-11-28T17:40:22.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cf2ffd640 1 -- 172.21.15.16:0/907336594 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec0a5980 con 0x7f7cf4146110 2023-11-28T17:40:22.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cf2ffd640 1 -- 172.21.15.16:0/907336594 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0a5d10 con 0x7f7cf4146110 2023-11-28T17:40:22.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 -- 172.21.15.16:0/907336594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4146110 msgr2=0x7f7cf40708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/907336594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4146110 0x7f7cf40708c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7cf40700e0 tx=0x7f7cec01c960 comp rx=0 tx=0).stop 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 -- 172.21.15.16:0/907336594 shutdown_connections 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/907336594 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4146110 0x7f7cf40708c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/907336594 >> v2:172.21.15.64:3300/0 conn(0x7f7cf4161710 0x7f7cf4165d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 -- 172.21.15.16:0/907336594 >> 172.21.15.16:0/907336594 conn(0x7f7cf406a5a0 msgr2=0x7f7cf406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 -- 172.21.15.16:0/907336594 shutdown_connections 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.266+0000 7f7cfa65a640 1 -- 172.21.15.16:0/907336594 wait complete. 2023-11-28T17:40:22.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 Processor -- start 2023-11-28T17:40:22.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 -- start start 2023-11-28T17:40:22.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cf4070460 0x7f7cf4142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7cf4146110 0x7f7cf4148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 0x7f7cf4148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf415dec0 con 0x7f7cf4161710 2023-11-28T17:40:22.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4142360 con 0x7f7cf4070460 2023-11-28T17:40:22.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4142640 con 0x7f7cf4146110 2023-11-28T17:40:22.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 0x7f7cf4148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 0x7f7cf4148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60818/0 (socket says 172.21.15.16:60818) 2023-11-28T17:40:22.278 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/294324471 learned_addr learned my addr 172.21.15.16:0/294324471 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:22.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf3fff640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cf4070460 0x7f7cf4142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf37fe640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7cf4146110 0x7f7cf4148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.279 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7cf4146110 msgr2=0x7f7cf4148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7cf4146110 0x7f7cf4148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cf4070460 msgr2=0x7f7cf4142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cf4070460 0x7f7cf4142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 -- 172.21.15.16:0/294324471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec009b30 con 0x7f7cf4161710 2023-11-28T17:40:22.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf8bf7640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 0x7f7cf4148ea0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0af040 tx=0x7f7cec019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:22.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0b8670 con 0x7f7cf4161710 2023-11-28T17:40:22.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec0b87d0 con 0x7f7cf4161710 2023-11-28T17:40:22.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0b8b80 con 0x7f7cf4161710 2023-11-28T17:40:22.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf415e110 con 0x7f7cf4161710 2023-11-28T17:40:22.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.270+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf41493e0 con 0x7f7cf4161710 2023-11-28T17:40:22.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.274+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4068860 con 0x7f7cf4161710 2023-11-28T17:40:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.274+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7cec0b8ce0 con 0x7f7cf4161710 2023-11-28T17:40:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.274+0000 7f7cf0ff9640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ce00668d0 0x7f7ce0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.274+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cec11f860 con 0x7f7cf4161710 2023-11-28T17:40:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.274+0000 7f7cf3fff640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ce00668d0 0x7f7ce0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.274+0000 7f7cf3fff640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ce00668d0 0x7f7ce0068d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4006fd0 tx=0x7f7ce4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:22.282 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.278+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7cec0ecfc0 con 0x7f7cf4161710 2023-11-28T17:40:22.497 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.494+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f7cf413e630 con 0x7f7cf4161710 2023-11-28T17:40:22.500 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cf0ff9640 1 -- 172.21.15.16:0/294324471 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7cec0f05e0 con 0x7f7cf4161710 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ce00668d0 msgr2=0x7f7ce0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ce00668d0 0x7f7ce0068d90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4006fd0 tx=0x7f7ce4008040 comp rx=0 tx=0).stop 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 msgr2=0x7f7cf4148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 0x7f7cf4148ea0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0af040 tx=0x7f7cec019700 comp rx=0 tx=0).stop 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 shutdown_connections 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7cf4161710 0x7f7cf4148ea0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7cf4146110 0x7f7cf4148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ce00668d0 0x7f7ce0068d90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 --2- 172.21.15.16:0/294324471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7cf4070460 0x7f7cf4142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 >> 172.21.15.16:0/294324471 conn(0x7f7cf406a5a0 msgr2=0x7f7cf40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:22.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 shutdown_connections 2023-11-28T17:40:22.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.498+0000 7f7cfa65a640 1 -- 172.21.15.16:0/294324471 wait complete. 2023-11-28T17:40:22.522 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T17:40:22.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 Processor -- start 2023-11-28T17:40:22.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 -- start start 2023-11-28T17:40:22.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7c9c1548e0 0x7f7c9c0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c9c15b350 0x7f7c9c0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c15a6a0 con 0x7f7c9c15b350 2023-11-28T17:40:22.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c0ced30 con 0x7f7c9c1548e0 2023-11-28T17:40:22.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7ca1b2a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c15a8b0 con 0x7f7c9c072090 2023-11-28T17:40:22.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c9c15b350 0x7f7c9c0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7c9c15b350 0x7f7c9c0cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60834/0 (socket says 172.21.15.16:60834) 2023-11-28T17:40:22.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 -- 172.21.15.16:0/4034260185 learned_addr learned my addr 172.21.15.16:0/4034260185 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:22.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9b7fe640 1 --2- 172.21.15.16:0/4034260185 >> v2:172.21.15.64:3300/0 conn(0x7f7c9c1548e0 0x7f7c9c0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9affd640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 -- 172.21.15.16:0/4034260185 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 msgr2=0x7f7c9c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:22.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c0cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 -- 172.21.15.16:0/4034260185 >> v2:172.21.15.64:3300/0 conn(0x7f7c9c1548e0 msgr2=0x7f7c9c0ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:22.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 --2- 172.21.15.16:0/4034260185 >> v2:172.21.15.64:3300/0 conn(0x7f7c9c1548e0 0x7f7c9c0ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9bfff640 1 -- 172.21.15.16:0/4034260185 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0cea50 con 0x7f7c9c15b350 2023-11-28T17:40:22.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.662+0000 7f7c9affd640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:22.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7c9bfff640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c0cf470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0744c0 tx=0x7f7c9401ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5af3db631400867 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:22.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7c9a7fc640 1 -- 172.21.15.16:0/4034260185 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940a7a40 con 0x7f7c9c15b350 2023-11-28T17:40:22.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7c9a7fc640 1 -- 172.21.15.16:0/4034260185 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c940a7ba0 con 0x7f7c9c15b350 2023-11-28T17:40:22.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7c9a7fc640 1 -- 172.21.15.16:0/4034260185 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940af3f0 con 0x7f7c9c15b350 2023-11-28T17:40:22.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/4034260185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 msgr2=0x7f7c9c0cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c0cf470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c0744c0 tx=0x7f7c9401ebb0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/4034260185 shutdown_connections 2023-11-28T17:40:22.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c0cf470 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/4034260185 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/4034260185 >> v2:172.21.15.64:3300/0 conn(0x7f7c9c1548e0 0x7f7c9c0ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/4034260185 >> 172.21.15.16:0/4034260185 conn(0x7f7c9c06a5a0 msgr2=0x7f7c9c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:22.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/4034260185 shutdown_connections 2023-11-28T17:40:22.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.666+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/4034260185 wait complete. 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 Processor -- start 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 -- start start 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1548e0 0x7f7c9c146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c14c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c148590 con 0x7f7c9c15b350 2023-11-28T17:40:22.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c149060 con 0x7f7c9c1548e0 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c14d6b0 con 0x7f7c9c072090 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c14c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c14c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60836/0 (socket says 172.21.15.16:60836) 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 -- 172.21.15.16:0/1275306378 learned_addr learned my addr 172.21.15.16:0/1275306378 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9affd640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1548e0 0x7f7c9c146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9b7fe640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 -- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 msgr2=0x7f7c9c148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 -- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1548e0 msgr2=0x7f7c9c146b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.678 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1548e0 0x7f7c9c146b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 -- 172.21.15.16:0/1275306378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c94009b30 con 0x7f7c9c15b350 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c9bfff640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c14c880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b1040 tx=0x7f7c9401b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940a7a40 con 0x7f7c9c15b350 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400e150 con 0x7f7c9c15b350 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94007df0 con 0x7f7c9c15b350 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c1487c0 con 0x7f7c9c15b350 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.670+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c148d80 con 0x7f7c9c15b350 2023-11-28T17:40:22.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.674+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c068860 con 0x7f7c9c15b350 2023-11-28T17:40:22.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.674+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7c940af3f0 con 0x7f7c9c15b350 2023-11-28T17:40:22.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.674+0000 7f7c83fff640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7c88066900 0x7f7c88068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:22.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.674+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c9411e4f0 con 0x7f7c9c15b350 2023-11-28T17:40:22.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.674+0000 7f7c9b7fe640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7c88066900 0x7f7c88068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:22.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.674+0000 7f7c9b7fe640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7c88066900 0x7f7c88068dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009a70 tx=0x7f7c8c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:22.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.678+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c940eb9e0 con 0x7f7c9c15b350 2023-11-28T17:40:22.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.894+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7c9c0cca40 con 0x7f7c9c15b350 2023-11-28T17:40:22.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.894+0000 7f7c83fff640 1 -- 172.21.15.16:0/1275306378 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7c94009510 con 0x7f7c9c15b350 2023-11-28T17:40:22.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7c88066900 msgr2=0x7f7c88068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7c88066900 0x7f7c88068dc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009a70 tx=0x7f7c8c008040 comp rx=0 tx=0).stop 2023-11-28T17:40:22.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 msgr2=0x7f7c9c14c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:22.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c14c880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c940b1040 tx=0x7f7c9401b950 comp rx=0 tx=0).stop 2023-11-28T17:40:22.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 shutdown_connections 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7c9c15b350 0x7f7c9c14c880 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7c88066900 0x7f7c88068dc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7c9c1548e0 0x7f7c9c146b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 --2- 172.21.15.16:0/1275306378 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7c9c072090 0x7f7c9c148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 >> 172.21.15.16:0/1275306378 conn(0x7f7c9c06a5a0 msgr2=0x7f7c9c15b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 shutdown_connections 2023-11-28T17:40:22.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:22.898+0000 7f7ca1b2a640 1 -- 172.21.15.16:0/1275306378 wait complete. 2023-11-28T17:40:22.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T17:40:23.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 Processor -- start 2023-11-28T17:40:23.066 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 -- start start 2023-11-28T17:40:23.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f191c15d540 0x7f191c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 0x7f191c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191c0b32c0 con 0x7f191c0d1f50 2023-11-28T17:40:23.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f191c15d920 con 0x7f191c15d540 2023-11-28T17:40:23.067 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1923fd8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c0b35a0 con 0x7f191c0d3690 2023-11-28T17:40:23.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f191c15d540 0x7f191c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1922575640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 0x7f191c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f191c15d540 0x7f191c0b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:49818/0 (socket says 172.21.15.16:49818) 2023-11-28T17:40:23.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 -- 172.21.15.16:0/674548357 learned_addr learned my addr 172.21.15.16:0/674548357 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:23.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1922575640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 0x7f191c0cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:39204/0 (socket says 172.21.15.16:39204) 2023-11-28T17:40:23.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 -- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 msgr2=0x7f191c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:23.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 0x7f191c0cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 -- 172.21.15.16:0/674548357 >> v1:172.21.15.64:6789/0 conn(0x7f191c0d1f50 legacy=0x7f191c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1921d74640 1 -- 172.21.15.16:0/674548357 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191c0b3880 con 0x7f191c15d540 2023-11-28T17:40:23.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.062+0000 7f1922575640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 0x7f191c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:23.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1921d74640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c15d540 0x7f191c0b29c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1918009870 tx=0x7f191801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=769660adbaf2be2f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1920d72640 1 -- 172.21.15.16:0/674548357 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180aa670 con 0x7f191c15d540 2023-11-28T17:40:23.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1920d72640 1 -- 172.21.15.16:0/674548357 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19180aa7d0 con 0x7f191c15d540 2023-11-28T17:40:23.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1920d72640 1 -- 172.21.15.16:0/674548357 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19180aab60 con 0x7f191c15d540 2023-11-28T17:40:23.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 -- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c15d540 msgr2=0x7f191c0b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c15d540 0x7f191c0b29c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1918009870 tx=0x7f191801c510 comp rx=0 tx=0).stop 2023-11-28T17:40:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 -- 172.21.15.16:0/674548357 shutdown_connections 2023-11-28T17:40:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c0d3690 0x7f191c0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 --2- 172.21.15.16:0/674548357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c15d540 0x7f191c0b29c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 -- 172.21.15.16:0/674548357 >> 172.21.15.16:0/674548357 conn(0x7f191c08ccf0 msgr2=0x7f191c09c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 -- 172.21.15.16:0/674548357 shutdown_connections 2023-11-28T17:40:23.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.066+0000 7f1923fd8640 1 -- 172.21.15.16:0/674548357 wait complete. 2023-11-28T17:40:23.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 Processor -- start 2023-11-28T17:40:23.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 -- start start 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c0d1f50 0x7f191c06c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 0x7f191c160400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c15d540 0x7f191c15aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c06cbd0 con 0x7f191c0d3690 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191c154b60 con 0x7f191c0d1f50 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191c160940 con 0x7f191c15d540 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 0x7f191c160400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 0x7f191c160400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60842/0 (socket says 172.21.15.16:60842) 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 -- 172.21.15.16:0/2396386999 learned_addr learned my addr 172.21.15.16:0/2396386999 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:23.076 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921d74640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c0d1f50 0x7f191c06c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1922575640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c15d540 0x7f191c15aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 -- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c15d540 msgr2=0x7f191c15aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c15d540 0x7f191c15aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 -- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c0d1f50 msgr2=0x7f191c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c0d1f50 0x7f191c06c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 -- 172.21.15.16:0/2396386999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1914009a70 con 0x7f191c0d3690 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1922575640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c15d540 0x7f191c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:23.077 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1921573640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 0x7f191c160400 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c340 tx=0x7f190c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c0052d0 con 0x7f191c0d3690 2023-11-28T17:40:23.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f190c005430 con 0x7f191c0d3690 2023-11-28T17:40:23.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.070+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19180094d0 con 0x7f191c0d3690 2023-11-28T17:40:23.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f190c007260 con 0x7f191c0d3690 2023-11-28T17:40:23.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f191c15dee0 con 0x7f191c0d3690 2023-11-28T17:40:23.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f191c154cd0 con 0x7f191c0d3690 2023-11-28T17:40:23.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f190c0073c0 con 0x7f191c0d3690 2023-11-28T17:40:23.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f19127fc640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f19000668d0 0x7f1900068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f190c0832d0 con 0x7f191c0d3690 2023-11-28T17:40:23.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.074+0000 7f1921d74640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f19000668d0 0x7f1900068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.078+0000 7f1921d74640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f19000668d0 0x7f1900068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19180ae000 tx=0x7f19180b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.078+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f190c0509a0 con 0x7f191c0d3690 2023-11-28T17:40:23.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.290+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f191c068860 con 0x7f191c0d3690 2023-11-28T17:40:23.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f19127fc640 1 -- 172.21.15.16:0/2396386999 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f190c053fc0 con 0x7f191c0d3690 2023-11-28T17:40:23.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f19000668d0 msgr2=0x7f1900068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f19000668d0 0x7f1900068d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19180ae000 tx=0x7f19180b5040 comp rx=0 tx=0).stop 2023-11-28T17:40:23.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 msgr2=0x7f191c160400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 0x7f191c160400 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f190c00c340 tx=0x7f190c00c800 comp rx=0 tx=0).stop 2023-11-28T17:40:23.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 shutdown_connections 2023-11-28T17:40:23.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f191c15d540 0x7f191c15aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f191c0d3690 0x7f191c160400 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f19000668d0 0x7f1900068d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 --2- 172.21.15.16:0/2396386999 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f191c0d1f50 0x7f191c06c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 >> 172.21.15.16:0/2396386999 conn(0x7f191c08ccf0 msgr2=0x7f191c1563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:23.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 shutdown_connections 2023-11-28T17:40:23.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.294+0000 7f1923fd8640 1 -- 172.21.15.16:0/2396386999 wait complete. 2023-11-28T17:40:23.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T17:40:23.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 Processor -- start 2023-11-28T17:40:23.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 -- start start 2023-11-28T17:40:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f93b0161710 0x7f93b0165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0146110 0x7f93b00708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93b0070e00 con 0x7f93b0070460 2023-11-28T17:40:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93b01662d0 con 0x7f93b0161710 2023-11-28T17:40:23.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b7cfe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b006c6d0 con 0x7f93b0146110 2023-11-28T17:40:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b5299640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f93b0070460 0x7f93b0146f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44308/0 (socket says 172.21.15.16:44308) 2023-11-28T17:40:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b5299640 1 -- 172.21.15.16:0/1685878655 learned_addr learned my addr 172.21.15.16:0/1685878655 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b629b640 1 --2- 172.21.15.16:0/1685878655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0146110 0x7f93b00708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b5a9a640 1 --2- 172.21.15.16:0/1685878655 >> v2:172.21.15.64:3300/0 conn(0x7f93b0161710 0x7f93b0165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b4a98640 1 -- 172.21.15.16:0/1685878655 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361256065 0 0) 0x7f93b0070e00 con 0x7f93b0070460 2023-11-28T17:40:23.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.458+0000 7f93b4a98640 1 -- 172.21.15.16:0/1685878655 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f939c003530 con 0x7f93b0070460 2023-11-28T17:40:23.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b629b640 1 -- 172.21.15.16:0/1685878655 >> v2:172.21.15.64:3300/0 conn(0x7f93b0161710 msgr2=0x7f93b0165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:23.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b629b640 1 --2- 172.21.15.16:0/1685878655 >> v2:172.21.15.64:3300/0 conn(0x7f93b0161710 0x7f93b0165d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b629b640 1 -- 172.21.15.16:0/1685878655 >> v1:172.21.15.16:6789/0 conn(0x7f93b0070460 legacy=0x7f93b0146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b4a98640 1 -- 172.21.15.16:0/1685878655 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3906259956 0 0) 0x7f939c003530 con 0x7f93b0070460 2023-11-28T17:40:23.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b629b640 1 -- 172.21.15.16:0/1685878655 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b006c9b0 con 0x7f93b0146110 2023-11-28T17:40:23.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b629b640 1 --2- 172.21.15.16:0/1685878655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0146110 0x7f93b00708c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a801c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd46d5d695fcaef server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b4a98640 1 -- 172.21.15.16:0/1685878655 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00016a0 con 0x7f93b0146110 2023-11-28T17:40:23.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b4a98640 1 -- 172.21.15.16:0/1685878655 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a80a5640 con 0x7f93b0146110 2023-11-28T17:40:23.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.462+0000 7f93b4a98640 1 -- 172.21.15.16:0/1685878655 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a59d0 con 0x7f93b0146110 2023-11-28T17:40:23.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- 172.21.15.16:0/1685878655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0146110 msgr2=0x7f93b00708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/1685878655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0146110 0x7f93b00708c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f93a8009d90 tx=0x7f93a801c840 comp rx=0 tx=0).stop 2023-11-28T17:40:23.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- 172.21.15.16:0/1685878655 shutdown_connections 2023-11-28T17:40:23.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/1685878655 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0146110 0x7f93b00708c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/1685878655 >> v2:172.21.15.64:3300/0 conn(0x7f93b0161710 0x7f93b0165d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- 172.21.15.16:0/1685878655 >> 172.21.15.16:0/1685878655 conn(0x7f93b006a5a0 msgr2=0x7f93b006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:23.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- 172.21.15.16:0/1685878655 shutdown_connections 2023-11-28T17:40:23.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- 172.21.15.16:0/1685878655 wait complete. 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 Processor -- start 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- start start 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b0070460 0x7f93b00b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 0x7f93b00b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0161710 0x7f93b015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0149610 con 0x7f93b0146110 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b01498f0 con 0x7f93b0070460 2023-11-28T17:40:23.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b7cfe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b0149bd0 con 0x7f93b0161710 2023-11-28T17:40:23.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 0x7f93b00b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 0x7f93b00b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60856/0 (socket says 172.21.15.16:60856) 2023-11-28T17:40:23.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 -- 172.21.15.16:0/8089600 learned_addr learned my addr 172.21.15.16:0/8089600 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:23.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5a9a640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b0070460 0x7f93b00b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b629b640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0161710 0x7f93b015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 -- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0161710 msgr2=0x7f93b015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0161710 0x7f93b015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 -- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b0070460 msgr2=0x7f93b00b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b0070460 0x7f93b00b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.466+0000 7f93b5299640 1 -- 172.21.15.16:0/8089600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8009a70 con 0x7f93b0146110 2023-11-28T17:40:23.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93b5299640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 0x7f93b00b0e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c730 tx=0x7f93a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00072d0 con 0x7f93b0146110 2023-11-28T17:40:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0007450 con 0x7f93b0146110 2023-11-28T17:40:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00047f0 con 0x7f93b0146110 2023-11-28T17:40:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93b0149eb0 con 0x7f93b0146110 2023-11-28T17:40:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93b00b3220 con 0x7f93b0146110 2023-11-28T17:40:23.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93b0068860 con 0x7f93b0146110 2023-11-28T17:40:23.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f93a0004950 con 0x7f93b0146110 2023-11-28T17:40:23.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93a67fc640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f93940668d0 0x7f9394068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f93a0083310 con 0x7f93b0146110 2023-11-28T17:40:23.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.470+0000 7f93b5a9a640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f93940668d0 0x7f9394068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.474+0000 7f93b5a9a640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f93940668d0 0x7f9394068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009b60 tx=0x7f93ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.474+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f93a0050940 con 0x7f93b0146110 2023-11-28T17:40:23.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.686+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f93b0141450 con 0x7f93b0146110 2023-11-28T17:40:23.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.690+0000 7f93a67fc640 1 -- 172.21.15.16:0/8089600 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f93a0053f60 con 0x7f93b0146110 2023-11-28T17:40:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f93940668d0 msgr2=0x7f9394068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f93940668d0 0x7f9394068d90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f93ac009b60 tx=0x7f93ac009190 comp rx=0 tx=0).stop 2023-11-28T17:40:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 msgr2=0x7f93b00b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 0x7f93b00b0e70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c730 tx=0x7f93a000cbf0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 shutdown_connections 2023-11-28T17:40:23.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f93b0161710 0x7f93b015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f93b0146110 0x7f93b00b0e70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f93940668d0 0x7f9394068d90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 --2- 172.21.15.16:0/8089600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93b0070460 0x7f93b00b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 >> 172.21.15.16:0/8089600 conn(0x7f93b006a5a0 msgr2=0x7f93b0141970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 shutdown_connections 2023-11-28T17:40:23.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.694+0000 7f93b7cfe640 1 -- 172.21.15.16:0/8089600 wait complete. 2023-11-28T17:40:23.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:23.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 Processor -- start 2023-11-28T17:40:23.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 -- start start 2023-11-28T17:40:23.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28b8153d30 0x7f28b8159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b80b3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b806a5a0 con 0x7f28b80b3990 2023-11-28T17:40:23.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b80b3e20 con 0x7f28b8153d30 2023-11-28T17:40:23.861 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.854+0000 7f28bf4fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b815a3d0 con 0x7f28b815d3e0 2023-11-28T17:40:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b80b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bd29a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28b8153d30 0x7f28b8159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b80b3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:39246/0 (socket says 172.21.15.16:39246) 2023-11-28T17:40:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 -- 172.21.15.16:0/345987041 learned_addr learned my addr 172.21.15.16:0/345987041 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 -- 172.21.15.16:0/345987041 >> v2:172.21.15.64:3300/0 conn(0x7f28b8153d30 msgr2=0x7f28b8159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:23.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 --2- 172.21.15.16:0/345987041 >> v2:172.21.15.64:3300/0 conn(0x7f28b8153d30 0x7f28b8159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 -- 172.21.15.16:0/345987041 >> v1:172.21.15.64:6789/0 conn(0x7f28b80b3990 legacy=0x7f28b80ae500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.863 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 -- 172.21.15.16:0/345987041 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b815a6b0 con 0x7f28b815d3e0 2023-11-28T17:40:23.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.858+0000 7f28bca99640 1 --2- 172.21.15.16:0/345987041 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b80b3450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28a8008120 tx=0x7f28a801c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ba7e6e7c9b2899e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28affff640 1 -- 172.21.15.16:0/345987041 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8004230 con 0x7f28b815d3e0 2023-11-28T17:40:23.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28affff640 1 -- 172.21.15.16:0/345987041 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28a8004390 con 0x7f28b815d3e0 2023-11-28T17:40:23.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28affff640 1 -- 172.21.15.16:0/345987041 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28a8003820 con 0x7f28b815d3e0 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- 172.21.15.16:0/345987041 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 msgr2=0x7f28b80b3450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/345987041 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b80b3450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f28a8008120 tx=0x7f28a801c7b0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- 172.21.15.16:0/345987041 shutdown_connections 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/345987041 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b80b3450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/345987041 >> v2:172.21.15.64:3300/0 conn(0x7f28b8153d30 0x7f28b8159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- 172.21.15.16:0/345987041 >> 172.21.15.16:0/345987041 conn(0x7f28b80b1de0 msgr2=0x7f28b80cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:23.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- 172.21.15.16:0/345987041 shutdown_connections 2023-11-28T17:40:23.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- 172.21.15.16:0/345987041 wait complete. 2023-11-28T17:40:23.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 Processor -- start 2023-11-28T17:40:23.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- start start 2023-11-28T17:40:23.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 0x7f28b813d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b8153d30 0x7f28b814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b814f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b814e720 con 0x7f28b80b3990 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b814dc20 con 0x7f28b8153d30 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bf4fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b814df00 con 0x7f28b815d3e0 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bd29a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 0x7f28b813d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bd29a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 0x7f28b813d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60858/0 (socket says 172.21.15.16:60858) 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bd29a640 1 -- 172.21.15.16:0/1755304825 learned_addr learned my addr 172.21.15.16:0/1755304825 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bca99640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b8153d30 0x7f28b814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.862+0000 7f28bda9b640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b814f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bd29a640 1 -- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 msgr2=0x7f28b814f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bd29a640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b814f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bd29a640 1 -- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b8153d30 msgr2=0x7f28b814d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bd29a640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b8153d30 0x7f28b814d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bd29a640 1 -- 172.21.15.16:0/1755304825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a800a580 con 0x7f28b80b3990 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bd29a640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 0x7f28b813d340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f28b400ed40 tx=0x7f28b400d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b400de30 con 0x7f28b80b3990 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b4010650 con 0x7f28b80b3990 2023-11-28T17:40:23.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40109c0 con 0x7f28b80b3990 2023-11-28T17:40:23.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b814e970 con 0x7f28b80b3990 2023-11-28T17:40:23.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b814a7e0 con 0x7f28b80b3990 2023-11-28T17:40:23.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b8068860 con 0x7f28b80b3990 2023-11-28T17:40:23.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f28b4010b20 con 0x7f28b80b3990 2023-11-28T17:40:23.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.866+0000 7f28adffb640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f289c0668d0 0x7f289c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:23.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.870+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28b4084580 con 0x7f28b80b3990 2023-11-28T17:40:23.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.870+0000 7f28bca99640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f289c0668d0 0x7f289c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:23.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.870+0000 7f28bca99640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f289c0668d0 0x7f289c068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28a80ae000 tx=0x7f28a80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:23.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:23.870+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f28b4051bc0 con 0x7f28b80b3990 2023-11-28T17:40:24.035 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.030+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28b806d0b0 con 0x7f28b80b3990 2023-11-28T17:40:24.036 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.030+0000 7f28adffb640 1 -- 172.21.15.16:0/1755304825 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12809 (secure 0 0 0) 0x7f28b40551e0 con 0x7f28b80b3990 2023-11-28T17:40:24.036 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:24.036 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":31,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:40:20.897100+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:24.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f289c0668d0 msgr2=0x7f289c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f289c0668d0 0x7f289c068d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f28a80ae000 tx=0x7f28a80a7070 comp rx=0 tx=0).stop 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 msgr2=0x7f28b813d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 0x7f28b813d340 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f28b400ed40 tx=0x7f28b400d720 comp rx=0 tx=0).stop 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 shutdown_connections 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f28b815d3e0 0x7f28b814f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f289c0668d0 0x7f289c068d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b8153d30 0x7f28b814d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 --2- 172.21.15.16:0/1755304825 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f28b80b3990 0x7f28b813d340 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 >> 172.21.15.16:0/1755304825 conn(0x7f28b80b1de0 msgr2=0x7f28b8152dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:24.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 shutdown_connections 2023-11-28T17:40:24.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.034+0000 7f28bf4fe640 1 -- 172.21.15.16:0/1755304825 wait complete. 2023-11-28T17:40:24.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T17:40:24.060 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T17:40:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 Processor -- start 2023-11-28T17:40:24.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 -- start start 2023-11-28T17:40:24.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2acc1548e0 0x7f2acc0ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2acc15b350 0x7f2acc0cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc15a6a0 con 0x7f2acc1548e0 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2acc0ced30 con 0x7f2acc15b350 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad4432640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc15a8b0 con 0x7f2acc072090 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2acc1548e0 0x7f2acc0ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2acc1548e0 0x7f2acc0ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60866/0 (socket says 172.21.15.16:60866) 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 -- 172.21.15.16:0/174286161 learned_addr learned my addr 172.21.15.16:0/174286161 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:24.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 -- 172.21.15.16:0/174286161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 msgr2=0x7f2acc0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:24.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 --2- 172.21.15.16:0/174286161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 -- 172.21.15.16:0/174286161 >> v2:172.21.15.64:3300/0 conn(0x7f2acc15b350 msgr2=0x7f2acc0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:24.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 --2- 172.21.15.16:0/174286161 >> v2:172.21.15.64:3300/0 conn(0x7f2acc15b350 0x7f2acc0cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.202+0000 7f2ad21ce640 1 -- 172.21.15.16:0/174286161 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0cea50 con 0x7f2acc1548e0 2023-11-28T17:40:24.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad21ce640 1 --2- 172.21.15.16:0/174286161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc0ce150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2acc06e950 tx=0x7f2ac801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e783352c1026a254 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad11cc640 1 -- 172.21.15.16:0/174286161 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80aa5f0 con 0x7f2acc1548e0 2023-11-28T17:40:24.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad11cc640 1 -- 172.21.15.16:0/174286161 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80aa750 con 0x7f2acc1548e0 2023-11-28T17:40:24.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad11cc640 1 -- 172.21.15.16:0/174286161 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac80aaae0 con 0x7f2acc1548e0 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 -- 172.21.15.16:0/174286161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 msgr2=0x7f2acc0ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 --2- 172.21.15.16:0/174286161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc0ce150 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2acc06e950 tx=0x7f2ac801c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 -- 172.21.15.16:0/174286161 shutdown_connections 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 --2- 172.21.15.16:0/174286161 >> v2:172.21.15.64:3300/0 conn(0x7f2acc15b350 0x7f2acc0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 --2- 172.21.15.16:0/174286161 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 --2- 172.21.15.16:0/174286161 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc0ce150 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 -- 172.21.15.16:0/174286161 >> 172.21.15.16:0/174286161 conn(0x7f2acc06a5a0 msgr2=0x7f2acc06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 -- 172.21.15.16:0/174286161 shutdown_connections 2023-11-28T17:40:24.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.206+0000 7f2ad4432640 1 -- 172.21.15.16:0/174286161 wait complete. 2023-11-28T17:40:24.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 Processor -- start 2023-11-28T17:40:24.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 -- start start 2023-11-28T17:40:24.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc15b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2acc15b350 0x7f2acc15bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0b1be0 con 0x7f2acc1548e0 2023-11-28T17:40:24.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc1f6a70 con 0x7f2acc15b350 2023-11-28T17:40:24.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc1f6140 con 0x7f2acc072090 2023-11-28T17:40:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc15b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad21ce640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc15b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60870/0 (socket says 172.21.15.16:60870) 2023-11-28T17:40:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 -- 172.21.15.16:0/2273141133 learned_addr learned my addr 172.21.15.16:0/2273141133 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:24.217 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad29cf640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2acc15b350 0x7f2acc15bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 -- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 msgr2=0x7f2acc145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 -- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2acc15b350 msgr2=0x7f2acc15bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2acc15b350 0x7f2acc15bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 -- 172.21.15.16:0/2273141133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac80094d0 con 0x7f2acc1548e0 2023-11-28T17:40:24.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad19cd640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc15b760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b480 tx=0x7f2abc00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc010870 con 0x7f2acc1548e0 2023-11-28T17:40:24.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc0109d0 con 0x7f2acc1548e0 2023-11-28T17:40:24.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc1f6420 con 0x7f2acc1548e0 2023-11-28T17:40:24.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.210+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc010d80 con 0x7f2acc1548e0 2023-11-28T17:40:24.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.214+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc146080 con 0x7f2acc1548e0 2023-11-28T17:40:24.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.214+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc1f6c20 con 0x7f2acc1548e0 2023-11-28T17:40:24.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.214+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2abc00f3c0 con 0x7f2acc1548e0 2023-11-28T17:40:24.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.214+0000 7f2ac2ffd640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ab0066900 0x7f2ab0068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.214+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2abc083ff0 con 0x7f2acc1548e0 2023-11-28T17:40:24.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.214+0000 7f2ad21ce640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ab0066900 0x7f2ab0068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.218+0000 7f2ad21ce640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ab0066900 0x7f2ab0068dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80ae000 tx=0x7f2ac80b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.218+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2acc1f6c20 con 0x7f2acc1548e0 2023-11-28T17:40:24.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2acc1f6be0 con 0x7f2acc1548e0 2023-11-28T17:40:24.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ac2ffd640 1 -- 172.21.15.16:0/2273141133 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2abc014020 con 0x7f2acc1548e0 2023-11-28T17:40:24.382 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-28T17:40:24.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ab0066900 msgr2=0x7f2ab0068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ab0066900 0x7f2ab0068dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80ae000 tx=0x7f2ac80b5040 comp rx=0 tx=0).stop 2023-11-28T17:40:24.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 msgr2=0x7f2acc15b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc15b760 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00b480 tx=0x7f2abc00b940 comp rx=0 tx=0).stop 2023-11-28T17:40:24.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 shutdown_connections 2023-11-28T17:40:24.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2ab0066900 0x7f2ab0068dc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2acc15b350 0x7f2acc15bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2acc1548e0 0x7f2acc15b760 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 --2- 172.21.15.16:0/2273141133 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2acc072090 0x7f2acc145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 >> 172.21.15.16:0/2273141133 conn(0x7f2acc06a5a0 msgr2=0x7f2acc06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:24.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 shutdown_connections 2023-11-28T17:40:24.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.378+0000 7f2ad4432640 1 -- 172.21.15.16:0/2273141133 wait complete. 2023-11-28T17:40:24.403 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T17:40:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb2509aa640 1 Processor -- start 2023-11-28T17:40:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb2509aa640 1 -- start start 2023-11-28T17:40:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb2509aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c15d540 0x7fb24c0b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb2509aa640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0b32c0 con 0x7fb24c0d1f50 2023-11-28T17:40:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb2509aa640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb24c0b35a0 con 0x7fb24c0d3690 2023-11-28T17:40:24.547 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb2509aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c15d920 con 0x7fb24c15d540 2023-11-28T17:40:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb243fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fb24c0d1f50 0x7fb24c0d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:44314/0 (socket says 172.21.15.16:44314) 2023-11-28T17:40:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb243fff640 1 -- 172.21.15.16:0/111309653 learned_addr learned my addr 172.21.15.16:0/111309653 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb24a59c640 1 --2- 172.21.15.16:0/111309653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c15d540 0x7fb24c0b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.548 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936523957 0 0) 0x7fb24c0b32c0 con 0x7fb24c0d1f50 2023-11-28T17:40:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb238003530 con 0x7fb24c0d1f50 2023-11-28T17:40:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930504101 0 0) 0x7fb24c0b35a0 con 0x7fb24c0d3690 2023-11-28T17:40:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb24c0b32c0 con 0x7fb24c0d3690 2023-11-28T17:40:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb24a59c640 1 -- 172.21.15.16:0/111309653 >> v1:172.21.15.64:6789/0 conn(0x7fb24c0d3690 legacy=0x7fb24c0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb24a59c640 1 -- 172.21.15.16:0/111309653 >> v1:172.21.15.16:6789/0 conn(0x7fb24c0d1f50 legacy=0x7fb24c0d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.549 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.542+0000 7fb24a59c640 1 -- 172.21.15.16:0/111309653 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c0b3880 con 0x7fb24c15d540 2023-11-28T17:40:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb24a59c640 1 --2- 172.21.15.16:0/111309653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c15d540 0x7fb24c0b29c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0097f0 tx=0x7fb23c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a576bb3b9624489d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0ab600 con 0x7fb24c15d540 2023-11-28T17:40:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0ab760 con 0x7fb24c15d540 2023-11-28T17:40:24.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb249d9b640 1 -- 172.21.15.16:0/111309653 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0abad0 con 0x7fb24c15d540 2023-11-28T17:40:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 -- 172.21.15.16:0/111309653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c15d540 msgr2=0x7fb24c0b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 --2- 172.21.15.16:0/111309653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c15d540 0x7fb24c0b29c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0097f0 tx=0x7fb23c01c400 comp rx=0 tx=0).stop 2023-11-28T17:40:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 -- 172.21.15.16:0/111309653 shutdown_connections 2023-11-28T17:40:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 --2- 172.21.15.16:0/111309653 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c15d540 0x7fb24c0b29c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 -- 172.21.15.16:0/111309653 >> 172.21.15.16:0/111309653 conn(0x7fb24c08ccf0 msgr2=0x7fb24c09c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 -- 172.21.15.16:0/111309653 shutdown_connections 2023-11-28T17:40:24.553 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.546+0000 7fb2509aa640 1 -- 172.21.15.16:0/111309653 wait complete. 2023-11-28T17:40:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 Processor -- start 2023-11-28T17:40:24.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 -- start start 2023-11-28T17:40:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c0d1f50 0x7fb24c152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 0x7fb24c14fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb24c15d540 0x7fb24c0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c15e470 con 0x7fb24c0d3690 2023-11-28T17:40:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c15e750 con 0x7fb24c15d540 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24c154810 con 0x7fb24c0d1f50 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 0x7fb24c14fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 0x7fb24c14fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60874/0 (socket says 172.21.15.16:60874) 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 -- 172.21.15.16:0/3045205794 learned_addr learned my addr 172.21.15.16:0/3045205794 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb24a59c640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c0d1f50 0x7fb24c152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 -- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c0d1f50 msgr2=0x7fb24c152720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c0d1f50 0x7fb24c152720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb24ad9d640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb24c15d540 0x7fb24c0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 -- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb24c15d540 msgr2=0x7fb24c0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb24c15d540 0x7fb24c0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 -- 172.21.15.16:0/3045205794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009420 con 0x7fb24c0d3690 2023-11-28T17:40:24.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb24ad9d640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb24c15d540 0x7fb24c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:24.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb243fff640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 0x7fb24c14fbb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c4d0 tx=0x7fb23400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234005cf0 con 0x7fb24c0d3690 2023-11-28T17:40:24.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb234005e50 con 0x7fb24c0d3690 2023-11-28T17:40:24.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb234007290 con 0x7fb24c0d3690 2023-11-28T17:40:24.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb24c154ab0 con 0x7fb24c0d3690 2023-11-28T17:40:24.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.550+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb24c152c60 con 0x7fb24c0d3690 2023-11-28T17:40:24.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.554+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24c068860 con 0x7fb24c0d3690 2023-11-28T17:40:24.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.554+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb2340073f0 con 0x7fb24c0d3690 2023-11-28T17:40:24.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.554+0000 7fb242ffd640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb22c066900 0x7fb22c068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.554+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb2340836b0 con 0x7fb24c0d3690 2023-11-28T17:40:24.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.554+0000 7fb24a59c640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb22c066900 0x7fb22c068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.554+0000 7fb24a59c640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb22c066900 0x7fb22c068dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0af000 tx=0x7fb23c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.558+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb234050c30 con 0x7fb24c0d3690 2023-11-28T17:40:24.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.718+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb24c06ccb0 con 0x7fb24c0d3690 2023-11-28T17:40:24.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.718+0000 7fb242ffd640 1 -- 172.21.15.16:0/3045205794 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb234017090 con 0x7fb24c0d3690 2023-11-28T17:40:24.724 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:24.725 INFO:teuthology.orchestra.run.smithi016.stdout:[ 2023-11-28T17:40:24.725 INFO:teuthology.orchestra.run.smithi016.stdout: { 2023-11-28T17:40:24.725 INFO:teuthology.orchestra.run.smithi016.stdout: "poolnum": 1, 2023-11-28T17:40:24.725 INFO:teuthology.orchestra.run.smithi016.stdout: "poolname": ".mgr" 2023-11-28T17:40:24.725 INFO:teuthology.orchestra.run.smithi016.stdout: } 2023-11-28T17:40:24.725 INFO:teuthology.orchestra.run.smithi016.stdout:] 2023-11-28T17:40:24.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb22c066900 msgr2=0x7fb22c068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb22c066900 0x7fb22c068dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb23c0af000 tx=0x7fb23c0a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 msgr2=0x7fb24c14fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 0x7fb24c14fbb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c4d0 tx=0x7fb23400c990 comp rx=0 tx=0).stop 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 shutdown_connections 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb22c066900 0x7fb22c068dc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb24c15d540 0x7fb24c0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb24c0d3690 0x7fb24c14fbb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 --2- 172.21.15.16:0/3045205794 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb24c0d1f50 0x7fb24c152720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 >> 172.21.15.16:0/3045205794 conn(0x7fb24c08ccf0 msgr2=0x7fb24c0b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 shutdown_connections 2023-11-28T17:40:24.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.722+0000 7fb2509aa640 1 -- 172.21.15.16:0/3045205794 wait complete. 2023-11-28T17:40:24.746 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T17:40:24.746 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T17:40:24.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 Processor -- start 2023-11-28T17:40:24.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 -- start start 2023-11-28T17:40:24.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6e7415d4b0 0x7f6e740b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e740b6880 0x7f6e7406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e740d23f0 con 0x7f6e7406bff0 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7406c480 con 0x7f6e7415d4b0 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e78957640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7415d890 con 0x7f6e740b6880 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e740b6880 0x7f6e7406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e7259c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6e7415d4b0 0x7f6e740b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e740b6880 0x7f6e7406bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:39282/0 (socket says 172.21.15.16:39282) 2023-11-28T17:40:24.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e6bfff640 1 -- 172.21.15.16:0/2477817886 learned_addr learned my addr 172.21.15.16:0/2477817886 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:24.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e7259c640 1 -- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e740b6880 msgr2=0x7f6e7406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:24.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e7259c640 1 --2- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e740b6880 0x7f6e7406bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e7259c640 1 -- 172.21.15.16:0/2477817886 >> v1:172.21.15.64:6789/0 conn(0x7f6e7406bff0 legacy=0x7f6e740d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.890+0000 7f6e7259c640 1 -- 172.21.15.16:0/2477817886 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740d2920 con 0x7f6e7415d4b0 2023-11-28T17:40:24.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e7259c640 1 --2- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7415d4b0 0x7f6e740b6340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e6401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=851af58dc574b77a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e71d9b640 1 -- 172.21.15.16:0/2477817886 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640ac620 con 0x7f6e7415d4b0 2023-11-28T17:40:24.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e71d9b640 1 -- 172.21.15.16:0/2477817886 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e640ac780 con 0x7f6e7415d4b0 2023-11-28T17:40:24.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e71d9b640 1 -- 172.21.15.16:0/2477817886 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640acb10 con 0x7f6e7415d4b0 2023-11-28T17:40:24.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 -- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7415d4b0 msgr2=0x7f6e740b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 --2- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7415d4b0 0x7f6e740b6340 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6e640097c0 tx=0x7f6e6401c3c0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 -- 172.21.15.16:0/2477817886 shutdown_connections 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 --2- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e740b6880 0x7f6e7406bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 --2- 172.21.15.16:0/2477817886 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e7415d4b0 0x7f6e740b6340 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 -- 172.21.15.16:0/2477817886 >> 172.21.15.16:0/2477817886 conn(0x7f6e740720d0 msgr2=0x7f6e740724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 -- 172.21.15.16:0/2477817886 shutdown_connections 2023-11-28T17:40:24.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.894+0000 7f6e78957640 1 -- 172.21.15.16:0/2477817886 wait complete. 2023-11-28T17:40:24.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 Processor -- start 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 -- start start 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e7406bff0 0x7f6e74151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e740b6880 0x7f6e740ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 0x7f6e7415f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7415ab00 con 0x7f6e7415d4b0 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740ca420 con 0x7f6e740b6880 2023-11-28T17:40:24.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740c6dc0 con 0x7f6e7406bff0 2023-11-28T17:40:24.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 0x7f6e7415f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e740b6880 0x7f6e740ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e7259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e7406bff0 0x7f6e74151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 0x7f6e7415f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60888/0 (socket says 172.21.15.16:60888) 2023-11-28T17:40:24.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 -- 172.21.15.16:0/3870643553 learned_addr learned my addr 172.21.15.16:0/3870643553 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e6bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e740b6880 0x7f6e740ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:49920/0 (socket says 172.21.15.16:49920) 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 -- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e7406bff0 msgr2=0x7f6e74151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e7406bff0 0x7f6e74151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 -- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e740b6880 msgr2=0x7f6e740ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e740b6880 0x7f6e740ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 -- 172.21.15.16:0/3870643553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e64009420 con 0x7f6e7415d4b0 2023-11-28T17:40:24.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e72d9d640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 0x7f6e7415f4a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c760 tx=0x7f6e6c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c003b80 con 0x7f6e7415d4b0 2023-11-28T17:40:24.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c003ce0 con 0x7f6e7415d4b0 2023-11-28T17:40:24.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740ca690 con 0x7f6e7415d4b0 2023-11-28T17:40:24.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.898+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c00aa30 con 0x7f6e7415d4b0 2023-11-28T17:40:24.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7415ad50 con 0x7f6e7415d4b0 2023-11-28T17:40:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7415af40 con 0x7f6e7415d4b0 2023-11-28T17:40:24.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6e6c00ab90 con 0x7f6e7415d4b0 2023-11-28T17:40:24.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e6affd640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6e540668d0 0x7f6e54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:24.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e6c083de0 con 0x7f6e7415d4b0 2023-11-28T17:40:24.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e7259c640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6e540668d0 0x7f6e54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:24.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.902+0000 7f6e7259c640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6e540668d0 0x7f6e54068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e640ae000 tx=0x7f6e64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:24.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:24.906+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6e6c051380 con 0x7f6e7415d4b0 2023-11-28T17:40:25.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.066+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6e74068860 con 0x7f6e7415d4b0 2023-11-28T17:40:25.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.898+0000 7f6e6affd640 1 -- 172.21.15.16:0/3870643553 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6e6c0549a0 con 0x7f6e7415d4b0 2023-11-28T17:40:25.902 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' created 2023-11-28T17:40:25.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6e540668d0 msgr2=0x7f6e54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:25.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6e540668d0 0x7f6e54068d90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e640ae000 tx=0x7f6e64008040 comp rx=0 tx=0).stop 2023-11-28T17:40:25.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 msgr2=0x7f6e7415f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 0x7f6e7415f4a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c00c760 tx=0x7f6e6c00cc20 comp rx=0 tx=0).stop 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 shutdown_connections 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6e7415d4b0 0x7f6e7415f4a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6e540668d0 0x7f6e54068d90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e740b6880 0x7f6e740ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 --2- 172.21.15.16:0/3870643553 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6e7406bff0 0x7f6e74151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 >> 172.21.15.16:0/3870643553 conn(0x7f6e740720d0 msgr2=0x7f6e74153010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 shutdown_connections 2023-11-28T17:40:25.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:25.902+0000 7f6e78957640 1 -- 172.21.15.16:0/3870643553 wait complete. 2023-11-28T17:40:25.932 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T17:40:26.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 Processor -- start 2023-11-28T17:40:26.086 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 -- start start 2023-11-28T17:40:26.087 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f221415d540 0x7f22140b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d1f50 0x7f22140d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22140d34c0 0x7f22140cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f221415d920 con 0x7f22140d34c0 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22140b32c0 con 0x7f221415d540 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221c7aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22140b35a0 con 0x7f22140d1f50 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22140d34c0 0x7f22140cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f22140d34c0 0x7f22140cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60902/0 (socket says 172.21.15.16:60902) 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 -- 172.21.15.16:0/2142196070 learned_addr learned my addr 172.21.15.16:0/2142196070 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221a546640 1 --2- 172.21.15.16:0/2142196070 >> v2:172.21.15.64:3300/0 conn(0x7f221415d540 0x7f22140b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f2219d45640 1 --2- 172.21.15.16:0/2142196070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d1f50 0x7f22140d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 -- 172.21.15.16:0/2142196070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d1f50 msgr2=0x7f22140d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 --2- 172.21.15.16:0/2142196070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d1f50 0x7f22140d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 -- 172.21.15.16:0/2142196070 >> v2:172.21.15.64:3300/0 conn(0x7f221415d540 msgr2=0x7f22140b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 --2- 172.21.15.16:0/2142196070 >> v2:172.21.15.64:3300/0 conn(0x7f221415d540 0x7f22140b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.082+0000 7f221ad47640 1 -- 172.21.15.16:0/2142196070 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140b3880 con 0x7f22140d34c0 2023-11-28T17:40:26.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221ad47640 1 --2- 172.21.15.16:0/2142196070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d34c0 0x7f22140cfbc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f221408cc80 tx=0x7f220c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=405cdc529f972ff7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:26.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f2219544640 1 -- 172.21.15.16:0/2142196070 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0a5560 con 0x7f22140d34c0 2023-11-28T17:40:26.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f2219544640 1 -- 172.21.15.16:0/2142196070 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220c0a56c0 con 0x7f22140d34c0 2023-11-28T17:40:26.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f2219544640 1 -- 172.21.15.16:0/2142196070 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220c0a5a50 con 0x7f22140d34c0 2023-11-28T17:40:26.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 -- 172.21.15.16:0/2142196070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d34c0 msgr2=0x7f22140cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:26.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 --2- 172.21.15.16:0/2142196070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d34c0 0x7f22140cfbc0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f221408cc80 tx=0x7f220c01c6e0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 -- 172.21.15.16:0/2142196070 shutdown_connections 2023-11-28T17:40:26.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 --2- 172.21.15.16:0/2142196070 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d34c0 0x7f22140cfbc0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 --2- 172.21.15.16:0/2142196070 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d1f50 0x7f22140d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 --2- 172.21.15.16:0/2142196070 >> v2:172.21.15.64:3300/0 conn(0x7f221415d540 0x7f22140b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 -- 172.21.15.16:0/2142196070 >> 172.21.15.16:0/2142196070 conn(0x7f221408ccf0 msgr2=0x7f221409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:26.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 -- 172.21.15.16:0/2142196070 shutdown_connections 2023-11-28T17:40:26.093 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.086+0000 7f221c7aa640 1 -- 172.21.15.16:0/2142196070 wait complete. 2023-11-28T17:40:26.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 Processor -- start 2023-11-28T17:40:26.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 -- start start 2023-11-28T17:40:26.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 0x7f221414fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d34c0 0x7f22141537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221415d540 0x7f221415ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22141504a0 con 0x7f22140d1f50 2023-11-28T17:40:26.095 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221415e950 con 0x7f221415d540 2023-11-28T17:40:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221415ec30 con 0x7f22140d34c0 2023-11-28T17:40:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 0x7f221414fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 0x7f221414fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:60908/0 (socket says 172.21.15.16:60908) 2023-11-28T17:40:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 -- 172.21.15.16:0/1892864038 learned_addr learned my addr 172.21.15.16:0/1892864038 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f2219d45640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d34c0 0x7f22141537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221ad47640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221415d540 0x7f221415ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 -- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d34c0 msgr2=0x7f22141537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d34c0 0x7f22141537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 -- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221415d540 msgr2=0x7f221415ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221415d540 0x7f221415ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 -- 172.21.15.16:0/1892864038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f220c009b30 con 0x7f22140d1f50 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221a546640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 0x7f221414fc70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f221000e870 tx=0x7f221000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:26.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210009510 con 0x7f22140d1f50 2023-11-28T17:40:26.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f221000eec0 con 0x7f22140d1f50 2023-11-28T17:40:26.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f221000cb40 con 0x7f22140d1f50 2023-11-28T17:40:26.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22141506f0 con 0x7f22140d1f50 2023-11-28T17:40:26.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.090+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22141501b0 con 0x7f22140d1f50 2023-11-28T17:40:26.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.094+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f221415edf0 con 0x7f22140d1f50 2023-11-28T17:40:26.099 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.094+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f221000cca0 con 0x7f22140d1f50 2023-11-28T17:40:26.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.094+0000 7f220affd640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21f80668d0 0x7f21f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:26.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.094+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2210084a30 con 0x7f22140d1f50 2023-11-28T17:40:26.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.094+0000 7f2219d45640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21f80668d0 0x7f21f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:26.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.098+0000 7f2219d45640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21f80668d0 0x7f21f8068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f221406bee0 tx=0x7f2204008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:26.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.098+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2210051fe0 con 0x7f22140d1f50 2023-11-28T17:40:26.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.262+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2214068860 con 0x7f22140d1f50 2023-11-28T17:40:26.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.906+0000 7f220affd640 1 -- 172.21.15.16:0/1892864038 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f22100170d0 con 0x7f22140d1f50 2023-11-28T17:40:26.910 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' created 2023-11-28T17:40:26.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21f80668d0 msgr2=0x7f21f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:26.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21f80668d0 0x7f21f8068d90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f221406bee0 tx=0x7f2204008040 comp rx=0 tx=0).stop 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 msgr2=0x7f221414fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 0x7f221414fc70 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f221000e870 tx=0x7f221000ec70 comp rx=0 tx=0).stop 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 shutdown_connections 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21f80668d0 0x7f21f8068d90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f221415d540 0x7f221415ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f22140d34c0 0x7f22141537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 --2- 172.21.15.16:0/1892864038 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f22140d1f50 0x7f221414fc70 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 >> 172.21.15.16:0/1892864038 conn(0x7f221408ccf0 msgr2=0x7f2214159840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 shutdown_connections 2023-11-28T17:40:26.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:26.910+0000 7f221c7aa640 1 -- 172.21.15.16:0/1892864038 wait complete. 2023-11-28T17:40:26.956 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T17:40:27.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.098+0000 7f7ad607b640 1 Processor -- start 2023-11-28T17:40:27.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.098+0000 7f7ad607b640 1 -- start start 2023-11-28T17:40:27.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad607b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ad0143600 0x7f7ad00ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:27.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad607b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad006d5a0 0x7f7ad006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:27.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad607b640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad00cbfb0 con 0x7f7ad00b3e30 2023-11-28T17:40:27.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad607b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad006df50 con 0x7f7ad0143600 2023-11-28T17:40:27.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad607b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00cc210 con 0x7f7ad006d5a0 2023-11-28T17:40:27.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ad0143600 0x7f7ad00ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:27.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7ad0143600 0x7f7ad00ce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37602/0 (socket says 172.21.15.16:37602) 2023-11-28T17:40:27.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 -- 172.21.15.16:0/2540042599 learned_addr learned my addr 172.21.15.16:0/2540042599 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:27.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad587a640 1 --2- 172.21.15.16:0/2540042599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad006d5a0 0x7f7ad006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:27.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 -- 172.21.15.16:0/2540042599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad006d5a0 msgr2=0x7f7ad006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:27.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 --2- 172.21.15.16:0/2540042599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad006d5a0 0x7f7ad006da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 -- 172.21.15.16:0/2540042599 >> v1:172.21.15.64:6789/0 conn(0x7f7ad00b3e30 legacy=0x7f7ad00cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:27.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.102+0000 7f7ad5079640 1 -- 172.21.15.16:0/2540042599 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00cec20 con 0x7f7ad0143600 2023-11-28T17:40:27.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad5079640 1 --2- 172.21.15.16:0/2540042599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad0143600 0x7f7ad00ce6e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009870 tx=0x7f7acc01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d4a28d06a53e40f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:27.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ac7fff640 1 -- 172.21.15.16:0/2540042599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0a7070 con 0x7f7ad0143600 2023-11-28T17:40:27.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ac7fff640 1 -- 172.21.15.16:0/2540042599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc0ab430 con 0x7f7ad0143600 2023-11-28T17:40:27.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ac7fff640 1 -- 172.21.15.16:0/2540042599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0ab7c0 con 0x7f7ad0143600 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- 172.21.15.16:0/2540042599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad0143600 msgr2=0x7f7ad00ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 --2- 172.21.15.16:0/2540042599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad0143600 0x7f7ad00ce6e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009870 tx=0x7f7acc01c540 comp rx=0 tx=0).stop 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- 172.21.15.16:0/2540042599 shutdown_connections 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 --2- 172.21.15.16:0/2540042599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad006d5a0 0x7f7ad006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 --2- 172.21.15.16:0/2540042599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad0143600 0x7f7ad00ce6e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- 172.21.15.16:0/2540042599 >> 172.21.15.16:0/2540042599 conn(0x7f7ad006aba0 msgr2=0x7f7ad00b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- 172.21.15.16:0/2540042599 shutdown_connections 2023-11-28T17:40:27.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- 172.21.15.16:0/2540042599 wait complete. 2023-11-28T17:40:27.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 Processor -- start 2023-11-28T17:40:27.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- start start 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 0x7f7ad01319f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ad00b3e30 0x7f7ad015bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad0143600 0x7f7ad0157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad0158930 con 0x7f7ad006d5a0 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad0158c10 con 0x7f7ad00b3e30 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad607b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad0158ef0 con 0x7f7ad0143600 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.106+0000 7f7ad5079640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 0x7f7ad01319f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 0x7f7ad01319f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37604/0 (socket says 172.21.15.16:37604) 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 -- 172.21.15.16:0/1675369314 learned_addr learned my addr 172.21.15.16:0/1675369314 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad587a640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad0143600 0x7f7ad0157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:27.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad4878640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ad00b3e30 0x7f7ad015bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 -- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad0143600 msgr2=0x7f7ad0157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad0143600 0x7f7ad0157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 -- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ad00b3e30 msgr2=0x7f7ad015bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ad00b3e30 0x7f7ad015bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 -- 172.21.15.16:0/1675369314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0094d0 con 0x7f7ad006d5a0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad4878640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ad00b3e30 0x7f7ad015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad5079640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 0x7f7ad01319f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0ad040 tx=0x7f7acc0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0bc070 con 0x7f7ad006d5a0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc0b4420 con 0x7f7ad006d5a0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0b47d0 con 0x7f7ad006d5a0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad01591d0 con 0x7f7ad006d5a0 2023-11-28T17:40:27.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad0131f30 con 0x7f7ad006d5a0 2023-11-28T17:40:27.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad00cca70 con 0x7f7ad006d5a0 2023-11-28T17:40:27.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.110+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7acc0b4930 con 0x7f7ad006d5a0 2023-11-28T17:40:27.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.114+0000 7f7ac5ffb640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ab40668d0 0x7f7ab4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:27.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.114+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7acc11dc40 con 0x7f7ad006d5a0 2023-11-28T17:40:27.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.114+0000 7f7ad4878640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ab40668d0 0x7f7ab4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:27.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.114+0000 7f7ad4878640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ab40668d0 0x7f7ab4068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7ad01344f0 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:27.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.118+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7acc0eaed0 con 0x7f7ad006d5a0 2023-11-28T17:40:27.310 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.306+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7ad004e890 con 0x7f7ad006d5a0 2023-11-28T17:40:27.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.906+0000 7f7ac5ffb640 1 -- 172.21.15.16:0/1675369314 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7acc0ee4f0 con 0x7f7ad006d5a0 2023-11-28T17:40:27.912 INFO:teuthology.orchestra.run.smithi016.stderr:new fs with metadata pool 4 and data pool 5 2023-11-28T17:40:27.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ab40668d0 msgr2=0x7f7ab4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:27.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ab40668d0 0x7f7ab4068d90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7ad01344f0 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2023-11-28T17:40:27.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 msgr2=0x7f7ad01319f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:27.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 0x7f7ad01319f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0ad040 tx=0x7f7acc0192e0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 shutdown_connections 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7ad0143600 0x7f7ad0157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7ab40668d0 0x7f7ab4068d90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ad00b3e30 0x7f7ad015bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 --2- 172.21.15.16:0/1675369314 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7ad006d5a0 0x7f7ad01319f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 >> 172.21.15.16:0/1675369314 conn(0x7f7ad006aba0 msgr2=0x7f7ad015cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 shutdown_connections 2023-11-28T17:40:27.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:27.910+0000 7f7ad607b640 1 -- 172.21.15.16:0/1675369314 wait complete. 2023-11-28T17:40:27.974 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:28.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.114+0000 7f60a4c6b640 1 Processor -- start 2023-11-28T17:40:28.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.114+0000 7f60a4c6b640 1 -- start start 2023-11-28T17:40:28.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f60a4c6b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f60a015d620 0x7f60a00cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.121 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f60a4c6b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60a006e880 0x7f60a006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f60a4c6b640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a006f210 con 0x7f60a006d300 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f60a4c6b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00cbcd0 con 0x7f60a006e880 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f60a4c6b640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a00cee20 con 0x7f60a015d620 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60a006e880 0x7f60a006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60a006e880 0x7f60a006ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37612/0 (socket says 172.21.15.16:37612) 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 -- 172.21.15.16:0/3046084816 learned_addr learned my addr 172.21.15.16:0/3046084816 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:28.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609e59c640 1 --2- 172.21.15.16:0/3046084816 >> v2:172.21.15.64:3300/0 conn(0x7f60a015d620 0x7f60a00cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 -- 172.21.15.16:0/3046084816 >> v2:172.21.15.64:3300/0 conn(0x7f60a015d620 msgr2=0x7f60a00cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:28.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 --2- 172.21.15.16:0/3046084816 >> v2:172.21.15.64:3300/0 conn(0x7f60a015d620 0x7f60a00cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 -- 172.21.15.16:0/3046084816 >> v1:172.21.15.64:6789/0 conn(0x7f60a006d300 legacy=0x7f60a0161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.118+0000 7f609ed9d640 1 -- 172.21.15.16:0/3046084816 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a00cf100 con 0x7f60a006e880 2023-11-28T17:40:28.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f609ed9d640 1 --2- 172.21.15.16:0/3046084816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a006e880 0x7f60a006ecd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6098009e50 tx=0x7f609801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3075fc12621b58c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f609d59a640 1 -- 172.21.15.16:0/3046084816 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980a5860 con 0x7f60a006e880 2023-11-28T17:40:28.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f609d59a640 1 -- 172.21.15.16:0/3046084816 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980a59c0 con 0x7f60a006e880 2023-11-28T17:40:28.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f609d59a640 1 -- 172.21.15.16:0/3046084816 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980a5d50 con 0x7f60a006e880 2023-11-28T17:40:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 -- 172.21.15.16:0/3046084816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a006e880 msgr2=0x7f60a006ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/3046084816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a006e880 0x7f60a006ecd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f6098009e50 tx=0x7f609801c9a0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 -- 172.21.15.16:0/3046084816 shutdown_connections 2023-11-28T17:40:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/3046084816 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a006e880 0x7f60a006ecd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/3046084816 >> v2:172.21.15.64:3300/0 conn(0x7f60a015d620 0x7f60a00cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 -- 172.21.15.16:0/3046084816 >> 172.21.15.16:0/3046084816 conn(0x7f60a006a5a0 msgr2=0x7f60a006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:28.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 -- 172.21.15.16:0/3046084816 shutdown_connections 2023-11-28T17:40:28.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 -- 172.21.15.16:0/3046084816 wait complete. 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 Processor -- start 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.122+0000 7f60a4c6b640 1 -- start start 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60a006d300 0x7f60a00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a006e880 0x7f60a015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 0x7f60a00c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a015ec00 con 0x7f60a015d620 2023-11-28T17:40:28.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a0156b90 con 0x7f60a006e880 2023-11-28T17:40:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a01568b0 con 0x7f60a006d300 2023-11-28T17:40:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 0x7f60a00c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 0x7f60a00c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37628/0 (socket says 172.21.15.16:37628) 2023-11-28T17:40:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 -- 172.21.15.16:0/1203154643 learned_addr learned my addr 172.21.15.16:0/1203154643 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609e59c640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60a006d300 0x7f60a00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609dd9b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a006e880 0x7f60a015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 -- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60a006d300 msgr2=0x7f60a00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60a006d300 0x7f60a00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 -- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a006e880 msgr2=0x7f60a015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a006e880 0x7f60a015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 -- 172.21.15.16:0/1203154643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6098009b30 con 0x7f60a015d620 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f609ed9d640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 0x7f60a00c8ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f60980af040 tx=0x7f6098019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980b8670 con 0x7f60a015d620 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60980b87d0 con 0x7f60a015d620 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a015e5b0 con 0x7f60a015d620 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60980b8b80 con 0x7f60a015d620 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a015fbe0 con 0x7f60a015d620 2023-11-28T17:40:28.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.126+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a015e410 con 0x7f60a015d620 2023-11-28T17:40:28.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.130+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60980b8ce0 con 0x7f60a015d620 2023-11-28T17:40:28.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.130+0000 7f608effd640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60800668d0 0x7f6080068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.130+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6098120190 con 0x7f60a015d620 2023-11-28T17:40:28.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.130+0000 7f609e59c640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60800668d0 0x7f6080068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.130+0000 7f609e59c640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60800668d0 0x7f6080068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6090009b60 tx=0x7f6090009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.134+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60980ed580 con 0x7f60a015d620 2023-11-28T17:40:28.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.290+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60a015e410 con 0x7f60a015d620 2023-11-28T17:40:28.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f608effd640 1 -- 172.21.15.16:0/1203154643 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f60a015e410 con 0x7f60a015d620 2023-11-28T17:40:28.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:28.297 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:40:27.311050+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60800668d0 msgr2=0x7f6080068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60800668d0 0x7f6080068d90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6090009b60 tx=0x7f6090009190 comp rx=0 tx=0).stop 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 msgr2=0x7f60a00c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 0x7f60a00c8ab0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f60980af040 tx=0x7f6098019740 comp rx=0 tx=0).stop 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 shutdown_connections 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60a015d620 0x7f60a00c8ab0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60800668d0 0x7f6080068d90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60a006e880 0x7f60a015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 --2- 172.21.15.16:0/1203154643 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60a006d300 0x7f60a00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 >> 172.21.15.16:0/1203154643 conn(0x7f60a006a5a0 msgr2=0x7f60a006b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:28.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 shutdown_connections 2023-11-28T17:40:28.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.294+0000 7f60a4c6b640 1 -- 172.21.15.16:0/1203154643 wait complete. 2023-11-28T17:40:28.318 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e63c17640 1 Processor -- start 2023-11-28T17:40:28.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e63c17640 1 -- start start 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e63c17640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e63c17640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0cf840 con 0x7f3e5c144c80 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e63c17640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e5c0ce4f0 con 0x7f3e5c0cef30 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e63c17640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0709b0 con 0x7f3e5c0cf3b0 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e619b3640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f3e5c144c80 0x7f3e5c0cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49764/0 (socket says 172.21.15.16:49764) 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e619b3640 1 -- 172.21.15.16:0/2473648011 learned_addr learned my addr 172.21.15.16:0/2473648011 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:28.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e621b4640 1 --2- 172.21.15.16:0/2473648011 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073669248 0 0) 0x7f3e5c0cf840 con 0x7f3e5c144c80 2023-11-28T17:40:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e48003530 con 0x7f3e5c144c80 2023-11-28T17:40:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.458+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034562834 0 0) 0x7f3e5c0ce4f0 con 0x7f3e5c0cef30 2023-11-28T17:40:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e5c0cf840 con 0x7f3e5c0cef30 2023-11-28T17:40:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e621b4640 1 -- 172.21.15.16:0/2473648011 >> v1:172.21.15.64:6789/0 conn(0x7f3e5c0cef30 legacy=0x7f3e5c070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.465 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e621b4640 1 -- 172.21.15.16:0/2473648011 >> v1:172.21.15.16:6789/0 conn(0x7f3e5c144c80 legacy=0x7f3e5c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e621b4640 1 -- 172.21.15.16:0/2473648011 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e5c0ce7d0 con 0x7f3e5c0cf3b0 2023-11-28T17:40:28.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e621b4640 1 --2- 172.21.15.16:0/2473648011 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0714e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009dc0 tx=0x7f3e5401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a2665c8f5310ca4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540a5940 con 0x7f3e5c0cf3b0 2023-11-28T17:40:28.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540a5aa0 con 0x7f3e5c0cf3b0 2023-11-28T17:40:28.468 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e609b1640 1 -- 172.21.15.16:0/2473648011 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540a5e30 con 0x7f3e5c0cf3b0 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e63c17640 1 -- 172.21.15.16:0/2473648011 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cf3b0 msgr2=0x7f3e5c0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e63c17640 1 --2- 172.21.15.16:0/2473648011 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0714e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3e54009dc0 tx=0x7f3e5401c970 comp rx=0 tx=0).stop 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e63c17640 1 -- 172.21.15.16:0/2473648011 shutdown_connections 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e63c17640 1 --2- 172.21.15.16:0/2473648011 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0714e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.462+0000 7f3e63c17640 1 -- 172.21.15.16:0/2473648011 >> 172.21.15.16:0/2473648011 conn(0x7f3e5c06a5a0 msgr2=0x7f3e5c06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 -- 172.21.15.16:0/2473648011 shutdown_connections 2023-11-28T17:40:28.469 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 -- 172.21.15.16:0/2473648011 wait complete. 2023-11-28T17:40:28.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 Processor -- start 2023-11-28T17:40:28.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 -- start start 2023-11-28T17:40:28.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cef30 0x7f3e5c0b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 0x7f3e5c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c158fe0 con 0x7f3e5c144c80 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0aded0 con 0x7f3e5c0cf3b0 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e63c17640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5c0ae1b0 con 0x7f3e5c0cef30 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 0x7f3e5c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 0x7f3e5c0ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37642/0 (socket says 172.21.15.16:37642) 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 -- 172.21.15.16:0/623065696 learned_addr learned my addr 172.21.15.16:0/623065696 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e611b2640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e619b3640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cef30 0x7f3e5c0b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 -- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cef30 msgr2=0x7f3e5c0b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cef30 0x7f3e5c0b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 -- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5c0cf3b0 msgr2=0x7f3e5c0ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 -- 172.21.15.16:0/623065696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54009a70 con 0x7f3e5c144c80 2023-11-28T17:40:28.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e619b3640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cef30 0x7f3e5c0b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e621b4640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 0x7f3e5c0ad800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3e5401a5a0 tx=0x7f3e54019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540adc80 con 0x7f3e5c144c80 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e540adde0 con 0x7f3e5c144c80 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.466+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e540b7650 con 0x7f3e5c144c80 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e5c13d280 con 0x7f3e5c144c80 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e5c13d840 con 0x7f3e5c144c80 2023-11-28T17:40:28.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5c13da30 con 0x7f3e5c144c80 2023-11-28T17:40:28.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3e540b4050 con 0x7f3e5c144c80 2023-11-28T17:40:28.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e527fc640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3e400668d0 0x7f3e40068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e5411f4d0 con 0x7f3e5c144c80 2023-11-28T17:40:28.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.470+0000 7f3e619b3640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3e400668d0 0x7f3e40068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.476 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.474+0000 7f3e619b3640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3e400668d0 0x7f3e40068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e58000f70 tx=0x7f3e58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.474+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e540ec7b0 con 0x7f3e5c144c80 2023-11-28T17:40:28.640 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.634+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e5c068860 con 0x7f3e5c144c80 2023-11-28T17:40:28.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e527fc640 1 -- 172.21.15.16:0/623065696 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16474 (secure 0 0 0) 0x7f3e54009450 con 0x7f3e5c144c80 2023-11-28T17:40:28.642 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:28.642 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":34,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:40:27.311050+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3e400668d0 msgr2=0x7f3e40068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3e400668d0 0x7f3e40068d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3e58000f70 tx=0x7f3e58009040 comp rx=0 tx=0).stop 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 msgr2=0x7f3e5c0ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 0x7f3e5c0ad800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3e5401a5a0 tx=0x7f3e54019710 comp rx=0 tx=0).stop 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 shutdown_connections 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3e5c144c80 0x7f3e5c0ad800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3e400668d0 0x7f3e40068d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5c0cf3b0 0x7f3e5c0ad2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 --2- 172.21.15.16:0/623065696 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3e5c0cef30 0x7f3e5c0b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.644 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 >> 172.21.15.16:0/623065696 conn(0x7f3e5c06a5a0 msgr2=0x7f3e5c0cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:28.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 shutdown_connections 2023-11-28T17:40:28.645 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.638+0000 7f3e63c17640 1 -- 172.21.15.16:0/623065696 wait complete. 2023-11-28T17:40:28.663 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T17:40:28.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 Processor -- start 2023-11-28T17:40:28.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 -- start start 2023-11-28T17:40:28.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f596c0d1b10 0x7f596c0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596c15d870 con 0x7f596c0b8b80 2023-11-28T17:40:28.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f596c0b6d20 con 0x7f596c0d1b10 2023-11-28T17:40:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5971757640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0b7000 con 0x7f596c0cfca0 2023-11-28T17:40:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f596b7fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f596c0b8b80 0x7f596c0b7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49776/0 (socket says 172.21.15.16:49776) 2023-11-28T17:40:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f596b7fe640 1 -- 172.21.15.16:0/3543827800 learned_addr learned my addr 172.21.15.16:0/3543827800 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5963fff640 1 --2- 172.21.15.16:0/3543827800 >> v2:172.21.15.64:3300/0 conn(0x7f596c0d1b10 0x7f596c0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f596affd640 1 --2- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f596a7fc640 1 -- 172.21.15.16:0/3543827800 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583654857 0 0) 0x7f596c15d870 con 0x7f596c0b8b80 2023-11-28T17:40:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f596a7fc640 1 -- 172.21.15.16:0/3543827800 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5958003530 con 0x7f596c0b8b80 2023-11-28T17:40:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5963fff640 1 -- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 msgr2=0x7f596c0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5963fff640 1 --2- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0d15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5963fff640 1 -- 172.21.15.16:0/3543827800 >> v1:172.21.15.16:6789/0 conn(0x7f596c0b8b80 legacy=0x7f596c0b7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.806+0000 7f5963fff640 1 -- 172.21.15.16:0/3543827800 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596c0b72e0 con 0x7f596c0d1b10 2023-11-28T17:40:28.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5963fff640 1 --2- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0b6290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59540097c0 tx=0x7f595401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c8a7ed99ef4a522 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f596a7fc640 1 -- 172.21.15.16:0/3543827800 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540a8970 con 0x7f596c0d1b10 2023-11-28T17:40:28.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f596a7fc640 1 -- 172.21.15.16:0/3543827800 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59540a8ad0 con 0x7f596c0d1b10 2023-11-28T17:40:28.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f596a7fc640 1 -- 172.21.15.16:0/3543827800 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59540a8e60 con 0x7f596c0d1b10 2023-11-28T17:40:28.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 -- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 msgr2=0x7f596c0b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 --2- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0b6290 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59540097c0 tx=0x7f595401ec70 comp rx=0 tx=0).stop 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 -- 172.21.15.16:0/3543827800 shutdown_connections 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 --2- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0b6290 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 --2- 172.21.15.16:0/3543827800 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0d15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 -- 172.21.15.16:0/3543827800 >> 172.21.15.16:0/3543827800 conn(0x7f596c0720d0 msgr2=0x7f596c0724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 -- 172.21.15.16:0/3543827800 shutdown_connections 2023-11-28T17:40:28.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.810+0000 7f5971757640 1 -- 172.21.15.16:0/3543827800 wait complete. 2023-11-28T17:40:28.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 Processor -- start 2023-11-28T17:40:28.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 -- start start 2023-11-28T17:40:28.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 0x7f596c1575e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c157b20 con 0x7f596c0b8b80 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0c7e50 con 0x7f596c0d1b10 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596c0c8130 con 0x7f596c0cfca0 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 0x7f596c1575e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 0x7f596c1575e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37648/0 (socket says 172.21.15.16:37648) 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 -- 172.21.15.16:0/2815473960 learned_addr learned my addr 172.21.15.16:0/2815473960 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5963fff640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596b7fe640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 -- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 msgr2=0x7f596c0cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 -- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 msgr2=0x7f596c0cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 -- 172.21.15.16:0/2815473960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954009420 con 0x7f596c0b8b80 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5963fff640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f596affd640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 0x7f596c1575e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e930 tx=0x7f595c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c009690 con 0x7f596c0b8b80 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595c00ca00 con 0x7f596c0b8b80 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596c0c8410 con 0x7f596c0b8b80 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595c00cd70 con 0x7f596c0b8b80 2023-11-28T17:40:28.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.814+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596c0c89d0 con 0x7f596c0b8b80 2023-11-28T17:40:28.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.818+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596c068860 con 0x7f596c0b8b80 2023-11-28T17:40:28.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.818+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f595c013470 con 0x7f596c0b8b80 2023-11-28T17:40:28.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.818+0000 7f59637fe640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f594c0668d0 0x7f594c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:28.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.818+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f595c0846a0 con 0x7f596c0b8b80 2023-11-28T17:40:28.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.818+0000 7f5963fff640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f594c0668d0 0x7f594c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:28.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.818+0000 7f5963fff640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f594c0668d0 0x7f594c068d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59540b2000 tx=0x7f5954008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:28.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:28.822+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f595c051990 con 0x7f596c0b8b80 2023-11-28T17:40:29.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.022+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f596c15cc50 con 0x7f596c0b8b80 2023-11-28T17:40:29.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.942+0000 7f59637fe640 1 -- 172.21.15.16:0/2815473960 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f595c054fb0 con 0x7f596c0b8b80 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f594c0668d0 msgr2=0x7f594c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f594c0668d0 0x7f594c068d90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f59540b2000 tx=0x7f5954008040 comp rx=0 tx=0).stop 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 msgr2=0x7f596c1575e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 0x7f596c1575e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f595c00e930 tx=0x7f595c00edf0 comp rx=0 tx=0).stop 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 shutdown_connections 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f594c0668d0 0x7f594c068d90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f596c0d1b10 0x7f596c0cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f596c0cfca0 0x7f596c0cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:29.951 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 --2- 172.21.15.16:0/2815473960 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f596c0b8b80 0x7f596c1575e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:29.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 >> 172.21.15.16:0/2815473960 conn(0x7f596c0720d0 msgr2=0x7f596c15de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:29.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 shutdown_connections 2023-11-28T17:40:29.952 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:29.946+0000 7f5971757640 1 -- 172.21.15.16:0/2815473960 wait complete. 2023-11-28T17:40:29.974 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T17:40:29.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T17:40:30.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 Processor -- start 2023-11-28T17:40:30.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 -- start start 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60f40cef30 0x7f60f40cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f4070dd0 0x7f60f4071260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60f40ce4f0 con 0x7f60f4144c80 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60f40709b0 con 0x7f60f40cef30 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.122+0000 7f60f9796640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f4145060 con 0x7f60f4070dd0 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60f40cef30 0x7f60f40cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f60f40cef30 0x7f60f40cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37662/0 (socket says 172.21.15.16:37662) 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 -- 172.21.15.16:0/2065007263 learned_addr learned my addr 172.21.15.16:0/2065007263 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:30.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60f37fe640 1 --2- 172.21.15.16:0/2065007263 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f4070dd0 0x7f60f4071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:30.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 -- 172.21.15.16:0/2065007263 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f4070dd0 msgr2=0x7f60f4071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:30.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 --2- 172.21.15.16:0/2065007263 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f4070dd0 0x7f60f4071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 -- 172.21.15.16:0/2065007263 >> v1:172.21.15.64:6789/0 conn(0x7f60f4144c80 legacy=0x7f60f40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:30.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 -- 172.21.15.16:0/2065007263 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f40ce7d0 con 0x7f60f40cef30 2023-11-28T17:40:30.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60ebfff640 1 --2- 172.21.15.16:0/2065007263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f40cef30 0x7f60f40cf3b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009870 tx=0x7f60dc01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33dd12771e9778f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:30.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60f27fc640 1 -- 172.21.15.16:0/2065007263 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab600 con 0x7f60f40cef30 2023-11-28T17:40:30.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60f27fc640 1 -- 172.21.15.16:0/2065007263 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0a7050 con 0x7f60f40cef30 2023-11-28T17:40:30.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.126+0000 7f60f27fc640 1 -- 172.21.15.16:0/2065007263 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60dc0ab980 con 0x7f60f40cef30 2023-11-28T17:40:30.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- 172.21.15.16:0/2065007263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f40cef30 msgr2=0x7f60f40cf3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:30.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 --2- 172.21.15.16:0/2065007263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f40cef30 0x7f60f40cf3b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f60dc009870 tx=0x7f60dc01c360 comp rx=0 tx=0).stop 2023-11-28T17:40:30.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- 172.21.15.16:0/2065007263 shutdown_connections 2023-11-28T17:40:30.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 --2- 172.21.15.16:0/2065007263 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f4070dd0 0x7f60f4071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 --2- 172.21.15.16:0/2065007263 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f40cef30 0x7f60f40cf3b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- 172.21.15.16:0/2065007263 >> 172.21.15.16:0/2065007263 conn(0x7f60f406a5a0 msgr2=0x7f60f406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:30.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- 172.21.15.16:0/2065007263 shutdown_connections 2023-11-28T17:40:30.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- 172.21.15.16:0/2065007263 wait complete. 2023-11-28T17:40:30.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 Processor -- start 2023-11-28T17:40:30.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- start start 2023-11-28T17:40:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 0x7f60f40ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f40cef30 0x7f60f40b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60f4144c80 0x7f60f4138260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:30.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40aff10 con 0x7f60f4070dd0 2023-11-28T17:40:30.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40af290 con 0x7f60f4144c80 2023-11-28T17:40:30.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f9796640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60f40af570 con 0x7f60f40cef30 2023-11-28T17:40:30.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 0x7f60f40ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:30.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 0x7f60f40ae990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37664/0 (socket says 172.21.15.16:37664) 2023-11-28T17:40:30.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 -- 172.21.15.16:0/1633304736 learned_addr learned my addr 172.21.15.16:0/1633304736 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f40cef30 0x7f60f40b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f37fe640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60f4144c80 0x7f60f4138260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 -- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f40cef30 msgr2=0x7f60f40b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f40cef30 0x7f60f40b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 -- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60f4144c80 msgr2=0x7f60f4138260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:30.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60f4144c80 0x7f60f4138260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.130+0000 7f60f2ffd640 1 -- 172.21.15.16:0/1633304736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60dc0094d0 con 0x7f60f4070dd0 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60f2ffd640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 0x7f60f40ae990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c500 tx=0x7f60e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4005220 con 0x7f60f4070dd0 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e4005380 con 0x7f60f4070dd0 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60f40af850 con 0x7f60f4070dd0 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e4007270 con 0x7f60f4070dd0 2023-11-28T17:40:30.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60f40b0310 con 0x7f60f4070dd0 2023-11-28T17:40:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60f4068860 con 0x7f60f4070dd0 2023-11-28T17:40:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f60e40073d0 con 0x7f60f4070dd0 2023-11-28T17:40:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60eb7fe640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60d40668d0 0x7f60d4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60e4083dc0 con 0x7f60f4070dd0 2023-11-28T17:40:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.134+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60d40668d0 0x7f60d4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:30.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.138+0000 7f60ebfff640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60d40668d0 0x7f60d4068d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0ad000 tx=0x7f60dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:30.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.138+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f60e4050f70 con 0x7f60f4070dd0 2023-11-28T17:40:30.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.330+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f60f40ad7b0 con 0x7f60f4070dd0 2023-11-28T17:40:30.957 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60eb7fe640 1 -- 172.21.15.16:0/1633304736 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f60e4054590 con 0x7f60f4070dd0 2023-11-28T17:40:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60d40668d0 msgr2=0x7f60d4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60d40668d0 0x7f60d4068d90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f60dc0ad000 tx=0x7f60dc008040 comp rx=0 tx=0).stop 2023-11-28T17:40:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 msgr2=0x7f60f40ae990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:30.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 0x7f60f40ae990 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60e400c500 tx=0x7f60e400c9c0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 shutdown_connections 2023-11-28T17:40:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f60d40668d0 0x7f60d4068d90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60f4144c80 0x7f60f4138260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f60f40cef30 0x7f60f40b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 --2- 172.21.15.16:0/1633304736 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f60f4070dd0 0x7f60f40ae990 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:30.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 >> 172.21.15.16:0/1633304736 conn(0x7f60f406a5a0 msgr2=0x7f60f415ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:30.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 shutdown_connections 2023-11-28T17:40:30.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:30.954+0000 7f60f9796640 1 -- 172.21.15.16:0/1633304736 wait complete. 2023-11-28T17:40:30.982 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T17:40:30.983 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:40:31.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 Processor -- start 2023-11-28T17:40:31.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 -- start start 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f692415d540 0x7f69240b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f69240d3690 0x7f69240cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240b32c0 con 0x7f69240d1f50 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692415d920 con 0x7f692415d540 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692c05a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69240b35a0 con 0x7f69240d3690 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f6929df6640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f692415d540 0x7f69240b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f69295f5640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f69240d1f50 0x7f69240d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49778/0 (socket says 172.21.15.16:49778) 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f69295f5640 1 -- 172.21.15.16:0/2481214557 learned_addr learned my addr 172.21.15.16:0/2481214557 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:31.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692a5f7640 1 --2- 172.21.15.16:0/2481214557 >> v2:172.21.15.64:3300/0 conn(0x7f69240d3690 0x7f69240cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f6929df6640 1 -- 172.21.15.16:0/2481214557 >> v2:172.21.15.64:3300/0 conn(0x7f69240d3690 msgr2=0x7f69240cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f6929df6640 1 --2- 172.21.15.16:0/2481214557 >> v2:172.21.15.64:3300/0 conn(0x7f69240d3690 0x7f69240cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f6929df6640 1 -- 172.21.15.16:0/2481214557 >> v1:172.21.15.16:6789/0 conn(0x7f69240d1f50 legacy=0x7f69240d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f6928df4640 1 -- 172.21.15.16:0/2481214557 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422588648 0 0) 0x7f69240b32c0 con 0x7f69240d1f50 2023-11-28T17:40:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f6929df6640 1 -- 172.21.15.16:0/2481214557 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240b3880 con 0x7f692415d540 2023-11-28T17:40:31.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.126+0000 7f692a5f7640 1 --2- 172.21.15.16:0/2481214557 >> v2:172.21.15.64:3300/0 conn(0x7f69240d3690 0x7f69240cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:31.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f6929df6640 1 --2- 172.21.15.16:0/2481214557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f692415d540 0x7f69240b29c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6924160ee0 tx=0x7f692001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddbed104be2aa9c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f6928df4640 1 -- 172.21.15.16:0/2481214557 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200ac600 con 0x7f692415d540 2023-11-28T17:40:31.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f6928df4640 1 -- 172.21.15.16:0/2481214557 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200a8050 con 0x7f692415d540 2023-11-28T17:40:31.134 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f6928df4640 1 -- 172.21.15.16:0/2481214557 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200ac980 con 0x7f692415d540 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 -- 172.21.15.16:0/2481214557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f692415d540 msgr2=0x7f69240b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 --2- 172.21.15.16:0/2481214557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f692415d540 0x7f69240b29c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6924160ee0 tx=0x7f692001c3a0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 -- 172.21.15.16:0/2481214557 shutdown_connections 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 --2- 172.21.15.16:0/2481214557 >> v2:172.21.15.64:3300/0 conn(0x7f69240d3690 0x7f69240cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 --2- 172.21.15.16:0/2481214557 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f692415d540 0x7f69240b29c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 -- 172.21.15.16:0/2481214557 >> 172.21.15.16:0/2481214557 conn(0x7f692408ccf0 msgr2=0x7f692409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 -- 172.21.15.16:0/2481214557 shutdown_connections 2023-11-28T17:40:31.135 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 -- 172.21.15.16:0/2481214557 wait complete. 2023-11-28T17:40:31.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.130+0000 7f692c05a640 1 Processor -- start 2023-11-28T17:40:31.136 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- start start 2023-11-28T17:40:31.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 0x7f69240c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.137 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69240d3690 0x7f69241545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f692415d540 0x7f69240b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6924154ee0 con 0x7f69240d1f50 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241551c0 con 0x7f69240d3690 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69241554a0 con 0x7f692415d540 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 0x7f69240c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 0x7f69240c8eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37678/0 (socket says 172.21.15.16:37678) 2023-11-28T17:40:31.138 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 -- 172.21.15.16:0/1047444570 learned_addr learned my addr 172.21.15.16:0/1047444570 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 -- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f692415d540 msgr2=0x7f69240b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f692415d540 0x7f69240b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 -- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69240d3690 msgr2=0x7f69241545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f69295f5640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69240d3690 0x7f69241545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69240d3690 0x7f69241545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 -- 172.21.15.16:0/1047444570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920009420 con 0x7f69240d1f50 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f69295f5640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69240d3690 0x7f69241545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f6929df6640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 0x7f69240c8eb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6920018fb0 tx=0x7f692001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200b7650 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200b77b0 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6924155780 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200b7b20 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69240c93f0 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.134+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924068860 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.138+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f69200b3070 con 0x7f69240d1f50 2023-11-28T17:40:31.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.138+0000 7f691a7fc640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f69080668d0 0x7f6908068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.138+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f692011e600 con 0x7f69240d1f50 2023-11-28T17:40:31.142 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.138+0000 7f69295f5640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f69080668d0 0x7f6908068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.138+0000 7f69295f5640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f69080668d0 0x7f6908068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6914000f70 tx=0x7f6914009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.142+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69200eb7a0 con 0x7f69240d1f50 2023-11-28T17:40:31.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.330+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69240667b0 con 0x7f69240d1f50 2023-11-28T17:40:31.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f691a7fc640 1 -- 172.21.15.16:0/1047444570 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f69200eedc0 con 0x7f69240d1f50 2023-11-28T17:40:31.337 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:31.337 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:40:27.311390+0000","modified":"2023-11-28T17:40:30.336858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6836/2775576031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2775576031},{"type":"v1","addr":"172.21.15.64:6836","nonce":2775576031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T17:40:31.338 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f69080668d0 msgr2=0x7f6908068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f69080668d0 0x7f6908068d90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6914000f70 tx=0x7f6914009040 comp rx=0 tx=0).stop 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 msgr2=0x7f69240c8eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 0x7f69240c8eb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6920018fb0 tx=0x7f692001abe0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 shutdown_connections 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f692415d540 0x7f69240b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f69080668d0 0x7f6908068d90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69240d3690 0x7f69241545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 --2- 172.21.15.16:0/1047444570 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f69240d1f50 0x7f69240c8eb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 >> 172.21.15.16:0/1047444570 conn(0x7f692408ccf0 msgr2=0x7f692406c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:31.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 shutdown_connections 2023-11-28T17:40:31.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.334+0000 7f692c05a640 1 -- 172.21.15.16:0/1047444570 wait complete. 2023-11-28T17:40:31.358 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T17:40:31.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e3832640 1 Processor -- start 2023-11-28T17:40:31.501 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e3832640 1 -- start start 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e3832640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52dc0b3b40 0x7f52dc0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e3832640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc071dc0 con 0x7f52dc06b140 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e3832640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52dc0720a0 con 0x7f52dc146ec0 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e3832640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52dc06ecd0 con 0x7f52dc0b3b40 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e1dcf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f52dc0b3b40 0x7f52dc0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e0dcd640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f52dc06b140 0x7f52dc0b3430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49786/0 (socket says 172.21.15.16:49786) 2023-11-28T17:40:31.503 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e0dcd640 1 -- 172.21.15.16:0/2441302687 learned_addr learned my addr 172.21.15.16:0/2441302687 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2441302687 >> v1:172.21.15.64:6789/0 conn(0x7f52dc146ec0 legacy=0x7f52dc071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2441302687 >> v1:172.21.15.16:6789/0 conn(0x7f52dc06b140 legacy=0x7f52dc0b3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2441302687 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52dc072380 con 0x7f52dc0b3b40 2023-11-28T17:40:31.504 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.498+0000 7f52d3fff640 1 -- 172.21.15.16:0/2441302687 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2193178363 0 0) 0x7f52dc071dc0 con 0x7f52dc06b140 2023-11-28T17:40:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e1dcf640 1 --2- 172.21.15.16:0/2441302687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc0b3b40 0x7f52dc0ccae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009d90 tx=0x7f52d401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825f555df8401872 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.506 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52d3fff640 1 -- 172.21.15.16:0/2441302687 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40a5920 con 0x7f52dc0b3b40 2023-11-28T17:40:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52d3fff640 1 -- 172.21.15.16:0/2441302687 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d40a5a80 con 0x7f52dc0b3b40 2023-11-28T17:40:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52d3fff640 1 -- 172.21.15.16:0/2441302687 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40a5e10 con 0x7f52dc0b3b40 2023-11-28T17:40:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 -- 172.21.15.16:0/2441302687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc0b3b40 msgr2=0x7f52dc0ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.507 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 --2- 172.21.15.16:0/2441302687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc0b3b40 0x7f52dc0ccae0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f52d4009d90 tx=0x7f52d401c950 comp rx=0 tx=0).stop 2023-11-28T17:40:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 -- 172.21.15.16:0/2441302687 shutdown_connections 2023-11-28T17:40:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 --2- 172.21.15.16:0/2441302687 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc0b3b40 0x7f52dc0ccae0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 -- 172.21.15.16:0/2441302687 >> 172.21.15.16:0/2441302687 conn(0x7f52dc0d00b0 msgr2=0x7f52dc0d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 -- 172.21.15.16:0/2441302687 shutdown_connections 2023-11-28T17:40:31.508 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.502+0000 7f52e3832640 1 -- 172.21.15.16:0/2441302687 wait complete. 2023-11-28T17:40:31.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 Processor -- start 2023-11-28T17:40:31.509 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 -- start start 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52dc06b140 0x7f52dc137c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52dc0b3b40 0x7f52dc15a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 0x7f52dc15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1333c0 con 0x7f52dc146ec0 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc133f00 con 0x7f52dc0b3b40 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52dc1335d0 con 0x7f52dc06b140 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 0x7f52dc15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 0x7f52dc15a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37704/0 (socket says 172.21.15.16:37704) 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2403934842 learned_addr learned my addr 172.21.15.16:0/2403934842 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e0dcd640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52dc0b3b40 0x7f52dc15a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e15ce640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52dc06b140 0x7f52dc137c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52dc06b140 msgr2=0x7f52dc137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52dc06b140 0x7f52dc137c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52dc0b3b40 msgr2=0x7f52dc15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52dc0b3b40 0x7f52dc15a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 -- 172.21.15.16:0/2403934842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d4009a70 con 0x7f52dc146ec0 2023-11-28T17:40:31.512 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e1dcf640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 0x7f52dc15a700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f52d40b0040 tx=0x7f52d40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b7610 con 0x7f52dc146ec0 2023-11-28T17:40:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d40b7770 con 0x7f52dc146ec0 2023-11-28T17:40:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52dc1338b0 con 0x7f52dc146ec0 2023-11-28T17:40:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52d40b7b40 con 0x7f52dc146ec0 2023-11-28T17:40:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.506+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52dc1381a0 con 0x7f52dc146ec0 2023-11-28T17:40:31.513 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.510+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52dc134070 con 0x7f52dc146ec0 2023-11-28T17:40:31.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.510+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f52d40b4050 con 0x7f52dc146ec0 2023-11-28T17:40:31.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.510+0000 7f52d1ffb640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52c00668d0 0x7f52c0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.510+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52d411fb80 con 0x7f52dc146ec0 2023-11-28T17:40:31.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.510+0000 7f52e15ce640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52c00668d0 0x7f52c0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.515 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.510+0000 7f52e15ce640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52c00668d0 0x7f52c0068d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f52dc160b10 tx=0x7f52d8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.519 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.514+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f52d40ecf20 con 0x7f52dc146ec0 2023-11-28T17:40:31.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.670+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52dc068860 con 0x7f52dc146ec0 2023-11-28T17:40:31.677 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52d1ffb640 1 -- 172.21.15.16:0/2403934842 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16461 (secure 0 0 0) 0x7f52d40c7090 con 0x7f52dc146ec0 2023-11-28T17:40:31.677 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:31.678 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":35,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:40:28.925954+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T17:40:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52c00668d0 msgr2=0x7f52c0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52c00668d0 0x7f52c0068d90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f52dc160b10 tx=0x7f52d8009040 comp rx=0 tx=0).stop 2023-11-28T17:40:31.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 msgr2=0x7f52dc15a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 0x7f52dc15a700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f52d40b0040 tx=0x7f52d40196f0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 shutdown_connections 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f52dc146ec0 0x7f52dc15a700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f52c00668d0 0x7f52c0068d90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52dc0b3b40 0x7f52dc15a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 --2- 172.21.15.16:0/2403934842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f52dc06b140 0x7f52dc137c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 >> 172.21.15.16:0/2403934842 conn(0x7f52dc0d00b0 msgr2=0x7f52dc0cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 shutdown_connections 2023-11-28T17:40:31.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.674+0000 7f52e3832640 1 -- 172.21.15.16:0/2403934842 wait complete. 2023-11-28T17:40:31.699 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T17:40:31.699 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:40:31.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 Processor -- start 2023-11-28T17:40:31.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 -- start start 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0980146ec0 0x7f098006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f09800b3430 0x7f09800b3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800b3dc0 con 0x7f09800ccae0 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098006ecd0 con 0x7f09800b3430 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0988232640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0980072660 con 0x7f0980146ec0 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f09800b3430 0x7f09800b3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f09800b3430 0x7f09800b3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37708/0 (socket says 172.21.15.16:37708) 2023-11-28T17:40:31.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 -- 172.21.15.16:0/3318155809 learned_addr learned my addr 172.21.15.16:0/3318155809 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:31.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f0985fce640 1 --2- 172.21.15.16:0/3318155809 >> v2:172.21.15.64:3300/0 conn(0x7f0980146ec0 0x7f098006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 -- 172.21.15.16:0/3318155809 >> v2:172.21.15.64:3300/0 conn(0x7f0980146ec0 msgr2=0x7f098006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:31.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 --2- 172.21.15.16:0/3318155809 >> v2:172.21.15.64:3300/0 conn(0x7f0980146ec0 0x7f098006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 -- 172.21.15.16:0/3318155809 >> v1:172.21.15.64:6789/0 conn(0x7f09800ccae0 legacy=0x7f0980071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.844 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.838+0000 7f09867cf640 1 -- 172.21.15.16:0/3318155809 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0980071dc0 con 0x7f09800b3430 2023-11-28T17:40:31.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f09867cf640 1 --2- 172.21.15.16:0/3318155809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09800b3430 0x7f09800b3880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0980074420 tx=0x7f097801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9c26ffa31c1a3a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.846 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0984fcc640 1 -- 172.21.15.16:0/3318155809 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780a5690 con 0x7f09800b3430 2023-11-28T17:40:31.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0984fcc640 1 -- 172.21.15.16:0/3318155809 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780a57f0 con 0x7f09800b3430 2023-11-28T17:40:31.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0984fcc640 1 -- 172.21.15.16:0/3318155809 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780a5b80 con 0x7f09800b3430 2023-11-28T17:40:31.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 -- 172.21.15.16:0/3318155809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09800b3430 msgr2=0x7f09800b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 --2- 172.21.15.16:0/3318155809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09800b3430 0x7f09800b3880 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0980074420 tx=0x7f097801c9d0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 -- 172.21.15.16:0/3318155809 shutdown_connections 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 --2- 172.21.15.16:0/3318155809 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f09800b3430 0x7f09800b3880 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 --2- 172.21.15.16:0/3318155809 >> v2:172.21.15.64:3300/0 conn(0x7f0980146ec0 0x7f098006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 -- 172.21.15.16:0/3318155809 >> 172.21.15.16:0/3318155809 conn(0x7f09800d00b0 msgr2=0x7f09800d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 -- 172.21.15.16:0/3318155809 shutdown_connections 2023-11-28T17:40:31.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.842+0000 7f0988232640 1 -- 172.21.15.16:0/3318155809 wait complete. 2023-11-28T17:40:31.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 Processor -- start 2023-11-28T17:40:31.849 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- start start 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09800b3430 0x7f098015c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ccae0 0x7f09800aec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 0x7f098006db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800af6c0 con 0x7f0980146ec0 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800af9a0 con 0x7f09800ccae0 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800afc80 con 0x7f09800b3430 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 0x7f098006db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 0x7f098006db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37720/0 (socket says 172.21.15.16:37720) 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 -- 172.21.15.16:0/4050047159 learned_addr learned my addr 172.21.15.16:0/4050047159 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:31.851 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09857cd640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ccae0 0x7f09800aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0985fce640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09800b3430 0x7f098015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 -- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09800b3430 msgr2=0x7f098015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09800b3430 0x7f098015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 -- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ccae0 msgr2=0x7f09800aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ccae0 0x7f09800aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 -- 172.21.15.16:0/4050047159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0978009b30 con 0x7f0980146ec0 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09857cd640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ccae0 0x7f09800aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:31.852 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09867cf640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 0x7f098006db00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09780195e0 tx=0x7f0978019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780b8670 con 0x7f0980146ec0 2023-11-28T17:40:31.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780b87f0 con 0x7f0980146ec0 2023-11-28T17:40:31.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09800aff60 con 0x7f0980146ec0 2023-11-28T17:40:31.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780b8ba0 con 0x7f0980146ec0 2023-11-28T17:40:31.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09800b0760 con 0x7f0980146ec0 2023-11-28T17:40:31.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.846+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0980068860 con 0x7f0980146ec0 2023-11-28T17:40:31.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.850+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f09780b8d00 con 0x7f0980146ec0 2023-11-28T17:40:31.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.850+0000 7f09767fc640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0964066900 0x7f0964068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:31.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.850+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f097811f400 con 0x7f0980146ec0 2023-11-28T17:40:31.855 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.850+0000 7f0985fce640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0964066900 0x7f0964068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:31.856 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.850+0000 7f0985fce640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0964066900 0x7f0964068dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f097c009ac0 tx=0x7f097c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:31.859 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:31.854+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f09780ec800 con 0x7f0980146ec0 2023-11-28T17:40:31.894 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T17:40:31.891+0000 7ff9566ab640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T17:40:32.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.010+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09800b0410 con 0x7f0964066900 2023-11-28T17:40:32.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.022+0000 7f09767fc640 1 -- 172.21.15.16:0/4050047159 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276543 (secure 0 0 0) 0x7f09800b0410 con 0x7f0964066900 2023-11-28T17:40:32.034 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:32.036 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:40:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0964066900 msgr2=0x7f0964068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0964066900 0x7f0964068dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f097c009ac0 tx=0x7f097c009190 comp rx=0 tx=0).stop 2023-11-28T17:40:32.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 msgr2=0x7f098006db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 0x7f098006db00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f09780195e0 tx=0x7f0978019770 comp rx=0 tx=0).stop 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 shutdown_connections 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0980146ec0 0x7f098006db00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f0964066900 0x7f0964068dc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09800ccae0 0x7f09800aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 --2- 172.21.15.16:0/4050047159 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f09800b3430 0x7f098015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 >> 172.21.15.16:0/4050047159 conn(0x7f09800d00b0 msgr2=0x7f09800cd060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:32.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 shutdown_connections 2023-11-28T17:40:32.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.026+0000 7f0988232640 1 -- 172.21.15.16:0/4050047159 wait complete. 2023-11-28T17:40:32.049 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-11-28T17:40:30.777765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":232544,"kb_used_data":3876,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742176,"statfs":{"total":773094113280,"available":772855988224,"internally_reserved":0,"allocated":3969024,"data_stored":2220005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.874388"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911089+0000","last_change":"2023-11-28T17:40:25.911089+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911089+0000","last_undegraded":"2023-11-28T17:40:25.911089+0000","last_fullsized":"2023-11-28T17:40:25.911089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906782+0000","last_change":"2023-11-28T17:40:25.906782+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906782+0000","last_undegraded":"2023-11-28T17:40:25.906782+0000","last_fullsized":"2023-11-28T17:40:25.906782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906812+0000","last_change":"2023-11-28T17:40:25.906812+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906812+0000","last_undegraded":"2023-11-28T17:40:25.906812+0000","last_fullsized":"2023-11-28T17:40:25.906812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174720+0000","last_change":"2023-11-28T17:40:26.174720+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174720+0000","last_undegraded":"2023-11-28T17:40:26.174720+0000","last_fullsized":"2023-11-28T17:40:26.174720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174824+0000","last_change":"2023-11-28T17:40:26.174824+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174824+0000","last_undegraded":"2023-11-28T17:40:26.174824+0000","last_fullsized":"2023-11-28T17:40:26.174824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174120+0000","last_change":"2023-11-28T17:40:26.174120+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174120+0000","last_undegraded":"2023-11-28T17:40:26.174120+0000","last_fullsized":"2023-11-28T17:40:26.174120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907178+0000","last_change":"2023-11-28T17:40:25.907178+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907178+0000","last_undegraded":"2023-11-28T17:40:25.907178+0000","last_fullsized":"2023-11-28T17:40:25.907178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907646+0000","last_change":"2023-11-28T17:40:25.907646+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907646+0000","last_undegraded":"2023-11-28T17:40:25.907646+0000","last_fullsized":"2023-11-28T17:40:25.907646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911121+0000","last_change":"2023-11-28T17:40:25.911121+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911121+0000","last_undegraded":"2023-11-28T17:40:25.911121+0000","last_fullsized":"2023-11-28T17:40:25.911121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.913794+0000","last_change":"2023-11-28T17:40:25.913794+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.913794+0000","last_undegraded":"2023-11-28T17:40:25.913794+0000","last_fullsized":"2023-11-28T17:40:25.913794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174126+0000","last_change":"2023-11-28T17:40:26.174126+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174126+0000","last_undegraded":"2023-11-28T17:40:26.174126+0000","last_fullsized":"2023-11-28T17:40:26.174126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906782+0000","last_change":"2023-11-28T17:40:25.906782+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906782+0000","last_undegraded":"2023-11-28T17:40:25.906782+0000","last_fullsized":"2023-11-28T17:40:25.906782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906787+0000","last_change":"2023-11-28T17:40:25.906787+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906787+0000","last_undegraded":"2023-11-28T17:40:25.906787+0000","last_fullsized":"2023-11-28T17:40:25.906787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174198+0000","last_change":"2023-11-28T17:40:26.174198+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174198+0000","last_undegraded":"2023-11-28T17:40:26.174198+0000","last_fullsized":"2023-11-28T17:40:26.174198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912064+0000","last_change":"2023-11-28T17:40:25.912064+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912064+0000","last_undegraded":"2023-11-28T17:40:25.912064+0000","last_fullsized":"2023-11-28T17:40:25.912064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907612+0000","last_change":"2023-11-28T17:40:25.907612+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907612+0000","last_undegraded":"2023-11-28T17:40:25.907612+0000","last_fullsized":"2023-11-28T17:40:25.907612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906945+0000","last_change":"2023-11-28T17:40:25.906945+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906945+0000","last_undegraded":"2023-11-28T17:40:25.906945+0000","last_fullsized":"2023-11-28T17:40:25.906945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174118+0000","last_change":"2023-11-28T17:40:26.174118+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174118+0000","last_undegraded":"2023-11-28T17:40:26.174118+0000","last_fullsized":"2023-11-28T17:40:26.174118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.910576+0000","last_change":"2023-11-28T17:40:25.910576+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.910576+0000","last_undegraded":"2023-11-28T17:40:25.910576+0000","last_fullsized":"2023-11-28T17:40:25.910576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911076+0000","last_change":"2023-11-28T17:40:25.911076+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911076+0000","last_undegraded":"2023-11-28T17:40:25.911076+0000","last_fullsized":"2023-11-28T17:40:25.911076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.913600+0000","last_change":"2023-11-28T17:40:25.913600+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.913600+0000","last_undegraded":"2023-11-28T17:40:25.913600+0000","last_fullsized":"2023-11-28T17:40:25.913600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907027+0000","last_change":"2023-11-28T17:40:25.907027+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907027+0000","last_undegraded":"2023-11-28T17:40:25.907027+0000","last_fullsized":"2023-11-28T17:40:25.907027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912985+0000","last_change":"2023-11-28T17:40:25.912985+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912985+0000","last_undegraded":"2023-11-28T17:40:25.912985+0000","last_fullsized":"2023-11-28T17:40:25.912985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912832+0000","last_change":"2023-11-28T17:40:25.912832+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912832+0000","last_undegraded":"2023-11-28T17:40:25.912832+0000","last_fullsized":"2023-11-28T17:40:25.912832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912801+0000","last_change":"2023-11-28T17:40:25.912801+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912801+0000","last_undegraded":"2023-11-28T17:40:25.912801+0000","last_fullsized":"2023-11-28T17:40:25.912801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174117+0000","last_change":"2023-11-28T17:40:26.174117+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174117+0000","last_undegraded":"2023-11-28T17:40:26.174117+0000","last_fullsized":"2023-11-28T17:40:26.174117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907042+0000","last_change":"2023-11-28T17:40:25.907042+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907042+0000","last_undegraded":"2023-11-28T17:40:25.907042+0000","last_fullsized":"2023-11-28T17:40:25.907042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911673+0000","last_change":"2023-11-28T17:40:25.911673+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911673+0000","last_undegraded":"2023-11-28T17:40:25.911673+0000","last_fullsized":"2023-11-28T17:40:25.911673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T17:40:21.079022+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:40:21.079022+0000","last_peered":"2023-11-28T17:40:21.079022+0000","last_clean":"2023-11-28T17:40:21.079022+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:40:21.079022+0000","last_undegraded":"2023-11-28T17:40:21.079022+0000","last_fullsized":"2023-11-28T17:40:21.079022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.492,"5min":7.492,"15min":7.492},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":0.754},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.86499999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.81299999999999994}]},{"osd":5,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.89100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":722458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71399999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.77800000000000002}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":5.6840000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.622}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.871},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.752}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":0.496},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.6779999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":5.3780000000000001,"5min":5.3780000000000001,"15min":5.3780000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.7640000000000002,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.628}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":8.3149999999999995,"5min":8.3149999999999995,"15min":8.3149999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.66100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":126273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.433},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54400000000000004}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.78300000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.72299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":716641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.36299999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46600000000000003}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.51800000000000002}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.67400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.438}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.72099999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72499999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.69299999999999995}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.877}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.752},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81499999999999995}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:40:32.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:40:32.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.230+0000 7fb9b2b8d640 1 Processor -- start 2023-11-28T17:40:32.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.230+0000 7fb9b2b8d640 1 -- start start 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.230+0000 7fb9b2b8d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0aed60 0x7fb9ac144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b2b8d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9ac0b2b70 0x7fb9ac0b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b2b8d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb9ac160fa0 0x7fb9ac161430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b2b8d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac06a5a0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b2b8d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac06ae00 con 0x7fb9ac160fa0 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b2b8d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0b34f0 con 0x7fb9ac0aed60 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9ac0b2b70 0x7fb9ac0b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fb9ac0b2b70 0x7fb9ac0b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37722/0 (socket says 172.21.15.16:37722) 2023-11-28T17:40:32.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 -- 172.21.15.16:0/867889599 learned_addr learned my addr 172.21.15.16:0/867889599 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b112a640 1 --2- 172.21.15.16:0/867889599 >> v2:172.21.15.64:3300/0 conn(0x7fb9ac160fa0 0x7fb9ac161430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9b0929640 1 --2- 172.21.15.16:0/867889599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0aed60 0x7fb9ac144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 -- 172.21.15.16:0/867889599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0aed60 msgr2=0x7fb9ac144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 --2- 172.21.15.16:0/867889599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0aed60 0x7fb9ac144f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 -- 172.21.15.16:0/867889599 >> v2:172.21.15.64:3300/0 conn(0x7fb9ac160fa0 msgr2=0x7fb9ac161430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:32.238 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 --2- 172.21.15.16:0/867889599 >> v2:172.21.15.64:3300/0 conn(0x7fb9ac160fa0 0x7fb9ac161430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 -- 172.21.15.16:0/867889599 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac161cd0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9abfff640 1 --2- 172.21.15.16:0/867889599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac0b2b70 0x7fb9ac0b2fb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac15b4f0 tx=0x7fb99801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1118b982983e4c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9ab7fe640 1 -- 172.21.15.16:0/867889599 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980ab600 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9ab7fe640 1 -- 172.21.15.16:0/867889599 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980a7050 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.234+0000 7fb9ab7fe640 1 -- 172.21.15.16:0/867889599 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980ab980 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/867889599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac0b2b70 msgr2=0x7fb9ac0b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/867889599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac0b2b70 0x7fb9ac0b2fb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac15b4f0 tx=0x7fb99801c470 comp rx=0 tx=0).stop 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/867889599 shutdown_connections 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/867889599 >> v2:172.21.15.64:3300/0 conn(0x7fb9ac160fa0 0x7fb9ac161430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/867889599 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac0b2b70 0x7fb9ac0b2fb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/867889599 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0aed60 0x7fb9ac144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/867889599 >> 172.21.15.16:0/867889599 conn(0x7fb9ac0b1de0 msgr2=0x7fb9ac0cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/867889599 shutdown_connections 2023-11-28T17:40:32.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/867889599 wait complete. 2023-11-28T17:40:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 Processor -- start 2023-11-28T17:40:32.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- start start 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac0aed60 0x7fb9ac15adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0b2b70 0x7fb9ac1426b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac160fa0 0x7fb9ac15fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0ccc30 con 0x7fb9ac160fa0 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac15b300 con 0x7fb9ac0aed60 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b2b8d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac0cced0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b112a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac160fa0 0x7fb9ac15fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b0929640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac0aed60 0x7fb9ac15adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9abfff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0b2b70 0x7fb9ac1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b0929640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac0aed60 0x7fb9ac15adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:40626/0 (socket says 172.21.15.16:40626) 2023-11-28T17:40:32.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.238+0000 7fb9b0929640 1 -- 172.21.15.16:0/1177854539 learned_addr learned my addr 172.21.15.16:0/1177854539 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9abfff640 1 -- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac0aed60 msgr2=0x7fb9ac15adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9abfff640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac0aed60 0x7fb9ac15adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9abfff640 1 -- 172.21.15.16:0/1177854539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac160fa0 msgr2=0x7fb9ac15fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9abfff640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac160fa0 0x7fb9ac15fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9abfff640 1 -- 172.21.15.16:0/1177854539 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9980094d0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9b112a640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac160fa0 0x7fb9ac15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9abfff640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0b2b70 0x7fb9ac1426b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9980ab000 tx=0x7fb998019210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980b4640 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980b47c0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9980b4b70 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac0cd1b0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.247 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac143e70 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac0cd3a0 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb9980b2070 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.242+0000 7fb9a97fa640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9900668d0 0x7fb990068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.246+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb99811e620 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.246+0000 7fb9b0929640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9900668d0 0x7fb990068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.246+0000 7fb9b0929640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9900668d0 0x7fb990068d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0007b10 tx=0x7fb9a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:32.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.246+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9980eb980 con 0x7fb9ac0b2b70 2023-11-28T17:40:32.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.402+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb9ac06ba80 con 0x7fb9900668d0 2023-11-28T17:40:32.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.410+0000 7fb9a97fa640 1 -- 172.21.15.16:0/1177854539 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276543 (secure 0 0 0) 0x7fb9a00109c0 con 0x7fb9900668d0 2023-11-28T17:40:32.416 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:32.418 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9900668d0 msgr2=0x7fb990068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9900668d0 0x7fb990068d90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb9a0007b10 tx=0x7fb9a0008040 comp rx=0 tx=0).stop 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0b2b70 msgr2=0x7fb9ac1426b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0b2b70 0x7fb9ac1426b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb9980ab000 tx=0x7fb998019210 comp rx=0 tx=0).stop 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 shutdown_connections 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb9ac160fa0 0x7fb9ac15fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb9ac0b2b70 0x7fb9ac1426b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb9900668d0 0x7fb990068d90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 --2- 172.21.15.16:0/1177854539 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9ac0aed60 0x7fb9ac15adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 >> 172.21.15.16:0/1177854539 conn(0x7fb9ac0b1de0 msgr2=0x7fb9ac06cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 shutdown_connections 2023-11-28T17:40:32.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.414+0000 7fb9b2b8d640 1 -- 172.21.15.16:0/1177854539 wait complete. 2023-11-28T17:40:32.438 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-11-28T17:40:30.777765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":232544,"kb_used_data":3876,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742176,"statfs":{"total":773094113280,"available":772855988224,"internally_reserved":0,"allocated":3969024,"data_stored":2220005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.874388"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911089+0000","last_change":"2023-11-28T17:40:25.911089+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911089+0000","last_undegraded":"2023-11-28T17:40:25.911089+0000","last_fullsized":"2023-11-28T17:40:25.911089+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906782+0000","last_change":"2023-11-28T17:40:25.906782+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906782+0000","last_undegraded":"2023-11-28T17:40:25.906782+0000","last_fullsized":"2023-11-28T17:40:25.906782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906812+0000","last_change":"2023-11-28T17:40:25.906812+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906812+0000","last_undegraded":"2023-11-28T17:40:25.906812+0000","last_fullsized":"2023-11-28T17:40:25.906812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174720+0000","last_change":"2023-11-28T17:40:26.174720+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174720+0000","last_undegraded":"2023-11-28T17:40:26.174720+0000","last_fullsized":"2023-11-28T17:40:26.174720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174824+0000","last_change":"2023-11-28T17:40:26.174824+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174824+0000","last_undegraded":"2023-11-28T17:40:26.174824+0000","last_fullsized":"2023-11-28T17:40:26.174824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174120+0000","last_change":"2023-11-28T17:40:26.174120+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174120+0000","last_undegraded":"2023-11-28T17:40:26.174120+0000","last_fullsized":"2023-11-28T17:40:26.174120+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907178+0000","last_change":"2023-11-28T17:40:25.907178+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907178+0000","last_undegraded":"2023-11-28T17:40:25.907178+0000","last_fullsized":"2023-11-28T17:40:25.907178+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907646+0000","last_change":"2023-11-28T17:40:25.907646+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907646+0000","last_undegraded":"2023-11-28T17:40:25.907646+0000","last_fullsized":"2023-11-28T17:40:25.907646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911121+0000","last_change":"2023-11-28T17:40:25.911121+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911121+0000","last_undegraded":"2023-11-28T17:40:25.911121+0000","last_fullsized":"2023-11-28T17:40:25.911121+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.913794+0000","last_change":"2023-11-28T17:40:25.913794+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.913794+0000","last_undegraded":"2023-11-28T17:40:25.913794+0000","last_fullsized":"2023-11-28T17:40:25.913794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174126+0000","last_change":"2023-11-28T17:40:26.174126+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174126+0000","last_undegraded":"2023-11-28T17:40:26.174126+0000","last_fullsized":"2023-11-28T17:40:26.174126+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906782+0000","last_change":"2023-11-28T17:40:25.906782+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906782+0000","last_undegraded":"2023-11-28T17:40:25.906782+0000","last_fullsized":"2023-11-28T17:40:25.906782+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906787+0000","last_change":"2023-11-28T17:40:25.906787+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906787+0000","last_undegraded":"2023-11-28T17:40:25.906787+0000","last_fullsized":"2023-11-28T17:40:25.906787+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:25.896266+0000","last_change":"2023-11-28T17:40:25.896266+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.896266+0000","last_undegraded":"2023-11-28T17:40:25.896266+0000","last_fullsized":"2023-11-28T17:40:25.896266+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174198+0000","last_change":"2023-11-28T17:40:26.174198+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174198+0000","last_undegraded":"2023-11-28T17:40:26.174198+0000","last_fullsized":"2023-11-28T17:40:26.174198+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912064+0000","last_change":"2023-11-28T17:40:25.912064+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912064+0000","last_undegraded":"2023-11-28T17:40:25.912064+0000","last_fullsized":"2023-11-28T17:40:25.912064+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907612+0000","last_change":"2023-11-28T17:40:25.907612+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907612+0000","last_undegraded":"2023-11-28T17:40:25.907612+0000","last_fullsized":"2023-11-28T17:40:25.907612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.906945+0000","last_change":"2023-11-28T17:40:25.906945+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.906945+0000","last_undegraded":"2023-11-28T17:40:25.906945+0000","last_fullsized":"2023-11-28T17:40:25.906945+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174118+0000","last_change":"2023-11-28T17:40:26.174118+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174118+0000","last_undegraded":"2023-11-28T17:40:26.174118+0000","last_fullsized":"2023-11-28T17:40:26.174118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.910576+0000","last_change":"2023-11-28T17:40:25.910576+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.910576+0000","last_undegraded":"2023-11-28T17:40:25.910576+0000","last_fullsized":"2023-11-28T17:40:25.910576+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911076+0000","last_change":"2023-11-28T17:40:25.911076+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911076+0000","last_undegraded":"2023-11-28T17:40:25.911076+0000","last_fullsized":"2023-11-28T17:40:25.911076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.913600+0000","last_change":"2023-11-28T17:40:25.913600+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.913600+0000","last_undegraded":"2023-11-28T17:40:25.913600+0000","last_fullsized":"2023-11-28T17:40:25.913600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907027+0000","last_change":"2023-11-28T17:40:25.907027+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907027+0000","last_undegraded":"2023-11-28T17:40:25.907027+0000","last_fullsized":"2023-11-28T17:40:25.907027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912985+0000","last_change":"2023-11-28T17:40:25.912985+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912985+0000","last_undegraded":"2023-11-28T17:40:25.912985+0000","last_fullsized":"2023-11-28T17:40:25.912985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912832+0000","last_change":"2023-11-28T17:40:25.912832+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912832+0000","last_undegraded":"2023-11-28T17:40:25.912832+0000","last_fullsized":"2023-11-28T17:40:25.912832+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.912801+0000","last_change":"2023-11-28T17:40:25.912801+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.912801+0000","last_undegraded":"2023-11-28T17:40:25.912801+0000","last_fullsized":"2023-11-28T17:40:25.912801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:26.174117+0000","last_change":"2023-11-28T17:40:26.174117+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.174117+0000","last_undegraded":"2023-11-28T17:40:26.174117+0000","last_fullsized":"2023-11-28T17:40:26.174117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.907042+0000","last_change":"2023-11-28T17:40:25.907042+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.907042+0000","last_undegraded":"2023-11-28T17:40:25.907042+0000","last_fullsized":"2023-11-28T17:40:25.907042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T17:40:26.903668+0000","last_change":"2023-11-28T17:40:26.903668+0000","last_active":"2023-11-28T17:40:26.903668+0000","last_peered":"2023-11-28T17:40:26.903668+0000","last_clean":"2023-11-28T17:40:26.903668+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:26.903668+0000","last_undegraded":"2023-11-28T17:40:26.903668+0000","last_fullsized":"2023-11-28T17:40:26.903668+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":32,"state":"creating+peering","last_fresh":"2023-11-28T17:40:25.911673+0000","last_change":"2023-11-28T17:40:25.911673+0000","last_active":"2023-11-28T17:40:25.896266+0000","last_peered":"2023-11-28T17:40:25.896266+0000","last_clean":"2023-11-28T17:40:25.896266+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T17:40:25.911673+0000","last_undegraded":"2023-11-28T17:40:25.911673+0000","last_fullsized":"2023-11-28T17:40:25.911673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T17:40:21.079022+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:40:21.079022+0000","last_peered":"2023-11-28T17:40:21.079022+0000","last_clean":"2023-11-28T17:40:21.079022+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:40:21.079022+0000","last_undegraded":"2023-11-28T17:40:21.079022+0000","last_fullsized":"2023-11-28T17:40:21.079022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":56,"acting":56,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.492,"5min":7.492,"15min":7.492},"last":0.61899999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":0.754},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.68899999999999995}]},{"osd":3,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.86499999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.81299999999999994}]},{"osd":5,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.89100000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509457,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":722458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.51800000000000002}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.55100000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.71399999999999997}]}]},{"osd":4,"up_from":15,"seq":64424509456,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.77800000000000002}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":5.6840000000000002},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.80500000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.98299999999999998}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.622}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.871},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.752}]}]},{"osd":3,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":0.496},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.6779999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.45600000000000002}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":5.3780000000000001,"5min":5.3780000000000001,"15min":5.3780000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.53600000000000003}]},{"osd":4,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.59499999999999997},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.7640000000000002,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.628}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.67500000000000004}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":8.3149999999999995,"5min":8.3149999999999995,"15min":8.3149999999999995},"last":0.64800000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.66100000000000003}]}]},{"osd":2,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":339968,"data_stored":126273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.433},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52100000000000002}]},{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.503},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.55600000000000005}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.54400000000000004}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.78300000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.75900000000000001}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.72299999999999998}]}]},{"osd":1,"up_from":15,"seq":64424509456,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":933888,"data_stored":716641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.36299999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46600000000000003}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.51800000000000002}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.65600000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.74299999999999999}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.67400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509456,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31524,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340316,"statfs":{"total":96636764160,"available":96604483584,"internally_reserved":0,"allocated":352256,"data_stored":132090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.438}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.625},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.72099999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27364,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":339968,"data_stored":126273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.72499999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.69299999999999995}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.877}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.752},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.63700000000000001}]},{"osd":5,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.81499999999999995}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:40:32.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:40:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb7d01640 1 Processor -- start 2023-11-28T17:40:32.626 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb7d01640 1 -- start start 2023-11-28T17:40:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb7d01640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2eb015d540 0x7f2eb00b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb7d01640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00b32c0 con 0x7f2eb00d3690 2023-11-28T17:40:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb7d01640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eb00b35a0 con 0x7f2eb00d1f50 2023-11-28T17:40:32.627 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb7d01640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eb015d920 con 0x7f2eb015d540 2023-11-28T17:40:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb629e640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f2eb00d3690 0x7f2eb00cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49792/0 (socket says 172.21.15.16:49792) 2023-11-28T17:40:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb5a9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f2eb015d540 0x7f2eb00b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb629e640 1 -- 172.21.15.16:0/3103716579 learned_addr learned my addr 172.21.15.16:0/3103716579 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb5a9d640 1 -- 172.21.15.16:0/3103716579 >> v1:172.21.15.64:6789/0 conn(0x7f2eb00d1f50 legacy=0x7f2eb00d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb5a9d640 1 -- 172.21.15.16:0/3103716579 >> v1:172.21.15.16:6789/0 conn(0x7f2eb00d3690 legacy=0x7f2eb00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.628 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.622+0000 7f2eb5a9d640 1 -- 172.21.15.16:0/3103716579 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb00b3880 con 0x7f2eb015d540 2023-11-28T17:40:32.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb5a9d640 1 --2- 172.21.15.16:0/3103716579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb015d540 0x7f2eb00b29c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0097c0 tx=0x7f2eac01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a51596c5c74b30 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:32.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb4a9b640 1 -- 172.21.15.16:0/3103716579 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0ac620 con 0x7f2eb015d540 2023-11-28T17:40:32.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb4a9b640 1 -- 172.21.15.16:0/3103716579 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eac0ac780 con 0x7f2eb015d540 2023-11-28T17:40:32.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb4a9b640 1 -- 172.21.15.16:0/3103716579 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac0acb10 con 0x7f2eb015d540 2023-11-28T17:40:32.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 -- 172.21.15.16:0/3103716579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb015d540 msgr2=0x7f2eb00b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.632 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/3103716579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb015d540 0x7f2eb00b29c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0097c0 tx=0x7f2eac01c3c0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 -- 172.21.15.16:0/3103716579 shutdown_connections 2023-11-28T17:40:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/3103716579 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb015d540 0x7f2eb00b29c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 -- 172.21.15.16:0/3103716579 >> 172.21.15.16:0/3103716579 conn(0x7f2eb008ccf0 msgr2=0x7f2eb009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 -- 172.21.15.16:0/3103716579 shutdown_connections 2023-11-28T17:40:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.626+0000 7f2eb7d01640 1 -- 172.21.15.16:0/3103716579 wait complete. 2023-11-28T17:40:32.633 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 Processor -- start 2023-11-28T17:40:32.634 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 -- start start 2023-11-28T17:40:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb00d1f50 0x7f2eb00cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 0x7f2eb0150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb015d540 0x7f2eb0156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.635 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0150dc0 con 0x7f2eb00d3690 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0156ec0 con 0x7f2eb015d540 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01571a0 con 0x7f2eb00d1f50 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 0x7f2eb0150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 0x7f2eb0150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37758/0 (socket says 172.21.15.16:37758) 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 -- 172.21.15.16:0/2980973690 learned_addr learned my addr 172.21.15.16:0/2980973690 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb5a9d640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb00d1f50 0x7f2eb00cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb629e640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb015d540 0x7f2eb0156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 -- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb00d1f50 msgr2=0x7f2eb00cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb00d1f50 0x7f2eb00cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 -- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb015d540 msgr2=0x7f2eb0156670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb015d540 0x7f2eb0156670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 -- 172.21.15.16:0/2980973690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009420 con 0x7f2eb00d3690 2023-11-28T17:40:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb629e640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb015d540 0x7f2eb0156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb529c640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 0x7f2eb0150880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c390 tx=0x7f2ea000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:32.637 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00052d0 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea0005430 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0003820 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb0157480 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.630+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb0157a40 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.634+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb0068860 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.634+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2ea0003980 con 0x7f2eb00d3690 2023-11-28T17:40:32.638 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.634+0000 7f2ea67fc640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2e940668d0 0x7f2e94068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:32.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.634+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ea0083970 con 0x7f2eb00d3690 2023-11-28T17:40:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.634+0000 7f2eb5a9d640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2e940668d0 0x7f2e94068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:32.641 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.634+0000 7f2eb5a9d640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2e940668d0 0x7f2e94068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ae000 tx=0x7f2eac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:32.642 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.638+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ea0050bc0 con 0x7f2eb00d3690 2023-11-28T17:40:32.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.790+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2eb00d3b50 con 0x7f2e940668d0 2023-11-28T17:40:32.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.798+0000 7f2ea67fc640 1 -- 172.21.15.16:0/2980973690 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288780 (secure 0 0 0) 0x7f2eb00d3b50 con 0x7f2e940668d0 2023-11-28T17:40:32.807 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:32.809 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2e940668d0 msgr2=0x7f2e94068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2e940668d0 0x7f2e94068d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0ae000 tx=0x7f2eac008040 comp rx=0 tx=0).stop 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 msgr2=0x7f2eb0150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 0x7f2eb0150880 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000c390 tx=0x7f2ea000c850 comp rx=0 tx=0).stop 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 shutdown_connections 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2e940668d0 0x7f2e94068d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2eb015d540 0x7f2eb0156670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f2eb00d3690 0x7f2eb0150880 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 --2- 172.21.15.16:0/2980973690 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f2eb00d1f50 0x7f2eb00cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:32.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 >> 172.21.15.16:0/2980973690 conn(0x7f2eb008ccf0 msgr2=0x7f2eb00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 shutdown_connections 2023-11-28T17:40:32.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:32.802+0000 7f2eb7d01640 1 -- 172.21.15.16:0/2980973690 wait complete. 2023-11-28T17:40:32.827 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-28T17:40:32.778093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232908,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741812,"statfs":{"total":773094113280,"available":772855615488,"internally_reserved":0,"allocated":4366336,"data_stored":2397076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001365"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107018+0000","last_change":"2023-11-28T17:40:27.947483+0000","last_active":"2023-11-28T17:40:30.107018+0000","last_peered":"2023-11-28T17:40:30.107018+0000","last_clean":"2023-11-28T17:40:30.107018+0000","last_became_active":"2023-11-28T17:40:27.947107+0000","last_became_peered":"2023-11-28T17:40:27.947107+0000","last_unstale":"2023-11-28T17:40:30.107018+0000","last_undegraded":"2023-11-28T17:40:30.107018+0000","last_fullsized":"2023-11-28T17:40:30.107018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941379+0000","last_change":"2023-11-28T17:40:27.938381+0000","last_active":"2023-11-28T17:40:28.941379+0000","last_peered":"2023-11-28T17:40:28.941379+0000","last_clean":"2023-11-28T17:40:28.941379+0000","last_became_active":"2023-11-28T17:40:27.938067+0000","last_became_peered":"2023-11-28T17:40:27.938067+0000","last_unstale":"2023-11-28T17:40:28.941379+0000","last_undegraded":"2023-11-28T17:40:28.941379+0000","last_fullsized":"2023-11-28T17:40:28.941379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975059+0000","last_change":"2023-11-28T17:40:27.935238+0000","last_active":"2023-11-28T17:40:28.975059+0000","last_peered":"2023-11-28T17:40:28.975059+0000","last_clean":"2023-11-28T17:40:28.975059+0000","last_became_active":"2023-11-28T17:40:27.934884+0000","last_became_peered":"2023-11-28T17:40:27.934884+0000","last_unstale":"2023-11-28T17:40:28.975059+0000","last_undegraded":"2023-11-28T17:40:28.975059+0000","last_fullsized":"2023-11-28T17:40:28.975059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:02.431496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107163+0000","last_change":"2023-11-28T17:40:27.952280+0000","last_active":"2023-11-28T17:40:30.107163+0000","last_peered":"2023-11-28T17:40:30.107163+0000","last_clean":"2023-11-28T17:40:30.107163+0000","last_became_active":"2023-11-28T17:40:27.951937+0000","last_became_peered":"2023-11-28T17:40:27.951937+0000","last_unstale":"2023-11-28T17:40:30.107163+0000","last_undegraded":"2023-11-28T17:40:30.107163+0000","last_fullsized":"2023-11-28T17:40:30.107163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:22.497701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940895+0000","last_change":"2023-11-28T17:40:27.957901+0000","last_active":"2023-11-28T17:40:28.940895+0000","last_peered":"2023-11-28T17:40:28.940895+0000","last_clean":"2023-11-28T17:40:28.940895+0000","last_became_active":"2023-11-28T17:40:27.957453+0000","last_became_peered":"2023-11-28T17:40:27.957453+0000","last_unstale":"2023-11-28T17:40:28.940895+0000","last_undegraded":"2023-11-28T17:40:28.940895+0000","last_fullsized":"2023-11-28T17:40:28.940895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940923+0000","last_change":"2023-11-28T17:40:27.959407+0000","last_active":"2023-11-28T17:40:28.940923+0000","last_peered":"2023-11-28T17:40:28.940923+0000","last_clean":"2023-11-28T17:40:28.940923+0000","last_became_active":"2023-11-28T17:40:27.959094+0000","last_became_peered":"2023-11-28T17:40:27.959094+0000","last_unstale":"2023-11-28T17:40:28.940923+0000","last_undegraded":"2023-11-28T17:40:28.940923+0000","last_fullsized":"2023-11-28T17:40:28.940923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:51.344460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107288+0000","last_change":"2023-11-28T17:40:27.948384+0000","last_active":"2023-11-28T17:40:30.107288+0000","last_peered":"2023-11-28T17:40:30.107288+0000","last_clean":"2023-11-28T17:40:30.107288+0000","last_became_active":"2023-11-28T17:40:27.941068+0000","last_became_peered":"2023-11-28T17:40:27.941068+0000","last_unstale":"2023-11-28T17:40:30.107288+0000","last_undegraded":"2023-11-28T17:40:30.107288+0000","last_fullsized":"2023-11-28T17:40:30.107288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106675+0000","last_change":"2023-11-28T17:40:27.955864+0000","last_active":"2023-11-28T17:40:30.106675+0000","last_peered":"2023-11-28T17:40:30.106675+0000","last_clean":"2023-11-28T17:40:30.106675+0000","last_became_active":"2023-11-28T17:40:27.955297+0000","last_became_peered":"2023-11-28T17:40:27.955297+0000","last_unstale":"2023-11-28T17:40:30.106675+0000","last_undegraded":"2023-11-28T17:40:30.106675+0000","last_fullsized":"2023-11-28T17:40:30.106675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.206124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975285+0000","last_change":"2023-11-28T17:40:27.934768+0000","last_active":"2023-11-28T17:40:28.975285+0000","last_peered":"2023-11-28T17:40:28.975285+0000","last_clean":"2023-11-28T17:40:28.975285+0000","last_became_active":"2023-11-28T17:40:27.934424+0000","last_became_peered":"2023-11-28T17:40:27.934424+0000","last_unstale":"2023-11-28T17:40:28.975285+0000","last_undegraded":"2023-11-28T17:40:28.975285+0000","last_fullsized":"2023-11-28T17:40:28.975285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:18.569746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107428+0000","last_change":"2023-11-28T17:40:27.939238+0000","last_active":"2023-11-28T17:40:30.107428+0000","last_peered":"2023-11-28T17:40:30.107428+0000","last_clean":"2023-11-28T17:40:30.107428+0000","last_became_active":"2023-11-28T17:40:27.938943+0000","last_became_peered":"2023-11-28T17:40:27.938943+0000","last_unstale":"2023-11-28T17:40:30.107428+0000","last_undegraded":"2023-11-28T17:40:30.107428+0000","last_fullsized":"2023-11-28T17:40:30.107428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:38.063099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936003+0000","last_change":"2023-11-28T17:40:27.943150+0000","last_active":"2023-11-28T17:40:28.936003+0000","last_peered":"2023-11-28T17:40:28.936003+0000","last_clean":"2023-11-28T17:40:28.936003+0000","last_became_active":"2023-11-28T17:40:27.942601+0000","last_became_peered":"2023-11-28T17:40:27.942601+0000","last_unstale":"2023-11-28T17:40:28.936003+0000","last_undegraded":"2023-11-28T17:40:28.936003+0000","last_fullsized":"2023-11-28T17:40:28.936003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:45.297173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975080+0000","last_change":"2023-11-28T17:40:27.959079+0000","last_active":"2023-11-28T17:40:28.975080+0000","last_peered":"2023-11-28T17:40:28.975080+0000","last_clean":"2023-11-28T17:40:28.975080+0000","last_became_active":"2023-11-28T17:40:27.958809+0000","last_became_peered":"2023-11-28T17:40:27.958809+0000","last_unstale":"2023-11-28T17:40:28.975080+0000","last_undegraded":"2023-11-28T17:40:28.975080+0000","last_fullsized":"2023-11-28T17:40:28.975080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:27.083860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106246+0000","last_change":"2023-11-28T17:40:27.951239+0000","last_active":"2023-11-28T17:40:30.106246+0000","last_peered":"2023-11-28T17:40:30.106246+0000","last_clean":"2023-11-28T17:40:30.106246+0000","last_became_active":"2023-11-28T17:40:27.950948+0000","last_became_peered":"2023-11-28T17:40:27.950948+0000","last_unstale":"2023-11-28T17:40:30.106246+0000","last_undegraded":"2023-11-28T17:40:30.106246+0000","last_fullsized":"2023-11-28T17:40:30.106246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:53.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106935+0000","last_change":"2023-11-28T17:40:27.940469+0000","last_active":"2023-11-28T17:40:30.106935+0000","last_peered":"2023-11-28T17:40:30.106935+0000","last_clean":"2023-11-28T17:40:30.106935+0000","last_became_active":"2023-11-28T17:40:27.940117+0000","last_became_peered":"2023-11-28T17:40:27.940117+0000","last_unstale":"2023-11-28T17:40:30.106935+0000","last_undegraded":"2023-11-28T17:40:30.106935+0000","last_fullsized":"2023-11-28T17:40:30.106935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216013+0000","last_change":"2023-11-28T17:40:27.950747+0000","last_active":"2023-11-28T17:40:29.216013+0000","last_peered":"2023-11-28T17:40:29.216013+0000","last_clean":"2023-11-28T17:40:29.216013+0000","last_became_active":"2023-11-28T17:40:27.950195+0000","last_became_peered":"2023-11-28T17:40:27.950195+0000","last_unstale":"2023-11-28T17:40:29.216013+0000","last_undegraded":"2023-11-28T17:40:29.216013+0000","last_fullsized":"2023-11-28T17:40:29.216013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215919+0000","last_change":"2023-11-28T17:40:27.951518+0000","last_active":"2023-11-28T17:40:29.215919+0000","last_peered":"2023-11-28T17:40:29.215919+0000","last_clean":"2023-11-28T17:40:29.215919+0000","last_became_active":"2023-11-28T17:40:27.951221+0000","last_became_peered":"2023-11-28T17:40:27.951221+0000","last_unstale":"2023-11-28T17:40:29.215919+0000","last_undegraded":"2023-11-28T17:40:29.215919+0000","last_fullsized":"2023-11-28T17:40:29.215919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935865+0000","last_change":"2023-11-28T17:40:27.946566+0000","last_active":"2023-11-28T17:40:28.935865+0000","last_peered":"2023-11-28T17:40:28.935865+0000","last_clean":"2023-11-28T17:40:28.935865+0000","last_became_active":"2023-11-28T17:40:27.946260+0000","last_became_peered":"2023-11-28T17:40:27.946260+0000","last_unstale":"2023-11-28T17:40:28.935865+0000","last_undegraded":"2023-11-28T17:40:28.935865+0000","last_fullsized":"2023-11-28T17:40:28.935865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:06.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940483+0000","last_change":"2023-11-28T17:40:27.952326+0000","last_active":"2023-11-28T17:40:28.940483+0000","last_peered":"2023-11-28T17:40:28.940483+0000","last_clean":"2023-11-28T17:40:28.940483+0000","last_became_active":"2023-11-28T17:40:27.951769+0000","last_became_peered":"2023-11-28T17:40:27.951769+0000","last_unstale":"2023-11-28T17:40:28.940483+0000","last_undegraded":"2023-11-28T17:40:28.940483+0000","last_fullsized":"2023-11-28T17:40:28.940483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:01:10.285439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941104+0000","last_change":"2023-11-28T17:40:27.947358+0000","last_active":"2023-11-28T17:40:28.941104+0000","last_peered":"2023-11-28T17:40:28.941104+0000","last_clean":"2023-11-28T17:40:28.941104+0000","last_became_active":"2023-11-28T17:40:27.946690+0000","last_became_peered":"2023-11-28T17:40:27.946690+0000","last_unstale":"2023-11-28T17:40:28.941104+0000","last_undegraded":"2023-11-28T17:40:28.941104+0000","last_fullsized":"2023-11-28T17:40:28.941104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:19.293511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106564+0000","last_change":"2023-11-28T17:40:27.956892+0000","last_active":"2023-11-28T17:40:30.106564+0000","last_peered":"2023-11-28T17:40:30.106564+0000","last_clean":"2023-11-28T17:40:30.106564+0000","last_became_active":"2023-11-28T17:40:27.956511+0000","last_became_peered":"2023-11-28T17:40:27.956511+0000","last_unstale":"2023-11-28T17:40:30.106564+0000","last_undegraded":"2023-11-28T17:40:30.106564+0000","last_fullsized":"2023-11-28T17:40:30.106564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216224+0000","last_change":"2023-11-28T17:40:27.954597+0000","last_active":"2023-11-28T17:40:29.216224+0000","last_peered":"2023-11-28T17:40:29.216224+0000","last_clean":"2023-11-28T17:40:29.216224+0000","last_became_active":"2023-11-28T17:40:27.954320+0000","last_became_peered":"2023-11-28T17:40:27.954320+0000","last_unstale":"2023-11-28T17:40:29.216224+0000","last_undegraded":"2023-11-28T17:40:29.216224+0000","last_fullsized":"2023-11-28T17:40:29.216224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106853+0000","last_change":"2023-11-28T17:40:27.954220+0000","last_active":"2023-11-28T17:40:30.106853+0000","last_peered":"2023-11-28T17:40:30.106853+0000","last_clean":"2023-11-28T17:40:30.106853+0000","last_became_active":"2023-11-28T17:40:27.953898+0000","last_became_peered":"2023-11-28T17:40:27.953898+0000","last_unstale":"2023-11-28T17:40:30.106853+0000","last_undegraded":"2023-11-28T17:40:30.106853+0000","last_fullsized":"2023-11-28T17:40:30.106853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106092+0000","last_change":"2023-11-28T17:40:27.948419+0000","last_active":"2023-11-28T17:40:30.106092+0000","last_peered":"2023-11-28T17:40:30.106092+0000","last_clean":"2023-11-28T17:40:30.106092+0000","last_became_active":"2023-11-28T17:40:27.948044+0000","last_became_peered":"2023-11-28T17:40:27.948044+0000","last_unstale":"2023-11-28T17:40:30.106092+0000","last_undegraded":"2023-11-28T17:40:30.106092+0000","last_fullsized":"2023-11-28T17:40:30.106092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.206124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106732+0000","last_change":"2023-11-28T17:40:27.954027+0000","last_active":"2023-11-28T17:40:30.106732+0000","last_peered":"2023-11-28T17:40:30.106732+0000","last_clean":"2023-11-28T17:40:30.106732+0000","last_became_active":"2023-11-28T17:40:27.953655+0000","last_became_peered":"2023-11-28T17:40:27.953655+0000","last_unstale":"2023-11-28T17:40:30.106732+0000","last_undegraded":"2023-11-28T17:40:30.106732+0000","last_fullsized":"2023-11-28T17:40:30.106732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:38:09.270172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107588+0000","last_change":"2023-11-28T17:40:27.936255+0000","last_active":"2023-11-28T17:40:30.107588+0000","last_peered":"2023-11-28T17:40:30.107588+0000","last_clean":"2023-11-28T17:40:30.107588+0000","last_became_active":"2023-11-28T17:40:27.935117+0000","last_became_peered":"2023-11-28T17:40:27.935117+0000","last_unstale":"2023-11-28T17:40:30.107588+0000","last_undegraded":"2023-11-28T17:40:30.107588+0000","last_fullsized":"2023-11-28T17:40:30.107588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.342955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107481+0000","last_change":"2023-11-28T17:40:27.938784+0000","last_active":"2023-11-28T17:40:30.107481+0000","last_peered":"2023-11-28T17:40:30.107481+0000","last_clean":"2023-11-28T17:40:30.107481+0000","last_became_active":"2023-11-28T17:40:27.935137+0000","last_became_peered":"2023-11-28T17:40:27.935137+0000","last_unstale":"2023-11-28T17:40:30.107481+0000","last_undegraded":"2023-11-28T17:40:30.107481+0000","last_fullsized":"2023-11-28T17:40:30.107481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:13.629735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940812+0000","last_change":"2023-11-28T17:40:27.946225+0000","last_active":"2023-11-28T17:40:28.940812+0000","last_peered":"2023-11-28T17:40:28.940812+0000","last_clean":"2023-11-28T17:40:28.940812+0000","last_became_active":"2023-11-28T17:40:27.943256+0000","last_became_peered":"2023-11-28T17:40:27.943256+0000","last_unstale":"2023-11-28T17:40:28.940812+0000","last_undegraded":"2023-11-28T17:40:28.940812+0000","last_fullsized":"2023-11-28T17:40:28.940812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107134+0000","last_change":"2023-11-28T17:40:27.957876+0000","last_active":"2023-11-28T17:40:30.107134+0000","last_peered":"2023-11-28T17:40:30.107134+0000","last_clean":"2023-11-28T17:40:30.107134+0000","last_became_active":"2023-11-28T17:40:27.957607+0000","last_became_peered":"2023-11-28T17:40:27.957607+0000","last_unstale":"2023-11-28T17:40:30.107134+0000","last_undegraded":"2023-11-28T17:40:30.107134+0000","last_fullsized":"2023-11-28T17:40:30.107134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216013+0000","last_change":"2023-11-28T17:40:27.939111+0000","last_active":"2023-11-28T17:40:29.216013+0000","last_peered":"2023-11-28T17:40:29.216013+0000","last_clean":"2023-11-28T17:40:29.216013+0000","last_became_active":"2023-11-28T17:40:27.938816+0000","last_became_peered":"2023-11-28T17:40:27.938816+0000","last_unstale":"2023-11-28T17:40:29.216013+0000","last_undegraded":"2023-11-28T17:40:29.216013+0000","last_fullsized":"2023-11-28T17:40:29.216013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215980+0000","last_change":"2023-11-28T17:40:27.938903+0000","last_active":"2023-11-28T17:40:29.215980+0000","last_peered":"2023-11-28T17:40:29.215980+0000","last_clean":"2023-11-28T17:40:29.215980+0000","last_became_active":"2023-11-28T17:40:27.938637+0000","last_became_peered":"2023-11-28T17:40:27.938637+0000","last_unstale":"2023-11-28T17:40:29.215980+0000","last_undegraded":"2023-11-28T17:40:29.215980+0000","last_fullsized":"2023-11-28T17:40:29.215980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106823+0000","last_change":"2023-11-28T17:40:27.955627+0000","last_active":"2023-11-28T17:40:30.106823+0000","last_peered":"2023-11-28T17:40:30.106823+0000","last_clean":"2023-11-28T17:40:30.106823+0000","last_became_active":"2023-11-28T17:40:27.955308+0000","last_became_peered":"2023-11-28T17:40:27.955308+0000","last_unstale":"2023-11-28T17:40:30.106823+0000","last_undegraded":"2023-11-28T17:40:30.106823+0000","last_fullsized":"2023-11-28T17:40:30.106823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:53.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936104+0000","last_change":"2023-11-28T17:40:27.942869+0000","last_active":"2023-11-28T17:40:28.936104+0000","last_peered":"2023-11-28T17:40:28.936104+0000","last_clean":"2023-11-28T17:40:28.936104+0000","last_became_active":"2023-11-28T17:40:27.942548+0000","last_became_peered":"2023-11-28T17:40:27.942548+0000","last_unstale":"2023-11-28T17:40:28.936104+0000","last_undegraded":"2023-11-28T17:40:28.936104+0000","last_fullsized":"2023-11-28T17:40:28.936104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:51.203222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106586+0000","last_change":"2023-11-28T17:40:27.947426+0000","last_active":"2023-11-28T17:40:30.106586+0000","last_peered":"2023-11-28T17:40:30.106586+0000","last_clean":"2023-11-28T17:40:30.106586+0000","last_became_active":"2023-11-28T17:40:27.946841+0000","last_became_peered":"2023-11-28T17:40:27.946841+0000","last_unstale":"2023-11-28T17:40:30.106586+0000","last_undegraded":"2023-11-28T17:40:30.106586+0000","last_fullsized":"2023-11-28T17:40:30.106586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.958478+0000","last_change":"2023-11-28T17:40:26.927946+0000","last_active":"2023-11-28T17:40:27.958478+0000","last_peered":"2023-11-28T17:40:27.958478+0000","last_clean":"2023-11-28T17:40:27.958478+0000","last_became_active":"2023-11-28T17:40:26.927239+0000","last_became_peered":"2023-11-28T17:40:26.927239+0000","last_unstale":"2023-11-28T17:40:27.958478+0000","last_undegraded":"2023-11-28T17:40:27.958478+0000","last_fullsized":"2023-11-28T17:40:27.958478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:13.335553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107166+0000","last_change":"2023-11-28T17:40:27.939400+0000","last_active":"2023-11-28T17:40:30.107166+0000","last_peered":"2023-11-28T17:40:30.107166+0000","last_clean":"2023-11-28T17:40:30.107166+0000","last_became_active":"2023-11-28T17:40:27.939101+0000","last_became_peered":"2023-11-28T17:40:27.939101+0000","last_unstale":"2023-11-28T17:40:30.107166+0000","last_undegraded":"2023-11-28T17:40:30.107166+0000","last_fullsized":"2023-11-28T17:40:30.107166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.953772+0000","last_change":"2023-11-28T17:40:26.936375+0000","last_active":"2023-11-28T17:40:27.953772+0000","last_peered":"2023-11-28T17:40:27.953772+0000","last_clean":"2023-11-28T17:40:27.953772+0000","last_became_active":"2023-11-28T17:40:26.936085+0000","last_became_peered":"2023-11-28T17:40:26.936085+0000","last_unstale":"2023-11-28T17:40:27.953772+0000","last_undegraded":"2023-11-28T17:40:27.953772+0000","last_fullsized":"2023-11-28T17:40:27.953772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:25.903111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107203+0000","last_change":"2023-11-28T17:40:27.954138+0000","last_active":"2023-11-28T17:40:30.107203+0000","last_peered":"2023-11-28T17:40:30.107203+0000","last_clean":"2023-11-28T17:40:30.107203+0000","last_became_active":"2023-11-28T17:40:27.953676+0000","last_became_peered":"2023-11-28T17:40:27.953676+0000","last_unstale":"2023-11-28T17:40:30.107203+0000","last_undegraded":"2023-11-28T17:40:30.107203+0000","last_fullsized":"2023-11-28T17:40:30.107203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941503+0000","last_change":"2023-11-28T17:40:26.934639+0000","last_active":"2023-11-28T17:40:28.941503+0000","last_peered":"2023-11-28T17:40:28.941503+0000","last_clean":"2023-11-28T17:40:28.941503+0000","last_became_active":"2023-11-28T17:40:26.934345+0000","last_became_peered":"2023-11-28T17:40:26.934345+0000","last_unstale":"2023-11-28T17:40:28.941503+0000","last_undegraded":"2023-11-28T17:40:28.941503+0000","last_fullsized":"2023-11-28T17:40:28.941503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:31.675585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107352+0000","last_change":"2023-11-28T17:40:27.952787+0000","last_active":"2023-11-28T17:40:30.107352+0000","last_peered":"2023-11-28T17:40:30.107352+0000","last_clean":"2023-11-28T17:40:30.107352+0000","last_became_active":"2023-11-28T17:40:27.952511+0000","last_became_peered":"2023-11-28T17:40:27.952511+0000","last_unstale":"2023-11-28T17:40:30.107352+0000","last_undegraded":"2023-11-28T17:40:30.107352+0000","last_fullsized":"2023-11-28T17:40:30.107352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:14.162764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.962995+0000","last_change":"2023-11-28T17:40:26.935178+0000","last_active":"2023-11-28T17:40:27.962995+0000","last_peered":"2023-11-28T17:40:27.962995+0000","last_clean":"2023-11-28T17:40:27.962995+0000","last_became_active":"2023-11-28T17:40:26.934878+0000","last_became_peered":"2023-11-28T17:40:26.934878+0000","last_unstale":"2023-11-28T17:40:27.962995+0000","last_undegraded":"2023-11-28T17:40:27.962995+0000","last_fullsized":"2023-11-28T17:40:27.962995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:50.213813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975174+0000","last_change":"2023-11-28T17:40:27.934749+0000","last_active":"2023-11-28T17:40:28.975174+0000","last_peered":"2023-11-28T17:40:28.975174+0000","last_clean":"2023-11-28T17:40:28.975174+0000","last_became_active":"2023-11-28T17:40:27.934482+0000","last_became_peered":"2023-11-28T17:40:27.934482+0000","last_unstale":"2023-11-28T17:40:28.975174+0000","last_undegraded":"2023-11-28T17:40:28.975174+0000","last_fullsized":"2023-11-28T17:40:28.975174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:42.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.954048+0000","last_change":"2023-11-28T17:40:26.934061+0000","last_active":"2023-11-28T17:40:27.954048+0000","last_peered":"2023-11-28T17:40:27.954048+0000","last_clean":"2023-11-28T17:40:27.954048+0000","last_became_active":"2023-11-28T17:40:26.932628+0000","last_became_peered":"2023-11-28T17:40:26.932628+0000","last_unstale":"2023-11-28T17:40:27.954048+0000","last_undegraded":"2023-11-28T17:40:27.954048+0000","last_fullsized":"2023-11-28T17:40:27.954048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:48.337820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106949+0000","last_change":"2023-11-28T17:40:27.952140+0000","last_active":"2023-11-28T17:40:30.106949+0000","last_peered":"2023-11-28T17:40:30.106949+0000","last_clean":"2023-11-28T17:40:30.106949+0000","last_became_active":"2023-11-28T17:40:27.948771+0000","last_became_peered":"2023-11-28T17:40:27.948771+0000","last_unstale":"2023-11-28T17:40:30.106949+0000","last_undegraded":"2023-11-28T17:40:30.106949+0000","last_fullsized":"2023-11-28T17:40:30.106949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.957197+0000","last_change":"2023-11-28T17:40:26.935301+0000","last_active":"2023-11-28T17:40:27.957197+0000","last_peered":"2023-11-28T17:40:27.957197+0000","last_clean":"2023-11-28T17:40:27.957197+0000","last_became_active":"2023-11-28T17:40:26.932982+0000","last_became_peered":"2023-11-28T17:40:26.932982+0000","last_unstale":"2023-11-28T17:40:27.957197+0000","last_undegraded":"2023-11-28T17:40:27.957197+0000","last_fullsized":"2023-11-28T17:40:27.957197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975003+0000","last_change":"2023-11-28T17:40:27.933484+0000","last_active":"2023-11-28T17:40:28.975003+0000","last_peered":"2023-11-28T17:40:28.975003+0000","last_clean":"2023-11-28T17:40:28.975003+0000","last_became_active":"2023-11-28T17:40:27.932519+0000","last_became_peered":"2023-11-28T17:40:27.932519+0000","last_unstale":"2023-11-28T17:40:28.975003+0000","last_undegraded":"2023-11-28T17:40:28.975003+0000","last_fullsized":"2023-11-28T17:40:28.975003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:16:03.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940267+0000","last_change":"2023-11-28T17:40:26.938953+0000","last_active":"2023-11-28T17:40:28.940267+0000","last_peered":"2023-11-28T17:40:28.940267+0000","last_clean":"2023-11-28T17:40:28.940267+0000","last_became_active":"2023-11-28T17:40:26.935951+0000","last_became_peered":"2023-11-28T17:40:26.935951+0000","last_unstale":"2023-11-28T17:40:28.940267+0000","last_undegraded":"2023-11-28T17:40:28.940267+0000","last_fullsized":"2023-11-28T17:40:28.940267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:26.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106813+0000","last_change":"2023-11-28T17:40:27.934329+0000","last_active":"2023-11-28T17:40:30.106813+0000","last_peered":"2023-11-28T17:40:30.106813+0000","last_clean":"2023-11-28T17:40:30.106813+0000","last_became_active":"2023-11-28T17:40:27.933994+0000","last_became_peered":"2023-11-28T17:40:27.933994+0000","last_unstale":"2023-11-28T17:40:30.106813+0000","last_undegraded":"2023-11-28T17:40:30.106813+0000","last_fullsized":"2023-11-28T17:40:30.106813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.935649+0000","last_change":"2023-11-28T17:40:26.933807+0000","last_active":"2023-11-28T17:40:27.935649+0000","last_peered":"2023-11-28T17:40:27.935649+0000","last_clean":"2023-11-28T17:40:27.935649+0000","last_became_active":"2023-11-28T17:40:26.933505+0000","last_became_peered":"2023-11-28T17:40:26.933505+0000","last_unstale":"2023-11-28T17:40:27.935649+0000","last_undegraded":"2023-11-28T17:40:27.935649+0000","last_fullsized":"2023-11-28T17:40:27.935649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:48.648901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935872+0000","last_change":"2023-11-28T17:40:27.947376+0000","last_active":"2023-11-28T17:40:28.935872+0000","last_peered":"2023-11-28T17:40:28.935872+0000","last_clean":"2023-11-28T17:40:28.935872+0000","last_became_active":"2023-11-28T17:40:27.947051+0000","last_became_peered":"2023-11-28T17:40:27.947051+0000","last_unstale":"2023-11-28T17:40:28.935872+0000","last_undegraded":"2023-11-28T17:40:28.935872+0000","last_fullsized":"2023-11-28T17:40:28.935872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:18.077272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.930522+0000","last_change":"2023-11-28T17:40:26.942248+0000","last_active":"2023-11-28T17:40:27.930522+0000","last_peered":"2023-11-28T17:40:27.930522+0000","last_clean":"2023-11-28T17:40:27.930522+0000","last_became_active":"2023-11-28T17:40:26.941803+0000","last_became_peered":"2023-11-28T17:40:26.941803+0000","last_unstale":"2023-11-28T17:40:27.930522+0000","last_undegraded":"2023-11-28T17:40:27.930522+0000","last_fullsized":"2023-11-28T17:40:27.930522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:25.903111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107611+0000","last_change":"2023-11-28T17:40:27.941143+0000","last_active":"2023-11-28T17:40:30.107611+0000","last_peered":"2023-11-28T17:40:30.107611+0000","last_clean":"2023-11-28T17:40:30.107611+0000","last_became_active":"2023-11-28T17:40:27.940852+0000","last_became_peered":"2023-11-28T17:40:27.940852+0000","last_unstale":"2023-11-28T17:40:30.107611+0000","last_undegraded":"2023-11-28T17:40:30.107611+0000","last_fullsized":"2023-11-28T17:40:30.107611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:00.453594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.926512+0000","last_change":"2023-11-28T17:40:26.927546+0000","last_active":"2023-11-28T17:40:27.926512+0000","last_peered":"2023-11-28T17:40:27.926512+0000","last_clean":"2023-11-28T17:40:27.926512+0000","last_became_active":"2023-11-28T17:40:26.927255+0000","last_became_peered":"2023-11-28T17:40:26.927255+0000","last_unstale":"2023-11-28T17:40:27.926512+0000","last_undegraded":"2023-11-28T17:40:27.926512+0000","last_fullsized":"2023-11-28T17:40:27.926512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:52.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107190+0000","last_change":"2023-11-28T17:40:27.950552+0000","last_active":"2023-11-28T17:40:30.107190+0000","last_peered":"2023-11-28T17:40:30.107190+0000","last_clean":"2023-11-28T17:40:30.107190+0000","last_became_active":"2023-11-28T17:40:27.950272+0000","last_became_peered":"2023-11-28T17:40:27.950272+0000","last_unstale":"2023-11-28T17:40:30.107190+0000","last_undegraded":"2023-11-28T17:40:30.107190+0000","last_fullsized":"2023-11-28T17:40:30.107190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:01.505965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.957480+0000","last_change":"2023-11-28T17:40:26.936775+0000","last_active":"2023-11-28T17:40:27.957480+0000","last_peered":"2023-11-28T17:40:27.957480+0000","last_clean":"2023-11-28T17:40:27.957480+0000","last_became_active":"2023-11-28T17:40:26.936489+0000","last_became_peered":"2023-11-28T17:40:26.936489+0000","last_unstale":"2023-11-28T17:40:27.957480+0000","last_undegraded":"2023-11-28T17:40:27.957480+0000","last_fullsized":"2023-11-28T17:40:27.957480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:12.622333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936000+0000","last_change":"2023-11-28T17:40:27.942869+0000","last_active":"2023-11-28T17:40:28.936000+0000","last_peered":"2023-11-28T17:40:28.936000+0000","last_clean":"2023-11-28T17:40:28.936000+0000","last_became_active":"2023-11-28T17:40:27.942336+0000","last_became_peered":"2023-11-28T17:40:27.942336+0000","last_unstale":"2023-11-28T17:40:28.936000+0000","last_undegraded":"2023-11-28T17:40:28.936000+0000","last_fullsized":"2023-11-28T17:40:28.936000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:28.761668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.969170+0000","last_change":"2023-11-28T17:40:26.941495+0000","last_active":"2023-11-28T17:40:27.969170+0000","last_peered":"2023-11-28T17:40:27.969170+0000","last_clean":"2023-11-28T17:40:27.969170+0000","last_became_active":"2023-11-28T17:40:26.941160+0000","last_became_peered":"2023-11-28T17:40:26.941160+0000","last_unstale":"2023-11-28T17:40:27.969170+0000","last_undegraded":"2023-11-28T17:40:27.969170+0000","last_fullsized":"2023-11-28T17:40:27.969170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106179+0000","last_change":"2023-11-28T17:40:27.943820+0000","last_active":"2023-11-28T17:40:30.106179+0000","last_peered":"2023-11-28T17:40:30.106179+0000","last_clean":"2023-11-28T17:40:30.106179+0000","last_became_active":"2023-11-28T17:40:27.943514+0000","last_became_peered":"2023-11-28T17:40:27.943514+0000","last_unstale":"2023-11-28T17:40:30.106179+0000","last_undegraded":"2023-11-28T17:40:30.106179+0000","last_fullsized":"2023-11-28T17:40:30.106179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:38:09.270172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.952342+0000","last_change":"2023-11-28T17:40:26.937343+0000","last_active":"2023-11-28T17:40:27.952342+0000","last_peered":"2023-11-28T17:40:27.952342+0000","last_clean":"2023-11-28T17:40:27.952342+0000","last_became_active":"2023-11-28T17:40:26.937064+0000","last_became_peered":"2023-11-28T17:40:26.937064+0000","last_unstale":"2023-11-28T17:40:27.952342+0000","last_undegraded":"2023-11-28T17:40:27.952342+0000","last_fullsized":"2023-11-28T17:40:27.952342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:58.337146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107141+0000","last_change":"2023-11-28T17:40:27.959543+0000","last_active":"2023-11-28T17:40:30.107141+0000","last_peered":"2023-11-28T17:40:30.107141+0000","last_clean":"2023-11-28T17:40:30.107141+0000","last_became_active":"2023-11-28T17:40:27.959257+0000","last_became_peered":"2023-11-28T17:40:27.959257+0000","last_unstale":"2023-11-28T17:40:30.107141+0000","last_undegraded":"2023-11-28T17:40:30.107141+0000","last_fullsized":"2023-11-28T17:40:30.107141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:14.042176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.922464+0000","last_change":"2023-11-28T17:40:26.935707+0000","last_active":"2023-11-28T17:40:27.922464+0000","last_peered":"2023-11-28T17:40:27.922464+0000","last_clean":"2023-11-28T17:40:27.922464+0000","last_became_active":"2023-11-28T17:40:26.935413+0000","last_became_peered":"2023-11-28T17:40:26.935413+0000","last_unstale":"2023-11-28T17:40:27.922464+0000","last_undegraded":"2023-11-28T17:40:27.922464+0000","last_fullsized":"2023-11-28T17:40:27.922464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:13.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106826+0000","last_change":"2023-11-28T17:40:27.941465+0000","last_active":"2023-11-28T17:40:30.106826+0000","last_peered":"2023-11-28T17:40:30.106826+0000","last_clean":"2023-11-28T17:40:30.106826+0000","last_became_active":"2023-11-28T17:40:27.940962+0000","last_became_peered":"2023-11-28T17:40:27.940962+0000","last_unstale":"2023-11-28T17:40:30.106826+0000","last_undegraded":"2023-11-28T17:40:30.106826+0000","last_fullsized":"2023-11-28T17:40:30.106826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:11.345803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.921851+0000","last_change":"2023-11-28T17:40:26.938693+0000","last_active":"2023-11-28T17:40:27.921851+0000","last_peered":"2023-11-28T17:40:27.921851+0000","last_clean":"2023-11-28T17:40:27.921851+0000","last_became_active":"2023-11-28T17:40:26.937922+0000","last_became_peered":"2023-11-28T17:40:26.937922+0000","last_unstale":"2023-11-28T17:40:27.921851+0000","last_undegraded":"2023-11-28T17:40:27.921851+0000","last_fullsized":"2023-11-28T17:40:27.921851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:10.338401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935682+0000","last_change":"2023-11-28T17:40:27.944600+0000","last_active":"2023-11-28T17:40:28.935682+0000","last_peered":"2023-11-28T17:40:28.935682+0000","last_clean":"2023-11-28T17:40:28.935682+0000","last_became_active":"2023-11-28T17:40:27.944295+0000","last_became_peered":"2023-11-28T17:40:27.944295+0000","last_unstale":"2023-11-28T17:40:28.935682+0000","last_undegraded":"2023-11-28T17:40:28.935682+0000","last_fullsized":"2023-11-28T17:40:28.935682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:00.453594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940214+0000","last_change":"2023-11-28T17:40:26.940626+0000","last_active":"2023-11-28T17:40:28.940214+0000","last_peered":"2023-11-28T17:40:28.940214+0000","last_clean":"2023-11-28T17:40:28.940214+0000","last_became_active":"2023-11-28T17:40:26.938026+0000","last_became_peered":"2023-11-28T17:40:26.938026+0000","last_unstale":"2023-11-28T17:40:28.940214+0000","last_undegraded":"2023-11-28T17:40:28.940214+0000","last_fullsized":"2023-11-28T17:40:28.940214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:56.702406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935998+0000","last_change":"2023-11-28T17:40:27.933249+0000","last_active":"2023-11-28T17:40:28.935998+0000","last_peered":"2023-11-28T17:40:28.935998+0000","last_clean":"2023-11-28T17:40:28.935998+0000","last_became_active":"2023-11-28T17:40:27.932961+0000","last_became_peered":"2023-11-28T17:40:27.932961+0000","last_unstale":"2023-11-28T17:40:28.935998+0000","last_undegraded":"2023-11-28T17:40:28.935998+0000","last_fullsized":"2023-11-28T17:40:28.935998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:01.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940599+0000","last_change":"2023-11-28T17:40:26.939525+0000","last_active":"2023-11-28T17:40:28.940599+0000","last_peered":"2023-11-28T17:40:28.940599+0000","last_clean":"2023-11-28T17:40:28.940599+0000","last_became_active":"2023-11-28T17:40:26.939241+0000","last_became_peered":"2023-11-28T17:40:26.939241+0000","last_unstale":"2023-11-28T17:40:28.940599+0000","last_undegraded":"2023-11-28T17:40:28.940599+0000","last_fullsized":"2023-11-28T17:40:28.940599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:34:33.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975332+0000","last_change":"2023-11-28T17:40:27.932349+0000","last_active":"2023-11-28T17:40:28.975332+0000","last_peered":"2023-11-28T17:40:28.975332+0000","last_clean":"2023-11-28T17:40:28.975332+0000","last_became_active":"2023-11-28T17:40:27.930754+0000","last_became_peered":"2023-11-28T17:40:27.930754+0000","last_unstale":"2023-11-28T17:40:28.975332+0000","last_undegraded":"2023-11-28T17:40:28.975332+0000","last_fullsized":"2023-11-28T17:40:28.975332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:44.527346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951285+0000","last_change":"2023-11-28T17:40:26.931143+0000","last_active":"2023-11-28T17:40:27.951285+0000","last_peered":"2023-11-28T17:40:27.951285+0000","last_clean":"2023-11-28T17:40:27.951285+0000","last_became_active":"2023-11-28T17:40:26.930860+0000","last_became_peered":"2023-11-28T17:40:26.930860+0000","last_unstale":"2023-11-28T17:40:27.951285+0000","last_undegraded":"2023-11-28T17:40:27.951285+0000","last_fullsized":"2023-11-28T17:40:27.951285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:04:12.304015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940783+0000","last_change":"2023-11-28T17:40:27.935780+0000","last_active":"2023-11-28T17:40:28.940783+0000","last_peered":"2023-11-28T17:40:28.940783+0000","last_clean":"2023-11-28T17:40:28.940783+0000","last_became_active":"2023-11-28T17:40:27.935486+0000","last_became_peered":"2023-11-28T17:40:27.935486+0000","last_unstale":"2023-11-28T17:40:28.940783+0000","last_undegraded":"2023-11-28T17:40:28.940783+0000","last_fullsized":"2023-11-28T17:40:28.940783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.956347+0000","last_change":"2023-11-28T17:40:26.934185+0000","last_active":"2023-11-28T17:40:27.956347+0000","last_peered":"2023-11-28T17:40:27.956347+0000","last_clean":"2023-11-28T17:40:27.956347+0000","last_became_active":"2023-11-28T17:40:26.933685+0000","last_became_peered":"2023-11-28T17:40:26.933685+0000","last_unstale":"2023-11-28T17:40:27.956347+0000","last_undegraded":"2023-11-28T17:40:27.956347+0000","last_fullsized":"2023-11-28T17:40:27.956347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:13.155362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941245+0000","last_change":"2023-11-28T17:40:27.947556+0000","last_active":"2023-11-28T17:40:28.941245+0000","last_peered":"2023-11-28T17:40:28.941245+0000","last_clean":"2023-11-28T17:40:28.941245+0000","last_became_active":"2023-11-28T17:40:27.947021+0000","last_became_peered":"2023-11-28T17:40:27.947021+0000","last_unstale":"2023-11-28T17:40:28.941245+0000","last_undegraded":"2023-11-28T17:40:28.941245+0000","last_fullsized":"2023-11-28T17:40:28.941245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:42.830805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.917361+0000","last_change":"2023-11-28T17:40:26.933719+0000","last_active":"2023-11-28T17:40:27.917361+0000","last_peered":"2023-11-28T17:40:27.917361+0000","last_clean":"2023-11-28T17:40:27.917361+0000","last_became_active":"2023-11-28T17:40:26.932832+0000","last_became_peered":"2023-11-28T17:40:26.932832+0000","last_unstale":"2023-11-28T17:40:27.917361+0000","last_undegraded":"2023-11-28T17:40:27.917361+0000","last_fullsized":"2023-11-28T17:40:27.917361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:23.182794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106367+0000","last_change":"2023-11-28T17:40:27.943358+0000","last_active":"2023-11-28T17:40:30.106367+0000","last_peered":"2023-11-28T17:40:30.106367+0000","last_clean":"2023-11-28T17:40:30.106367+0000","last_became_active":"2023-11-28T17:40:27.943032+0000","last_became_peered":"2023-11-28T17:40:27.943032+0000","last_unstale":"2023-11-28T17:40:30.106367+0000","last_undegraded":"2023-11-28T17:40:30.106367+0000","last_fullsized":"2023-11-28T17:40:30.106367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:11.345803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951408+0000","last_change":"2023-11-28T17:40:26.932256+0000","last_active":"2023-11-28T17:40:27.951408+0000","last_peered":"2023-11-28T17:40:27.951408+0000","last_clean":"2023-11-28T17:40:27.951408+0000","last_became_active":"2023-11-28T17:40:26.931963+0000","last_became_peered":"2023-11-28T17:40:26.931963+0000","last_unstale":"2023-11-28T17:40:27.951408+0000","last_undegraded":"2023-11-28T17:40:27.951408+0000","last_fullsized":"2023-11-28T17:40:27.951408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:10.338401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941041+0000","last_change":"2023-11-28T17:40:27.948756+0000","last_active":"2023-11-28T17:40:28.941041+0000","last_peered":"2023-11-28T17:40:28.941041+0000","last_clean":"2023-11-28T17:40:28.941041+0000","last_became_active":"2023-11-28T17:40:27.948477+0000","last_became_peered":"2023-11-28T17:40:27.948477+0000","last_unstale":"2023-11-28T17:40:28.941041+0000","last_undegraded":"2023-11-28T17:40:28.941041+0000","last_fullsized":"2023-11-28T17:40:28.941041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.936202+0000","last_change":"2023-11-28T17:40:26.931177+0000","last_active":"2023-11-28T17:40:27.936202+0000","last_peered":"2023-11-28T17:40:27.936202+0000","last_clean":"2023-11-28T17:40:27.936202+0000","last_became_active":"2023-11-28T17:40:26.930885+0000","last_became_peered":"2023-11-28T17:40:26.930885+0000","last_unstale":"2023-11-28T17:40:27.936202+0000","last_undegraded":"2023-11-28T17:40:27.936202+0000","last_fullsized":"2023-11-28T17:40:27.936202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:09.133492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106076+0000","last_change":"2023-11-28T17:40:27.952232+0000","last_active":"2023-11-28T17:40:30.106076+0000","last_peered":"2023-11-28T17:40:30.106076+0000","last_clean":"2023-11-28T17:40:30.106076+0000","last_became_active":"2023-11-28T17:40:27.951907+0000","last_became_peered":"2023-11-28T17:40:27.951907+0000","last_unstale":"2023-11-28T17:40:30.106076+0000","last_undegraded":"2023-11-28T17:40:30.106076+0000","last_fullsized":"2023-11-28T17:40:30.106076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:24.190196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.918883+0000","last_change":"2023-11-28T17:40:26.946081+0000","last_active":"2023-11-28T17:40:27.918883+0000","last_peered":"2023-11-28T17:40:27.918883+0000","last_clean":"2023-11-28T17:40:27.918883+0000","last_became_active":"2023-11-28T17:40:26.945847+0000","last_became_peered":"2023-11-28T17:40:26.945847+0000","last_unstale":"2023-11-28T17:40:27.918883+0000","last_undegraded":"2023-11-28T17:40:27.918883+0000","last_fullsized":"2023-11-28T17:40:27.918883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:28.336537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975115+0000","last_change":"2023-11-28T17:40:27.925069+0000","last_active":"2023-11-28T17:40:28.975115+0000","last_peered":"2023-11-28T17:40:28.975115+0000","last_clean":"2023-11-28T17:40:28.975115+0000","last_became_active":"2023-11-28T17:40:27.924556+0000","last_became_peered":"2023-11-28T17:40:27.924556+0000","last_unstale":"2023-11-28T17:40:28.975115+0000","last_undegraded":"2023-11-28T17:40:28.975115+0000","last_fullsized":"2023-11-28T17:40:28.975115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:49.294183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.925235+0000","last_change":"2023-11-28T17:40:26.931615+0000","last_active":"2023-11-28T17:40:27.925235+0000","last_peered":"2023-11-28T17:40:27.925235+0000","last_clean":"2023-11-28T17:40:27.925235+0000","last_became_active":"2023-11-28T17:40:26.931265+0000","last_became_peered":"2023-11-28T17:40:26.931265+0000","last_unstale":"2023-11-28T17:40:27.925235+0000","last_undegraded":"2023-11-28T17:40:27.925235+0000","last_fullsized":"2023-11-28T17:40:27.925235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:00.498563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940561+0000","last_change":"2023-11-28T17:40:27.952115+0000","last_active":"2023-11-28T17:40:28.940561+0000","last_peered":"2023-11-28T17:40:28.940561+0000","last_clean":"2023-11-28T17:40:28.940561+0000","last_became_active":"2023-11-28T17:40:27.951381+0000","last_became_peered":"2023-11-28T17:40:27.951381+0000","last_unstale":"2023-11-28T17:40:28.940561+0000","last_undegraded":"2023-11-28T17:40:28.940561+0000","last_fullsized":"2023-11-28T17:40:28.940561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:42:21.105746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951085+0000","last_change":"2023-11-28T17:40:26.939295+0000","last_active":"2023-11-28T17:40:27.951085+0000","last_peered":"2023-11-28T17:40:27.951085+0000","last_clean":"2023-11-28T17:40:27.951085+0000","last_became_active":"2023-11-28T17:40:26.938074+0000","last_became_peered":"2023-11-28T17:40:26.938074+0000","last_unstale":"2023-11-28T17:40:27.951085+0000","last_undegraded":"2023-11-28T17:40:27.951085+0000","last_fullsized":"2023-11-28T17:40:27.951085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:09.133492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935942+0000","last_change":"2023-11-28T17:40:27.950731+0000","last_active":"2023-11-28T17:40:28.935942+0000","last_peered":"2023-11-28T17:40:28.935942+0000","last_clean":"2023-11-28T17:40:28.935942+0000","last_became_active":"2023-11-28T17:40:27.949604+0000","last_became_peered":"2023-11-28T17:40:27.949604+0000","last_unstale":"2023-11-28T17:40:28.935942+0000","last_undegraded":"2023-11-28T17:40:28.935942+0000","last_fullsized":"2023-11-28T17:40:28.935942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:05.741714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941483+0000","last_change":"2023-11-28T17:40:26.927541+0000","last_active":"2023-11-28T17:40:28.941483+0000","last_peered":"2023-11-28T17:40:28.941483+0000","last_clean":"2023-11-28T17:40:28.941483+0000","last_became_active":"2023-11-28T17:40:26.926798+0000","last_became_peered":"2023-11-28T17:40:26.926798+0000","last_unstale":"2023-11-28T17:40:28.941483+0000","last_undegraded":"2023-11-28T17:40:28.941483+0000","last_fullsized":"2023-11-28T17:40:28.941483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:13.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941395+0000","last_change":"2023-11-28T17:40:27.964200+0000","last_active":"2023-11-28T17:40:28.941395+0000","last_peered":"2023-11-28T17:40:28.941395+0000","last_clean":"2023-11-28T17:40:28.941395+0000","last_became_active":"2023-11-28T17:40:27.963801+0000","last_became_peered":"2023-11-28T17:40:27.963801+0000","last_unstale":"2023-11-28T17:40:28.941395+0000","last_undegraded":"2023-11-28T17:40:28.941395+0000","last_fullsized":"2023-11-28T17:40:28.941395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:56:29.022310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.930045+0000","last_change":"2023-11-28T17:40:26.929535+0000","last_active":"2023-11-28T17:40:27.930045+0000","last_peered":"2023-11-28T17:40:27.930045+0000","last_clean":"2023-11-28T17:40:27.930045+0000","last_became_active":"2023-11-28T17:40:26.929195+0000","last_became_peered":"2023-11-28T17:40:26.929195+0000","last_unstale":"2023-11-28T17:40:27.930045+0000","last_undegraded":"2023-11-28T17:40:27.930045+0000","last_fullsized":"2023-11-28T17:40:27.930045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:48.337820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215994+0000","last_change":"2023-11-28T17:40:27.950605+0000","last_active":"2023-11-28T17:40:29.215994+0000","last_peered":"2023-11-28T17:40:29.215994+0000","last_clean":"2023-11-28T17:40:29.215994+0000","last_became_active":"2023-11-28T17:40:27.950249+0000","last_became_peered":"2023-11-28T17:40:27.950249+0000","last_unstale":"2023-11-28T17:40:29.215994+0000","last_undegraded":"2023-11-28T17:40:29.215994+0000","last_fullsized":"2023-11-28T17:40:29.215994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.937353+0000","last_change":"2023-11-28T17:40:26.938080+0000","last_active":"2023-11-28T17:40:27.937353+0000","last_peered":"2023-11-28T17:40:27.937353+0000","last_clean":"2023-11-28T17:40:27.937353+0000","last_became_active":"2023-11-28T17:40:26.937738+0000","last_became_peered":"2023-11-28T17:40:26.937738+0000","last_unstale":"2023-11-28T17:40:27.937353+0000","last_undegraded":"2023-11-28T17:40:27.937353+0000","last_fullsized":"2023-11-28T17:40:27.937353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:58.337146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107335+0000","last_change":"2023-11-28T17:40:27.954352+0000","last_active":"2023-11-28T17:40:30.107335+0000","last_peered":"2023-11-28T17:40:30.107335+0000","last_clean":"2023-11-28T17:40:30.107335+0000","last_became_active":"2023-11-28T17:40:27.954059+0000","last_became_peered":"2023-11-28T17:40:27.954059+0000","last_unstale":"2023-11-28T17:40:30.107335+0000","last_undegraded":"2023-11-28T17:40:30.107335+0000","last_fullsized":"2023-11-28T17:40:30.107335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:38.101907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.927949+0000","last_change":"2023-11-28T17:40:26.931119+0000","last_active":"2023-11-28T17:40:27.927949+0000","last_peered":"2023-11-28T17:40:27.927949+0000","last_clean":"2023-11-28T17:40:27.927949+0000","last_became_active":"2023-11-28T17:40:26.930806+0000","last_became_peered":"2023-11-28T17:40:26.930806+0000","last_unstale":"2023-11-28T17:40:27.927949+0000","last_undegraded":"2023-11-28T17:40:27.927949+0000","last_fullsized":"2023-11-28T17:40:27.927949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:17.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106858+0000","last_change":"2023-11-28T17:40:27.937688+0000","last_active":"2023-11-28T17:40:30.106858+0000","last_peered":"2023-11-28T17:40:30.106858+0000","last_clean":"2023-11-28T17:40:30.106858+0000","last_became_active":"2023-11-28T17:40:27.937334+0000","last_became_peered":"2023-11-28T17:40:27.937334+0000","last_unstale":"2023-11-28T17:40:30.106858+0000","last_undegraded":"2023-11-28T17:40:30.106858+0000","last_fullsized":"2023-11-28T17:40:30.106858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.940788+0000","last_change":"2023-11-28T17:40:26.932477+0000","last_active":"2023-11-28T17:40:27.940788+0000","last_peered":"2023-11-28T17:40:27.940788+0000","last_clean":"2023-11-28T17:40:27.940788+0000","last_became_active":"2023-11-28T17:40:26.930810+0000","last_became_peered":"2023-11-28T17:40:26.930810+0000","last_unstale":"2023-11-28T17:40:27.940788+0000","last_undegraded":"2023-11-28T17:40:27.940788+0000","last_fullsized":"2023-11-28T17:40:27.940788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:23.182794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935711+0000","last_change":"2023-11-28T17:40:27.949096+0000","last_active":"2023-11-28T17:40:28.935711+0000","last_peered":"2023-11-28T17:40:28.935711+0000","last_clean":"2023-11-28T17:40:28.935711+0000","last_became_active":"2023-11-28T17:40:27.948781+0000","last_became_peered":"2023-11-28T17:40:27.948781+0000","last_unstale":"2023-11-28T17:40:28.935711+0000","last_undegraded":"2023-11-28T17:40:28.935711+0000","last_fullsized":"2023-11-28T17:40:28.935711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:28.966721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.920356+0000","last_change":"2023-11-28T17:40:26.937241+0000","last_active":"2023-11-28T17:40:27.920356+0000","last_peered":"2023-11-28T17:40:27.920356+0000","last_clean":"2023-11-28T17:40:27.920356+0000","last_became_active":"2023-11-28T17:40:26.936877+0000","last_became_peered":"2023-11-28T17:40:26.936877+0000","last_unstale":"2023-11-28T17:40:27.920356+0000","last_undegraded":"2023-11-28T17:40:27.920356+0000","last_fullsized":"2023-11-28T17:40:27.920356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216241+0000","last_change":"2023-11-28T17:40:27.949193+0000","last_active":"2023-11-28T17:40:29.216241+0000","last_peered":"2023-11-28T17:40:29.216241+0000","last_clean":"2023-11-28T17:40:29.216241+0000","last_became_active":"2023-11-28T17:40:27.948365+0000","last_became_peered":"2023-11-28T17:40:27.948365+0000","last_unstale":"2023-11-28T17:40:29.216241+0000","last_undegraded":"2023-11-28T17:40:29.216241+0000","last_fullsized":"2023-11-28T17:40:29.216241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.935153+0000","last_change":"2023-11-28T17:40:26.933957+0000","last_active":"2023-11-28T17:40:27.935153+0000","last_peered":"2023-11-28T17:40:27.935153+0000","last_clean":"2023-11-28T17:40:27.935153+0000","last_became_active":"2023-11-28T17:40:26.933214+0000","last_became_peered":"2023-11-28T17:40:26.933214+0000","last_unstale":"2023-11-28T17:40:27.935153+0000","last_undegraded":"2023-11-28T17:40:27.935153+0000","last_fullsized":"2023-11-28T17:40:27.935153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:37.055697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.920809+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:40:27.920809+0000","last_peered":"2023-11-28T17:40:27.920809+0000","last_clean":"2023-11-28T17:40:27.920809+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:40:27.920809+0000","last_undegraded":"2023-11-28T17:40:27.920809+0000","last_fullsized":"2023-11-28T17:40:27.920809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.75},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.492,"5min":7.492,"15min":7.492},"last":0.55700000000000005}]},{"osd":1,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":0.623},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.70799999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.81299999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.65400000000000003}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":153074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":5.6840000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":0.871}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.754},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52900000000000003}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.62},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.69799999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":152216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.6779999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":5.3780000000000001,"5min":5.3780000000000001,"15min":5.3780000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.40500000000000003}]},{"osd":4,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.7640000000000002,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.56499999999999995}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.70499999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":8.3149999999999995,"5min":8.3149999999999995,"15min":8.3149999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.72699999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.502}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.67800000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":741878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.37},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.314}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41199999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.50800000000000001}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.54700000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.371},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.41799999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71199999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73599999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.499},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.754}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:40:32.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T17:40:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 Processor -- start 2023-11-28T17:40:33.010 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 -- start start 2023-11-28T17:40:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68c415d540 0x7f68c40b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f68c40d1f50 0x7f68c40d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c40b32c0 con 0x7f68c40d34c0 2023-11-28T17:40:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c415d920 con 0x7f68c415d540 2023-11-28T17:40:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68ca432640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40b35a0 con 0x7f68c40d1f50 2023-11-28T17:40:33.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c3fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f68c415d540 0x7f68c40b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c89cf640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f68c40d34c0 0x7f68c40cfbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:49794/0 (socket says 172.21.15.16:49794) 2023-11-28T17:40:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c89cf640 1 -- 172.21.15.16:0/583642125 learned_addr learned my addr 172.21.15.16:0/583642125 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c37fe640 1 --2- 172.21.15.16:0/583642125 >> v2:172.21.15.64:3300/0 conn(0x7f68c40d1f50 0x7f68c40d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c3fff640 1 -- 172.21.15.16:0/583642125 >> v2:172.21.15.64:3300/0 conn(0x7f68c40d1f50 msgr2=0x7f68c40d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c3fff640 1 --2- 172.21.15.16:0/583642125 >> v2:172.21.15.64:3300/0 conn(0x7f68c40d1f50 0x7f68c40d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.012 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c3fff640 1 -- 172.21.15.16:0/583642125 >> v1:172.21.15.16:6789/0 conn(0x7f68c40d34c0 legacy=0x7f68c40cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c3fff640 1 -- 172.21.15.16:0/583642125 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40b3880 con 0x7f68c415d540 2023-11-28T17:40:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c2ffd640 1 -- 172.21.15.16:0/583642125 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678675779 0 0) 0x7f68c40b32c0 con 0x7f68c40d34c0 2023-11-28T17:40:33.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.006+0000 7f68c37fe640 1 --2- 172.21.15.16:0/583642125 >> v2:172.21.15.64:3300/0 conn(0x7f68c40d1f50 0x7f68c40d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:33.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68c3fff640 1 --2- 172.21.15.16:0/583642125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c40b29c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f68c408d6e0 tx=0x7f68b401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5439e5367908823f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68c2ffd640 1 -- 172.21.15.16:0/583642125 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40a7070 con 0x7f68c415d540 2023-11-28T17:40:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68c2ffd640 1 -- 172.21.15.16:0/583642125 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b40ab430 con 0x7f68c415d540 2023-11-28T17:40:33.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68c2ffd640 1 -- 172.21.15.16:0/583642125 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b40ab7c0 con 0x7f68c415d540 2023-11-28T17:40:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 -- 172.21.15.16:0/583642125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 msgr2=0x7f68c40b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.016 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 --2- 172.21.15.16:0/583642125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c40b29c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f68c408d6e0 tx=0x7f68b401c430 comp rx=0 tx=0).stop 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 -- 172.21.15.16:0/583642125 shutdown_connections 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 --2- 172.21.15.16:0/583642125 >> v2:172.21.15.64:3300/0 conn(0x7f68c40d1f50 0x7f68c40d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 --2- 172.21.15.16:0/583642125 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c40b29c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 -- 172.21.15.16:0/583642125 >> 172.21.15.16:0/583642125 conn(0x7f68c408ccf0 msgr2=0x7f68c409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 -- 172.21.15.16:0/583642125 shutdown_connections 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.010+0000 7f68ca432640 1 -- 172.21.15.16:0/583642125 wait complete. 2023-11-28T17:40:33.017 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 Processor -- start 2023-11-28T17:40:33.018 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 -- start start 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c40d1f50 0x7f68c415e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68c40d34c0 0x7f68c415c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c415c3c0 con 0x7f68c415d540 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c415e2e0 con 0x7f68c40d1f50 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c414e460 con 0x7f68c40d34c0 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c414c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37772/0 (socket says 172.21.15.16:37772) 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 -- 172.21.15.16:0/2901606108 learned_addr learned my addr 172.21.15.16:0/2901606108 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c3fff640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c40d1f50 0x7f68c415e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.020 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c37fe640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68c40d34c0 0x7f68c415c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 -- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68c40d34c0 msgr2=0x7f68c415c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68c40d34c0 0x7f68c415c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 -- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c40d1f50 msgr2=0x7f68c415e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c40d1f50 0x7f68c415e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 -- 172.21.15.16:0/2901606108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009420 con 0x7f68c415d540 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c89cf640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c414c0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68bc001570 tx=0x7f68bc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00a640 con 0x7f68c415d540 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00a7c0 con 0x7f68c415d540 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c415ce90 con 0x7f68c415d540 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00ab70 con 0x7f68c415d540 2023-11-28T17:40:33.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.014+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c415dc20 con 0x7f68c415d540 2023-11-28T17:40:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.018+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c415e420 con 0x7f68c415d540 2023-11-28T17:40:33.022 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.018+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f68bc00acd0 con 0x7f68c415d540 2023-11-28T17:40:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.018+0000 7f68c0ff9640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f68b00668d0 0x7f68b0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.018+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68bc083c80 con 0x7f68c415d540 2023-11-28T17:40:33.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.018+0000 7f68c3fff640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f68b00668d0 0x7f68b0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.024 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.018+0000 7f68c3fff640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f68b00668d0 0x7f68b0068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68b40af000 tx=0x7f68b40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:33.027 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.022+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68c415e420 con 0x7f68c415d540 2023-11-28T17:40:33.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.230+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f68c415e420 con 0x7f68c415d540 2023-11-28T17:40:33.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68c0ff9640 1 -- 172.21.15.16:0/2901606108 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1559 (secure 0 0 0) 0x7f68c415e420 con 0x7f68c415d540 2023-11-28T17:40:33.237 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:33.237 INFO:teuthology.orchestra.run.smithi016.stdout:{"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":83,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1701193161,"num_in_osds":8,"osd_in_since":1701193152,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":238497792,"bytes_avail":772855615488,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5055}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-11-28T17:40:22.776055+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T17:40:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f68b00668d0 msgr2=0x7f68b0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f68b00668d0 0x7f68b0068d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f68b40af000 tx=0x7f68b40a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 msgr2=0x7f68c414c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c414c0b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f68bc001570 tx=0x7f68bc00cca0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 shutdown_connections 2023-11-28T17:40:33.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f68c415d540 0x7f68c414c0b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f68c40d34c0 0x7f68c415c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f68b00668d0 0x7f68b0068d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 --2- 172.21.15.16:0/2901606108 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f68c40d1f50 0x7f68c415e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 >> 172.21.15.16:0/2901606108 conn(0x7f68c408ccf0 msgr2=0x7f68c40b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 shutdown_connections 2023-11-28T17:40:33.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.234+0000 7f68ca432640 1 -- 172.21.15.16:0/2901606108 wait complete. 2023-11-28T17:40:33.258 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T17:40:33.259 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:40:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 Processor -- start 2023-11-28T17:40:33.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 -- start start 2023-11-28T17:40:33.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f215015d540 0x7f21500b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d1f50 0x7f21500d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21500b32c0 con 0x7f21500d34c0 2023-11-28T17:40:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215015d920 con 0x7f215015d540 2023-11-28T17:40:33.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2157e46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b35a0 con 0x7f21500d1f50 2023-11-28T17:40:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2155be2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f215015d540 0x7f21500b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21553e1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d1f50 0x7f21500d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21563e3640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f21500d34c0 0x7f21500cfbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:58716/0 (socket says 172.21.15.16:58716) 2023-11-28T17:40:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21563e3640 1 -- 172.21.15.16:0/187033382 learned_addr learned my addr 172.21.15.16:0/187033382 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:33.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21553e1640 1 -- 172.21.15.16:0/187033382 >> v2:172.21.15.64:3300/0 conn(0x7f215015d540 msgr2=0x7f21500b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21553e1640 1 --2- 172.21.15.16:0/187033382 >> v2:172.21.15.64:3300/0 conn(0x7f215015d540 0x7f21500b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21553e1640 1 -- 172.21.15.16:0/187033382 >> v1:172.21.15.64:6789/0 conn(0x7f21500d34c0 legacy=0x7f21500cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f21553e1640 1 -- 172.21.15.16:0/187033382 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500b3880 con 0x7f21500d1f50 2023-11-28T17:40:33.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.398+0000 7f2155be2640 1 --2- 172.21.15.16:0/187033382 >> v2:172.21.15.64:3300/0 conn(0x7f215015d540 0x7f21500b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:33.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f21553e1640 1 --2- 172.21.15.16:0/187033382 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d1f50 0x7f21500d2f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21400097c0 tx=0x7f214001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff440178166cee4f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2154be0640 1 -- 172.21.15.16:0/187033382 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400ab650 con 0x7f21500d1f50 2023-11-28T17:40:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2154be0640 1 -- 172.21.15.16:0/187033382 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21400ab7b0 con 0x7f21500d1f50 2023-11-28T17:40:33.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2154be0640 1 -- 172.21.15.16:0/187033382 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21400abb40 con 0x7f21500d1f50 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 -- 172.21.15.16:0/187033382 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d1f50 msgr2=0x7f21500d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 --2- 172.21.15.16:0/187033382 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d1f50 0x7f21500d2f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21400097c0 tx=0x7f214001c450 comp rx=0 tx=0).stop 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 -- 172.21.15.16:0/187033382 shutdown_connections 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 --2- 172.21.15.16:0/187033382 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d1f50 0x7f21500d2f80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 --2- 172.21.15.16:0/187033382 >> v2:172.21.15.64:3300/0 conn(0x7f215015d540 0x7f21500b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 -- 172.21.15.16:0/187033382 >> 172.21.15.16:0/187033382 conn(0x7f215008ccf0 msgr2=0x7f215009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 -- 172.21.15.16:0/187033382 shutdown_connections 2023-11-28T17:40:33.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.402+0000 7f2157e46640 1 -- 172.21.15.16:0/187033382 wait complete. 2023-11-28T17:40:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 Processor -- start 2023-11-28T17:40:33.409 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 -- start start 2023-11-28T17:40:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 0x7f21500ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d34c0 0x7f21500b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f215015d540 0x7f215015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215015da60 con 0x7f21500d1f50 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b78f0 con 0x7f215015d540 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21500b7bd0 con 0x7f21500d34c0 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 0x7f21500ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 0x7f21500ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37782/0 (socket says 172.21.15.16:37782) 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 -- 172.21.15.16:0/2339275669 learned_addr learned my addr 172.21.15.16:0/2339275669 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f21553e1640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d34c0 0x7f21500b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f21563e3640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f215015d540 0x7f215015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 -- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d34c0 msgr2=0x7f21500b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d34c0 0x7f21500b6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 -- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f215015d540 msgr2=0x7f215015deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f215015d540 0x7f215015deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 -- 172.21.15.16:0/2339275669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c009420 con 0x7f21500d1f50 2023-11-28T17:40:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2155be2640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 0x7f21500ccbd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f214c00e980 tx=0x7f214c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:33.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00ca00 con 0x7f21500d1f50 2023-11-28T17:40:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00cb60 con 0x7f21500d1f50 2023-11-28T17:40:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2140009420 con 0x7f21500d1f50 2023-11-28T17:40:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c013470 con 0x7f21500d1f50 2023-11-28T17:40:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.406+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21500b8190 con 0x7f21500d1f50 2023-11-28T17:40:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.410+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2150068860 con 0x7f21500d1f50 2023-11-28T17:40:33.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.410+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f214c0135d0 con 0x7f21500d1f50 2023-11-28T17:40:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.410+0000 7f21467fc640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21340668d0 0x7f2134068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.410+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f214c084600 con 0x7f21500d1f50 2023-11-28T17:40:33.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.410+0000 7f21553e1640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21340668d0 0x7f2134068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:33.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.410+0000 7f21553e1640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21340668d0 0x7f2134068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21400af000 tx=0x7f21400a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:33.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.414+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f214c0518f0 con 0x7f21500d1f50 2023-11-28T17:40:33.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.566+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2150169ff0 con 0x7f21340668d0 2023-11-28T17:40:33.581 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f21467fc640 1 -- 172.21.15.16:0/2339275669 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288780 (secure 0 0 0) 0x7f21400ab920 con 0x7f21340668d0 2023-11-28T17:40:33.584 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:33.585 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:40:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21340668d0 msgr2=0x7f2134068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.586 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21340668d0 0x7f2134068d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f21400af000 tx=0x7f21400a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 msgr2=0x7f21500ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 0x7f21500ccbd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f214c00e980 tx=0x7f214c00ee40 comp rx=0 tx=0).stop 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 shutdown_connections 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21340668d0 0x7f2134068d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f215015d540 0x7f215015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21500d34c0 0x7f21500b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 --2- 172.21.15.16:0/2339275669 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21500d1f50 0x7f21500ccbd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.578+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 >> 172.21.15.16:0/2339275669 conn(0x7f215008ccf0 msgr2=0x7f21500b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.582+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 shutdown_connections 2023-11-28T17:40:33.587 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:33.582+0000 7f2157e46640 1 -- 172.21.15.16:0/2339275669 wait complete. 2023-11-28T17:40:33.606 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-11-28T17:40:32.778093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":173,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232908,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741812,"statfs":{"total":773094113280,"available":772855615488,"internally_reserved":0,"allocated":4366336,"data_stored":2397076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001365"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107018+0000","last_change":"2023-11-28T17:40:27.947483+0000","last_active":"2023-11-28T17:40:30.107018+0000","last_peered":"2023-11-28T17:40:30.107018+0000","last_clean":"2023-11-28T17:40:30.107018+0000","last_became_active":"2023-11-28T17:40:27.947107+0000","last_became_peered":"2023-11-28T17:40:27.947107+0000","last_unstale":"2023-11-28T17:40:30.107018+0000","last_undegraded":"2023-11-28T17:40:30.107018+0000","last_fullsized":"2023-11-28T17:40:30.107018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941379+0000","last_change":"2023-11-28T17:40:27.938381+0000","last_active":"2023-11-28T17:40:28.941379+0000","last_peered":"2023-11-28T17:40:28.941379+0000","last_clean":"2023-11-28T17:40:28.941379+0000","last_became_active":"2023-11-28T17:40:27.938067+0000","last_became_peered":"2023-11-28T17:40:27.938067+0000","last_unstale":"2023-11-28T17:40:28.941379+0000","last_undegraded":"2023-11-28T17:40:28.941379+0000","last_fullsized":"2023-11-28T17:40:28.941379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975059+0000","last_change":"2023-11-28T17:40:27.935238+0000","last_active":"2023-11-28T17:40:28.975059+0000","last_peered":"2023-11-28T17:40:28.975059+0000","last_clean":"2023-11-28T17:40:28.975059+0000","last_became_active":"2023-11-28T17:40:27.934884+0000","last_became_peered":"2023-11-28T17:40:27.934884+0000","last_unstale":"2023-11-28T17:40:28.975059+0000","last_undegraded":"2023-11-28T17:40:28.975059+0000","last_fullsized":"2023-11-28T17:40:28.975059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:02.431496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107163+0000","last_change":"2023-11-28T17:40:27.952280+0000","last_active":"2023-11-28T17:40:30.107163+0000","last_peered":"2023-11-28T17:40:30.107163+0000","last_clean":"2023-11-28T17:40:30.107163+0000","last_became_active":"2023-11-28T17:40:27.951937+0000","last_became_peered":"2023-11-28T17:40:27.951937+0000","last_unstale":"2023-11-28T17:40:30.107163+0000","last_undegraded":"2023-11-28T17:40:30.107163+0000","last_fullsized":"2023-11-28T17:40:30.107163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:22.497701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940895+0000","last_change":"2023-11-28T17:40:27.957901+0000","last_active":"2023-11-28T17:40:28.940895+0000","last_peered":"2023-11-28T17:40:28.940895+0000","last_clean":"2023-11-28T17:40:28.940895+0000","last_became_active":"2023-11-28T17:40:27.957453+0000","last_became_peered":"2023-11-28T17:40:27.957453+0000","last_unstale":"2023-11-28T17:40:28.940895+0000","last_undegraded":"2023-11-28T17:40:28.940895+0000","last_fullsized":"2023-11-28T17:40:28.940895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940923+0000","last_change":"2023-11-28T17:40:27.959407+0000","last_active":"2023-11-28T17:40:28.940923+0000","last_peered":"2023-11-28T17:40:28.940923+0000","last_clean":"2023-11-28T17:40:28.940923+0000","last_became_active":"2023-11-28T17:40:27.959094+0000","last_became_peered":"2023-11-28T17:40:27.959094+0000","last_unstale":"2023-11-28T17:40:28.940923+0000","last_undegraded":"2023-11-28T17:40:28.940923+0000","last_fullsized":"2023-11-28T17:40:28.940923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:51.344460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107288+0000","last_change":"2023-11-28T17:40:27.948384+0000","last_active":"2023-11-28T17:40:30.107288+0000","last_peered":"2023-11-28T17:40:30.107288+0000","last_clean":"2023-11-28T17:40:30.107288+0000","last_became_active":"2023-11-28T17:40:27.941068+0000","last_became_peered":"2023-11-28T17:40:27.941068+0000","last_unstale":"2023-11-28T17:40:30.107288+0000","last_undegraded":"2023-11-28T17:40:30.107288+0000","last_fullsized":"2023-11-28T17:40:30.107288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106675+0000","last_change":"2023-11-28T17:40:27.955864+0000","last_active":"2023-11-28T17:40:30.106675+0000","last_peered":"2023-11-28T17:40:30.106675+0000","last_clean":"2023-11-28T17:40:30.106675+0000","last_became_active":"2023-11-28T17:40:27.955297+0000","last_became_peered":"2023-11-28T17:40:27.955297+0000","last_unstale":"2023-11-28T17:40:30.106675+0000","last_undegraded":"2023-11-28T17:40:30.106675+0000","last_fullsized":"2023-11-28T17:40:30.106675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.206124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975285+0000","last_change":"2023-11-28T17:40:27.934768+0000","last_active":"2023-11-28T17:40:28.975285+0000","last_peered":"2023-11-28T17:40:28.975285+0000","last_clean":"2023-11-28T17:40:28.975285+0000","last_became_active":"2023-11-28T17:40:27.934424+0000","last_became_peered":"2023-11-28T17:40:27.934424+0000","last_unstale":"2023-11-28T17:40:28.975285+0000","last_undegraded":"2023-11-28T17:40:28.975285+0000","last_fullsized":"2023-11-28T17:40:28.975285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:18.569746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107428+0000","last_change":"2023-11-28T17:40:27.939238+0000","last_active":"2023-11-28T17:40:30.107428+0000","last_peered":"2023-11-28T17:40:30.107428+0000","last_clean":"2023-11-28T17:40:30.107428+0000","last_became_active":"2023-11-28T17:40:27.938943+0000","last_became_peered":"2023-11-28T17:40:27.938943+0000","last_unstale":"2023-11-28T17:40:30.107428+0000","last_undegraded":"2023-11-28T17:40:30.107428+0000","last_fullsized":"2023-11-28T17:40:30.107428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:38.063099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936003+0000","last_change":"2023-11-28T17:40:27.943150+0000","last_active":"2023-11-28T17:40:28.936003+0000","last_peered":"2023-11-28T17:40:28.936003+0000","last_clean":"2023-11-28T17:40:28.936003+0000","last_became_active":"2023-11-28T17:40:27.942601+0000","last_became_peered":"2023-11-28T17:40:27.942601+0000","last_unstale":"2023-11-28T17:40:28.936003+0000","last_undegraded":"2023-11-28T17:40:28.936003+0000","last_fullsized":"2023-11-28T17:40:28.936003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:45.297173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975080+0000","last_change":"2023-11-28T17:40:27.959079+0000","last_active":"2023-11-28T17:40:28.975080+0000","last_peered":"2023-11-28T17:40:28.975080+0000","last_clean":"2023-11-28T17:40:28.975080+0000","last_became_active":"2023-11-28T17:40:27.958809+0000","last_became_peered":"2023-11-28T17:40:27.958809+0000","last_unstale":"2023-11-28T17:40:28.975080+0000","last_undegraded":"2023-11-28T17:40:28.975080+0000","last_fullsized":"2023-11-28T17:40:28.975080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:27.083860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106246+0000","last_change":"2023-11-28T17:40:27.951239+0000","last_active":"2023-11-28T17:40:30.106246+0000","last_peered":"2023-11-28T17:40:30.106246+0000","last_clean":"2023-11-28T17:40:30.106246+0000","last_became_active":"2023-11-28T17:40:27.950948+0000","last_became_peered":"2023-11-28T17:40:27.950948+0000","last_unstale":"2023-11-28T17:40:30.106246+0000","last_undegraded":"2023-11-28T17:40:30.106246+0000","last_fullsized":"2023-11-28T17:40:30.106246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:53.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106935+0000","last_change":"2023-11-28T17:40:27.940469+0000","last_active":"2023-11-28T17:40:30.106935+0000","last_peered":"2023-11-28T17:40:30.106935+0000","last_clean":"2023-11-28T17:40:30.106935+0000","last_became_active":"2023-11-28T17:40:27.940117+0000","last_became_peered":"2023-11-28T17:40:27.940117+0000","last_unstale":"2023-11-28T17:40:30.106935+0000","last_undegraded":"2023-11-28T17:40:30.106935+0000","last_fullsized":"2023-11-28T17:40:30.106935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216013+0000","last_change":"2023-11-28T17:40:27.950747+0000","last_active":"2023-11-28T17:40:29.216013+0000","last_peered":"2023-11-28T17:40:29.216013+0000","last_clean":"2023-11-28T17:40:29.216013+0000","last_became_active":"2023-11-28T17:40:27.950195+0000","last_became_peered":"2023-11-28T17:40:27.950195+0000","last_unstale":"2023-11-28T17:40:29.216013+0000","last_undegraded":"2023-11-28T17:40:29.216013+0000","last_fullsized":"2023-11-28T17:40:29.216013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215919+0000","last_change":"2023-11-28T17:40:27.951518+0000","last_active":"2023-11-28T17:40:29.215919+0000","last_peered":"2023-11-28T17:40:29.215919+0000","last_clean":"2023-11-28T17:40:29.215919+0000","last_became_active":"2023-11-28T17:40:27.951221+0000","last_became_peered":"2023-11-28T17:40:27.951221+0000","last_unstale":"2023-11-28T17:40:29.215919+0000","last_undegraded":"2023-11-28T17:40:29.215919+0000","last_fullsized":"2023-11-28T17:40:29.215919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935865+0000","last_change":"2023-11-28T17:40:27.946566+0000","last_active":"2023-11-28T17:40:28.935865+0000","last_peered":"2023-11-28T17:40:28.935865+0000","last_clean":"2023-11-28T17:40:28.935865+0000","last_became_active":"2023-11-28T17:40:27.946260+0000","last_became_peered":"2023-11-28T17:40:27.946260+0000","last_unstale":"2023-11-28T17:40:28.935865+0000","last_undegraded":"2023-11-28T17:40:28.935865+0000","last_fullsized":"2023-11-28T17:40:28.935865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:06.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940483+0000","last_change":"2023-11-28T17:40:27.952326+0000","last_active":"2023-11-28T17:40:28.940483+0000","last_peered":"2023-11-28T17:40:28.940483+0000","last_clean":"2023-11-28T17:40:28.940483+0000","last_became_active":"2023-11-28T17:40:27.951769+0000","last_became_peered":"2023-11-28T17:40:27.951769+0000","last_unstale":"2023-11-28T17:40:28.940483+0000","last_undegraded":"2023-11-28T17:40:28.940483+0000","last_fullsized":"2023-11-28T17:40:28.940483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:01:10.285439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941104+0000","last_change":"2023-11-28T17:40:27.947358+0000","last_active":"2023-11-28T17:40:28.941104+0000","last_peered":"2023-11-28T17:40:28.941104+0000","last_clean":"2023-11-28T17:40:28.941104+0000","last_became_active":"2023-11-28T17:40:27.946690+0000","last_became_peered":"2023-11-28T17:40:27.946690+0000","last_unstale":"2023-11-28T17:40:28.941104+0000","last_undegraded":"2023-11-28T17:40:28.941104+0000","last_fullsized":"2023-11-28T17:40:28.941104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:19.293511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106564+0000","last_change":"2023-11-28T17:40:27.956892+0000","last_active":"2023-11-28T17:40:30.106564+0000","last_peered":"2023-11-28T17:40:30.106564+0000","last_clean":"2023-11-28T17:40:30.106564+0000","last_became_active":"2023-11-28T17:40:27.956511+0000","last_became_peered":"2023-11-28T17:40:27.956511+0000","last_unstale":"2023-11-28T17:40:30.106564+0000","last_undegraded":"2023-11-28T17:40:30.106564+0000","last_fullsized":"2023-11-28T17:40:30.106564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216224+0000","last_change":"2023-11-28T17:40:27.954597+0000","last_active":"2023-11-28T17:40:29.216224+0000","last_peered":"2023-11-28T17:40:29.216224+0000","last_clean":"2023-11-28T17:40:29.216224+0000","last_became_active":"2023-11-28T17:40:27.954320+0000","last_became_peered":"2023-11-28T17:40:27.954320+0000","last_unstale":"2023-11-28T17:40:29.216224+0000","last_undegraded":"2023-11-28T17:40:29.216224+0000","last_fullsized":"2023-11-28T17:40:29.216224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106853+0000","last_change":"2023-11-28T17:40:27.954220+0000","last_active":"2023-11-28T17:40:30.106853+0000","last_peered":"2023-11-28T17:40:30.106853+0000","last_clean":"2023-11-28T17:40:30.106853+0000","last_became_active":"2023-11-28T17:40:27.953898+0000","last_became_peered":"2023-11-28T17:40:27.953898+0000","last_unstale":"2023-11-28T17:40:30.106853+0000","last_undegraded":"2023-11-28T17:40:30.106853+0000","last_fullsized":"2023-11-28T17:40:30.106853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106092+0000","last_change":"2023-11-28T17:40:27.948419+0000","last_active":"2023-11-28T17:40:30.106092+0000","last_peered":"2023-11-28T17:40:30.106092+0000","last_clean":"2023-11-28T17:40:30.106092+0000","last_became_active":"2023-11-28T17:40:27.948044+0000","last_became_peered":"2023-11-28T17:40:27.948044+0000","last_unstale":"2023-11-28T17:40:30.106092+0000","last_undegraded":"2023-11-28T17:40:30.106092+0000","last_fullsized":"2023-11-28T17:40:30.106092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.206124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106732+0000","last_change":"2023-11-28T17:40:27.954027+0000","last_active":"2023-11-28T17:40:30.106732+0000","last_peered":"2023-11-28T17:40:30.106732+0000","last_clean":"2023-11-28T17:40:30.106732+0000","last_became_active":"2023-11-28T17:40:27.953655+0000","last_became_peered":"2023-11-28T17:40:27.953655+0000","last_unstale":"2023-11-28T17:40:30.106732+0000","last_undegraded":"2023-11-28T17:40:30.106732+0000","last_fullsized":"2023-11-28T17:40:30.106732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:38:09.270172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107588+0000","last_change":"2023-11-28T17:40:27.936255+0000","last_active":"2023-11-28T17:40:30.107588+0000","last_peered":"2023-11-28T17:40:30.107588+0000","last_clean":"2023-11-28T17:40:30.107588+0000","last_became_active":"2023-11-28T17:40:27.935117+0000","last_became_peered":"2023-11-28T17:40:27.935117+0000","last_unstale":"2023-11-28T17:40:30.107588+0000","last_undegraded":"2023-11-28T17:40:30.107588+0000","last_fullsized":"2023-11-28T17:40:30.107588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.342955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107481+0000","last_change":"2023-11-28T17:40:27.938784+0000","last_active":"2023-11-28T17:40:30.107481+0000","last_peered":"2023-11-28T17:40:30.107481+0000","last_clean":"2023-11-28T17:40:30.107481+0000","last_became_active":"2023-11-28T17:40:27.935137+0000","last_became_peered":"2023-11-28T17:40:27.935137+0000","last_unstale":"2023-11-28T17:40:30.107481+0000","last_undegraded":"2023-11-28T17:40:30.107481+0000","last_fullsized":"2023-11-28T17:40:30.107481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:13.629735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940812+0000","last_change":"2023-11-28T17:40:27.946225+0000","last_active":"2023-11-28T17:40:28.940812+0000","last_peered":"2023-11-28T17:40:28.940812+0000","last_clean":"2023-11-28T17:40:28.940812+0000","last_became_active":"2023-11-28T17:40:27.943256+0000","last_became_peered":"2023-11-28T17:40:27.943256+0000","last_unstale":"2023-11-28T17:40:28.940812+0000","last_undegraded":"2023-11-28T17:40:28.940812+0000","last_fullsized":"2023-11-28T17:40:28.940812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107134+0000","last_change":"2023-11-28T17:40:27.957876+0000","last_active":"2023-11-28T17:40:30.107134+0000","last_peered":"2023-11-28T17:40:30.107134+0000","last_clean":"2023-11-28T17:40:30.107134+0000","last_became_active":"2023-11-28T17:40:27.957607+0000","last_became_peered":"2023-11-28T17:40:27.957607+0000","last_unstale":"2023-11-28T17:40:30.107134+0000","last_undegraded":"2023-11-28T17:40:30.107134+0000","last_fullsized":"2023-11-28T17:40:30.107134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216013+0000","last_change":"2023-11-28T17:40:27.939111+0000","last_active":"2023-11-28T17:40:29.216013+0000","last_peered":"2023-11-28T17:40:29.216013+0000","last_clean":"2023-11-28T17:40:29.216013+0000","last_became_active":"2023-11-28T17:40:27.938816+0000","last_became_peered":"2023-11-28T17:40:27.938816+0000","last_unstale":"2023-11-28T17:40:29.216013+0000","last_undegraded":"2023-11-28T17:40:29.216013+0000","last_fullsized":"2023-11-28T17:40:29.216013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215980+0000","last_change":"2023-11-28T17:40:27.938903+0000","last_active":"2023-11-28T17:40:29.215980+0000","last_peered":"2023-11-28T17:40:29.215980+0000","last_clean":"2023-11-28T17:40:29.215980+0000","last_became_active":"2023-11-28T17:40:27.938637+0000","last_became_peered":"2023-11-28T17:40:27.938637+0000","last_unstale":"2023-11-28T17:40:29.215980+0000","last_undegraded":"2023-11-28T17:40:29.215980+0000","last_fullsized":"2023-11-28T17:40:29.215980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106823+0000","last_change":"2023-11-28T17:40:27.955627+0000","last_active":"2023-11-28T17:40:30.106823+0000","last_peered":"2023-11-28T17:40:30.106823+0000","last_clean":"2023-11-28T17:40:30.106823+0000","last_became_active":"2023-11-28T17:40:27.955308+0000","last_became_peered":"2023-11-28T17:40:27.955308+0000","last_unstale":"2023-11-28T17:40:30.106823+0000","last_undegraded":"2023-11-28T17:40:30.106823+0000","last_fullsized":"2023-11-28T17:40:30.106823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:53.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936104+0000","last_change":"2023-11-28T17:40:27.942869+0000","last_active":"2023-11-28T17:40:28.936104+0000","last_peered":"2023-11-28T17:40:28.936104+0000","last_clean":"2023-11-28T17:40:28.936104+0000","last_became_active":"2023-11-28T17:40:27.942548+0000","last_became_peered":"2023-11-28T17:40:27.942548+0000","last_unstale":"2023-11-28T17:40:28.936104+0000","last_undegraded":"2023-11-28T17:40:28.936104+0000","last_fullsized":"2023-11-28T17:40:28.936104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:51.203222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106586+0000","last_change":"2023-11-28T17:40:27.947426+0000","last_active":"2023-11-28T17:40:30.106586+0000","last_peered":"2023-11-28T17:40:30.106586+0000","last_clean":"2023-11-28T17:40:30.106586+0000","last_became_active":"2023-11-28T17:40:27.946841+0000","last_became_peered":"2023-11-28T17:40:27.946841+0000","last_unstale":"2023-11-28T17:40:30.106586+0000","last_undegraded":"2023-11-28T17:40:30.106586+0000","last_fullsized":"2023-11-28T17:40:30.106586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.958478+0000","last_change":"2023-11-28T17:40:26.927946+0000","last_active":"2023-11-28T17:40:27.958478+0000","last_peered":"2023-11-28T17:40:27.958478+0000","last_clean":"2023-11-28T17:40:27.958478+0000","last_became_active":"2023-11-28T17:40:26.927239+0000","last_became_peered":"2023-11-28T17:40:26.927239+0000","last_unstale":"2023-11-28T17:40:27.958478+0000","last_undegraded":"2023-11-28T17:40:27.958478+0000","last_fullsized":"2023-11-28T17:40:27.958478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:13.335553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107166+0000","last_change":"2023-11-28T17:40:27.939400+0000","last_active":"2023-11-28T17:40:30.107166+0000","last_peered":"2023-11-28T17:40:30.107166+0000","last_clean":"2023-11-28T17:40:30.107166+0000","last_became_active":"2023-11-28T17:40:27.939101+0000","last_became_peered":"2023-11-28T17:40:27.939101+0000","last_unstale":"2023-11-28T17:40:30.107166+0000","last_undegraded":"2023-11-28T17:40:30.107166+0000","last_fullsized":"2023-11-28T17:40:30.107166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.953772+0000","last_change":"2023-11-28T17:40:26.936375+0000","last_active":"2023-11-28T17:40:27.953772+0000","last_peered":"2023-11-28T17:40:27.953772+0000","last_clean":"2023-11-28T17:40:27.953772+0000","last_became_active":"2023-11-28T17:40:26.936085+0000","last_became_peered":"2023-11-28T17:40:26.936085+0000","last_unstale":"2023-11-28T17:40:27.953772+0000","last_undegraded":"2023-11-28T17:40:27.953772+0000","last_fullsized":"2023-11-28T17:40:27.953772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:25.903111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107203+0000","last_change":"2023-11-28T17:40:27.954138+0000","last_active":"2023-11-28T17:40:30.107203+0000","last_peered":"2023-11-28T17:40:30.107203+0000","last_clean":"2023-11-28T17:40:30.107203+0000","last_became_active":"2023-11-28T17:40:27.953676+0000","last_became_peered":"2023-11-28T17:40:27.953676+0000","last_unstale":"2023-11-28T17:40:30.107203+0000","last_undegraded":"2023-11-28T17:40:30.107203+0000","last_fullsized":"2023-11-28T17:40:30.107203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941503+0000","last_change":"2023-11-28T17:40:26.934639+0000","last_active":"2023-11-28T17:40:28.941503+0000","last_peered":"2023-11-28T17:40:28.941503+0000","last_clean":"2023-11-28T17:40:28.941503+0000","last_became_active":"2023-11-28T17:40:26.934345+0000","last_became_peered":"2023-11-28T17:40:26.934345+0000","last_unstale":"2023-11-28T17:40:28.941503+0000","last_undegraded":"2023-11-28T17:40:28.941503+0000","last_fullsized":"2023-11-28T17:40:28.941503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:31.675585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107352+0000","last_change":"2023-11-28T17:40:27.952787+0000","last_active":"2023-11-28T17:40:30.107352+0000","last_peered":"2023-11-28T17:40:30.107352+0000","last_clean":"2023-11-28T17:40:30.107352+0000","last_became_active":"2023-11-28T17:40:27.952511+0000","last_became_peered":"2023-11-28T17:40:27.952511+0000","last_unstale":"2023-11-28T17:40:30.107352+0000","last_undegraded":"2023-11-28T17:40:30.107352+0000","last_fullsized":"2023-11-28T17:40:30.107352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:14.162764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.962995+0000","last_change":"2023-11-28T17:40:26.935178+0000","last_active":"2023-11-28T17:40:27.962995+0000","last_peered":"2023-11-28T17:40:27.962995+0000","last_clean":"2023-11-28T17:40:27.962995+0000","last_became_active":"2023-11-28T17:40:26.934878+0000","last_became_peered":"2023-11-28T17:40:26.934878+0000","last_unstale":"2023-11-28T17:40:27.962995+0000","last_undegraded":"2023-11-28T17:40:27.962995+0000","last_fullsized":"2023-11-28T17:40:27.962995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:50.213813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975174+0000","last_change":"2023-11-28T17:40:27.934749+0000","last_active":"2023-11-28T17:40:28.975174+0000","last_peered":"2023-11-28T17:40:28.975174+0000","last_clean":"2023-11-28T17:40:28.975174+0000","last_became_active":"2023-11-28T17:40:27.934482+0000","last_became_peered":"2023-11-28T17:40:27.934482+0000","last_unstale":"2023-11-28T17:40:28.975174+0000","last_undegraded":"2023-11-28T17:40:28.975174+0000","last_fullsized":"2023-11-28T17:40:28.975174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:42.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.954048+0000","last_change":"2023-11-28T17:40:26.934061+0000","last_active":"2023-11-28T17:40:27.954048+0000","last_peered":"2023-11-28T17:40:27.954048+0000","last_clean":"2023-11-28T17:40:27.954048+0000","last_became_active":"2023-11-28T17:40:26.932628+0000","last_became_peered":"2023-11-28T17:40:26.932628+0000","last_unstale":"2023-11-28T17:40:27.954048+0000","last_undegraded":"2023-11-28T17:40:27.954048+0000","last_fullsized":"2023-11-28T17:40:27.954048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:48.337820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106949+0000","last_change":"2023-11-28T17:40:27.952140+0000","last_active":"2023-11-28T17:40:30.106949+0000","last_peered":"2023-11-28T17:40:30.106949+0000","last_clean":"2023-11-28T17:40:30.106949+0000","last_became_active":"2023-11-28T17:40:27.948771+0000","last_became_peered":"2023-11-28T17:40:27.948771+0000","last_unstale":"2023-11-28T17:40:30.106949+0000","last_undegraded":"2023-11-28T17:40:30.106949+0000","last_fullsized":"2023-11-28T17:40:30.106949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.957197+0000","last_change":"2023-11-28T17:40:26.935301+0000","last_active":"2023-11-28T17:40:27.957197+0000","last_peered":"2023-11-28T17:40:27.957197+0000","last_clean":"2023-11-28T17:40:27.957197+0000","last_became_active":"2023-11-28T17:40:26.932982+0000","last_became_peered":"2023-11-28T17:40:26.932982+0000","last_unstale":"2023-11-28T17:40:27.957197+0000","last_undegraded":"2023-11-28T17:40:27.957197+0000","last_fullsized":"2023-11-28T17:40:27.957197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975003+0000","last_change":"2023-11-28T17:40:27.933484+0000","last_active":"2023-11-28T17:40:28.975003+0000","last_peered":"2023-11-28T17:40:28.975003+0000","last_clean":"2023-11-28T17:40:28.975003+0000","last_became_active":"2023-11-28T17:40:27.932519+0000","last_became_peered":"2023-11-28T17:40:27.932519+0000","last_unstale":"2023-11-28T17:40:28.975003+0000","last_undegraded":"2023-11-28T17:40:28.975003+0000","last_fullsized":"2023-11-28T17:40:28.975003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:16:03.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940267+0000","last_change":"2023-11-28T17:40:26.938953+0000","last_active":"2023-11-28T17:40:28.940267+0000","last_peered":"2023-11-28T17:40:28.940267+0000","last_clean":"2023-11-28T17:40:28.940267+0000","last_became_active":"2023-11-28T17:40:26.935951+0000","last_became_peered":"2023-11-28T17:40:26.935951+0000","last_unstale":"2023-11-28T17:40:28.940267+0000","last_undegraded":"2023-11-28T17:40:28.940267+0000","last_fullsized":"2023-11-28T17:40:28.940267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:26.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106813+0000","last_change":"2023-11-28T17:40:27.934329+0000","last_active":"2023-11-28T17:40:30.106813+0000","last_peered":"2023-11-28T17:40:30.106813+0000","last_clean":"2023-11-28T17:40:30.106813+0000","last_became_active":"2023-11-28T17:40:27.933994+0000","last_became_peered":"2023-11-28T17:40:27.933994+0000","last_unstale":"2023-11-28T17:40:30.106813+0000","last_undegraded":"2023-11-28T17:40:30.106813+0000","last_fullsized":"2023-11-28T17:40:30.106813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.935649+0000","last_change":"2023-11-28T17:40:26.933807+0000","last_active":"2023-11-28T17:40:27.935649+0000","last_peered":"2023-11-28T17:40:27.935649+0000","last_clean":"2023-11-28T17:40:27.935649+0000","last_became_active":"2023-11-28T17:40:26.933505+0000","last_became_peered":"2023-11-28T17:40:26.933505+0000","last_unstale":"2023-11-28T17:40:27.935649+0000","last_undegraded":"2023-11-28T17:40:27.935649+0000","last_fullsized":"2023-11-28T17:40:27.935649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:48.648901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935872+0000","last_change":"2023-11-28T17:40:27.947376+0000","last_active":"2023-11-28T17:40:28.935872+0000","last_peered":"2023-11-28T17:40:28.935872+0000","last_clean":"2023-11-28T17:40:28.935872+0000","last_became_active":"2023-11-28T17:40:27.947051+0000","last_became_peered":"2023-11-28T17:40:27.947051+0000","last_unstale":"2023-11-28T17:40:28.935872+0000","last_undegraded":"2023-11-28T17:40:28.935872+0000","last_fullsized":"2023-11-28T17:40:28.935872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:18.077272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.930522+0000","last_change":"2023-11-28T17:40:26.942248+0000","last_active":"2023-11-28T17:40:27.930522+0000","last_peered":"2023-11-28T17:40:27.930522+0000","last_clean":"2023-11-28T17:40:27.930522+0000","last_became_active":"2023-11-28T17:40:26.941803+0000","last_became_peered":"2023-11-28T17:40:26.941803+0000","last_unstale":"2023-11-28T17:40:27.930522+0000","last_undegraded":"2023-11-28T17:40:27.930522+0000","last_fullsized":"2023-11-28T17:40:27.930522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:25.903111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107611+0000","last_change":"2023-11-28T17:40:27.941143+0000","last_active":"2023-11-28T17:40:30.107611+0000","last_peered":"2023-11-28T17:40:30.107611+0000","last_clean":"2023-11-28T17:40:30.107611+0000","last_became_active":"2023-11-28T17:40:27.940852+0000","last_became_peered":"2023-11-28T17:40:27.940852+0000","last_unstale":"2023-11-28T17:40:30.107611+0000","last_undegraded":"2023-11-28T17:40:30.107611+0000","last_fullsized":"2023-11-28T17:40:30.107611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:00.453594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.926512+0000","last_change":"2023-11-28T17:40:26.927546+0000","last_active":"2023-11-28T17:40:27.926512+0000","last_peered":"2023-11-28T17:40:27.926512+0000","last_clean":"2023-11-28T17:40:27.926512+0000","last_became_active":"2023-11-28T17:40:26.927255+0000","last_became_peered":"2023-11-28T17:40:26.927255+0000","last_unstale":"2023-11-28T17:40:27.926512+0000","last_undegraded":"2023-11-28T17:40:27.926512+0000","last_fullsized":"2023-11-28T17:40:27.926512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:52.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107190+0000","last_change":"2023-11-28T17:40:27.950552+0000","last_active":"2023-11-28T17:40:30.107190+0000","last_peered":"2023-11-28T17:40:30.107190+0000","last_clean":"2023-11-28T17:40:30.107190+0000","last_became_active":"2023-11-28T17:40:27.950272+0000","last_became_peered":"2023-11-28T17:40:27.950272+0000","last_unstale":"2023-11-28T17:40:30.107190+0000","last_undegraded":"2023-11-28T17:40:30.107190+0000","last_fullsized":"2023-11-28T17:40:30.107190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:01.505965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.957480+0000","last_change":"2023-11-28T17:40:26.936775+0000","last_active":"2023-11-28T17:40:27.957480+0000","last_peered":"2023-11-28T17:40:27.957480+0000","last_clean":"2023-11-28T17:40:27.957480+0000","last_became_active":"2023-11-28T17:40:26.936489+0000","last_became_peered":"2023-11-28T17:40:26.936489+0000","last_unstale":"2023-11-28T17:40:27.957480+0000","last_undegraded":"2023-11-28T17:40:27.957480+0000","last_fullsized":"2023-11-28T17:40:27.957480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:12.622333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936000+0000","last_change":"2023-11-28T17:40:27.942869+0000","last_active":"2023-11-28T17:40:28.936000+0000","last_peered":"2023-11-28T17:40:28.936000+0000","last_clean":"2023-11-28T17:40:28.936000+0000","last_became_active":"2023-11-28T17:40:27.942336+0000","last_became_peered":"2023-11-28T17:40:27.942336+0000","last_unstale":"2023-11-28T17:40:28.936000+0000","last_undegraded":"2023-11-28T17:40:28.936000+0000","last_fullsized":"2023-11-28T17:40:28.936000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:28.761668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.969170+0000","last_change":"2023-11-28T17:40:26.941495+0000","last_active":"2023-11-28T17:40:27.969170+0000","last_peered":"2023-11-28T17:40:27.969170+0000","last_clean":"2023-11-28T17:40:27.969170+0000","last_became_active":"2023-11-28T17:40:26.941160+0000","last_became_peered":"2023-11-28T17:40:26.941160+0000","last_unstale":"2023-11-28T17:40:27.969170+0000","last_undegraded":"2023-11-28T17:40:27.969170+0000","last_fullsized":"2023-11-28T17:40:27.969170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106179+0000","last_change":"2023-11-28T17:40:27.943820+0000","last_active":"2023-11-28T17:40:30.106179+0000","last_peered":"2023-11-28T17:40:30.106179+0000","last_clean":"2023-11-28T17:40:30.106179+0000","last_became_active":"2023-11-28T17:40:27.943514+0000","last_became_peered":"2023-11-28T17:40:27.943514+0000","last_unstale":"2023-11-28T17:40:30.106179+0000","last_undegraded":"2023-11-28T17:40:30.106179+0000","last_fullsized":"2023-11-28T17:40:30.106179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:38:09.270172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.952342+0000","last_change":"2023-11-28T17:40:26.937343+0000","last_active":"2023-11-28T17:40:27.952342+0000","last_peered":"2023-11-28T17:40:27.952342+0000","last_clean":"2023-11-28T17:40:27.952342+0000","last_became_active":"2023-11-28T17:40:26.937064+0000","last_became_peered":"2023-11-28T17:40:26.937064+0000","last_unstale":"2023-11-28T17:40:27.952342+0000","last_undegraded":"2023-11-28T17:40:27.952342+0000","last_fullsized":"2023-11-28T17:40:27.952342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:58.337146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107141+0000","last_change":"2023-11-28T17:40:27.959543+0000","last_active":"2023-11-28T17:40:30.107141+0000","last_peered":"2023-11-28T17:40:30.107141+0000","last_clean":"2023-11-28T17:40:30.107141+0000","last_became_active":"2023-11-28T17:40:27.959257+0000","last_became_peered":"2023-11-28T17:40:27.959257+0000","last_unstale":"2023-11-28T17:40:30.107141+0000","last_undegraded":"2023-11-28T17:40:30.107141+0000","last_fullsized":"2023-11-28T17:40:30.107141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:14.042176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.922464+0000","last_change":"2023-11-28T17:40:26.935707+0000","last_active":"2023-11-28T17:40:27.922464+0000","last_peered":"2023-11-28T17:40:27.922464+0000","last_clean":"2023-11-28T17:40:27.922464+0000","last_became_active":"2023-11-28T17:40:26.935413+0000","last_became_peered":"2023-11-28T17:40:26.935413+0000","last_unstale":"2023-11-28T17:40:27.922464+0000","last_undegraded":"2023-11-28T17:40:27.922464+0000","last_fullsized":"2023-11-28T17:40:27.922464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:13.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106826+0000","last_change":"2023-11-28T17:40:27.941465+0000","last_active":"2023-11-28T17:40:30.106826+0000","last_peered":"2023-11-28T17:40:30.106826+0000","last_clean":"2023-11-28T17:40:30.106826+0000","last_became_active":"2023-11-28T17:40:27.940962+0000","last_became_peered":"2023-11-28T17:40:27.940962+0000","last_unstale":"2023-11-28T17:40:30.106826+0000","last_undegraded":"2023-11-28T17:40:30.106826+0000","last_fullsized":"2023-11-28T17:40:30.106826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:11.345803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.921851+0000","last_change":"2023-11-28T17:40:26.938693+0000","last_active":"2023-11-28T17:40:27.921851+0000","last_peered":"2023-11-28T17:40:27.921851+0000","last_clean":"2023-11-28T17:40:27.921851+0000","last_became_active":"2023-11-28T17:40:26.937922+0000","last_became_peered":"2023-11-28T17:40:26.937922+0000","last_unstale":"2023-11-28T17:40:27.921851+0000","last_undegraded":"2023-11-28T17:40:27.921851+0000","last_fullsized":"2023-11-28T17:40:27.921851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:10.338401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935682+0000","last_change":"2023-11-28T17:40:27.944600+0000","last_active":"2023-11-28T17:40:28.935682+0000","last_peered":"2023-11-28T17:40:28.935682+0000","last_clean":"2023-11-28T17:40:28.935682+0000","last_became_active":"2023-11-28T17:40:27.944295+0000","last_became_peered":"2023-11-28T17:40:27.944295+0000","last_unstale":"2023-11-28T17:40:28.935682+0000","last_undegraded":"2023-11-28T17:40:28.935682+0000","last_fullsized":"2023-11-28T17:40:28.935682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:00.453594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940214+0000","last_change":"2023-11-28T17:40:26.940626+0000","last_active":"2023-11-28T17:40:28.940214+0000","last_peered":"2023-11-28T17:40:28.940214+0000","last_clean":"2023-11-28T17:40:28.940214+0000","last_became_active":"2023-11-28T17:40:26.938026+0000","last_became_peered":"2023-11-28T17:40:26.938026+0000","last_unstale":"2023-11-28T17:40:28.940214+0000","last_undegraded":"2023-11-28T17:40:28.940214+0000","last_fullsized":"2023-11-28T17:40:28.940214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:56.702406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935998+0000","last_change":"2023-11-28T17:40:27.933249+0000","last_active":"2023-11-28T17:40:28.935998+0000","last_peered":"2023-11-28T17:40:28.935998+0000","last_clean":"2023-11-28T17:40:28.935998+0000","last_became_active":"2023-11-28T17:40:27.932961+0000","last_became_peered":"2023-11-28T17:40:27.932961+0000","last_unstale":"2023-11-28T17:40:28.935998+0000","last_undegraded":"2023-11-28T17:40:28.935998+0000","last_fullsized":"2023-11-28T17:40:28.935998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:01.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940599+0000","last_change":"2023-11-28T17:40:26.939525+0000","last_active":"2023-11-28T17:40:28.940599+0000","last_peered":"2023-11-28T17:40:28.940599+0000","last_clean":"2023-11-28T17:40:28.940599+0000","last_became_active":"2023-11-28T17:40:26.939241+0000","last_became_peered":"2023-11-28T17:40:26.939241+0000","last_unstale":"2023-11-28T17:40:28.940599+0000","last_undegraded":"2023-11-28T17:40:28.940599+0000","last_fullsized":"2023-11-28T17:40:28.940599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:34:33.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975332+0000","last_change":"2023-11-28T17:40:27.932349+0000","last_active":"2023-11-28T17:40:28.975332+0000","last_peered":"2023-11-28T17:40:28.975332+0000","last_clean":"2023-11-28T17:40:28.975332+0000","last_became_active":"2023-11-28T17:40:27.930754+0000","last_became_peered":"2023-11-28T17:40:27.930754+0000","last_unstale":"2023-11-28T17:40:28.975332+0000","last_undegraded":"2023-11-28T17:40:28.975332+0000","last_fullsized":"2023-11-28T17:40:28.975332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:44.527346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951285+0000","last_change":"2023-11-28T17:40:26.931143+0000","last_active":"2023-11-28T17:40:27.951285+0000","last_peered":"2023-11-28T17:40:27.951285+0000","last_clean":"2023-11-28T17:40:27.951285+0000","last_became_active":"2023-11-28T17:40:26.930860+0000","last_became_peered":"2023-11-28T17:40:26.930860+0000","last_unstale":"2023-11-28T17:40:27.951285+0000","last_undegraded":"2023-11-28T17:40:27.951285+0000","last_fullsized":"2023-11-28T17:40:27.951285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:04:12.304015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940783+0000","last_change":"2023-11-28T17:40:27.935780+0000","last_active":"2023-11-28T17:40:28.940783+0000","last_peered":"2023-11-28T17:40:28.940783+0000","last_clean":"2023-11-28T17:40:28.940783+0000","last_became_active":"2023-11-28T17:40:27.935486+0000","last_became_peered":"2023-11-28T17:40:27.935486+0000","last_unstale":"2023-11-28T17:40:28.940783+0000","last_undegraded":"2023-11-28T17:40:28.940783+0000","last_fullsized":"2023-11-28T17:40:28.940783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.956347+0000","last_change":"2023-11-28T17:40:26.934185+0000","last_active":"2023-11-28T17:40:27.956347+0000","last_peered":"2023-11-28T17:40:27.956347+0000","last_clean":"2023-11-28T17:40:27.956347+0000","last_became_active":"2023-11-28T17:40:26.933685+0000","last_became_peered":"2023-11-28T17:40:26.933685+0000","last_unstale":"2023-11-28T17:40:27.956347+0000","last_undegraded":"2023-11-28T17:40:27.956347+0000","last_fullsized":"2023-11-28T17:40:27.956347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:13.155362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941245+0000","last_change":"2023-11-28T17:40:27.947556+0000","last_active":"2023-11-28T17:40:28.941245+0000","last_peered":"2023-11-28T17:40:28.941245+0000","last_clean":"2023-11-28T17:40:28.941245+0000","last_became_active":"2023-11-28T17:40:27.947021+0000","last_became_peered":"2023-11-28T17:40:27.947021+0000","last_unstale":"2023-11-28T17:40:28.941245+0000","last_undegraded":"2023-11-28T17:40:28.941245+0000","last_fullsized":"2023-11-28T17:40:28.941245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:42.830805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.917361+0000","last_change":"2023-11-28T17:40:26.933719+0000","last_active":"2023-11-28T17:40:27.917361+0000","last_peered":"2023-11-28T17:40:27.917361+0000","last_clean":"2023-11-28T17:40:27.917361+0000","last_became_active":"2023-11-28T17:40:26.932832+0000","last_became_peered":"2023-11-28T17:40:26.932832+0000","last_unstale":"2023-11-28T17:40:27.917361+0000","last_undegraded":"2023-11-28T17:40:27.917361+0000","last_fullsized":"2023-11-28T17:40:27.917361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:23.182794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106367+0000","last_change":"2023-11-28T17:40:27.943358+0000","last_active":"2023-11-28T17:40:30.106367+0000","last_peered":"2023-11-28T17:40:30.106367+0000","last_clean":"2023-11-28T17:40:30.106367+0000","last_became_active":"2023-11-28T17:40:27.943032+0000","last_became_peered":"2023-11-28T17:40:27.943032+0000","last_unstale":"2023-11-28T17:40:30.106367+0000","last_undegraded":"2023-11-28T17:40:30.106367+0000","last_fullsized":"2023-11-28T17:40:30.106367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:11.345803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951408+0000","last_change":"2023-11-28T17:40:26.932256+0000","last_active":"2023-11-28T17:40:27.951408+0000","last_peered":"2023-11-28T17:40:27.951408+0000","last_clean":"2023-11-28T17:40:27.951408+0000","last_became_active":"2023-11-28T17:40:26.931963+0000","last_became_peered":"2023-11-28T17:40:26.931963+0000","last_unstale":"2023-11-28T17:40:27.951408+0000","last_undegraded":"2023-11-28T17:40:27.951408+0000","last_fullsized":"2023-11-28T17:40:27.951408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:10.338401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941041+0000","last_change":"2023-11-28T17:40:27.948756+0000","last_active":"2023-11-28T17:40:28.941041+0000","last_peered":"2023-11-28T17:40:28.941041+0000","last_clean":"2023-11-28T17:40:28.941041+0000","last_became_active":"2023-11-28T17:40:27.948477+0000","last_became_peered":"2023-11-28T17:40:27.948477+0000","last_unstale":"2023-11-28T17:40:28.941041+0000","last_undegraded":"2023-11-28T17:40:28.941041+0000","last_fullsized":"2023-11-28T17:40:28.941041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.936202+0000","last_change":"2023-11-28T17:40:26.931177+0000","last_active":"2023-11-28T17:40:27.936202+0000","last_peered":"2023-11-28T17:40:27.936202+0000","last_clean":"2023-11-28T17:40:27.936202+0000","last_became_active":"2023-11-28T17:40:26.930885+0000","last_became_peered":"2023-11-28T17:40:26.930885+0000","last_unstale":"2023-11-28T17:40:27.936202+0000","last_undegraded":"2023-11-28T17:40:27.936202+0000","last_fullsized":"2023-11-28T17:40:27.936202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:09.133492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106076+0000","last_change":"2023-11-28T17:40:27.952232+0000","last_active":"2023-11-28T17:40:30.106076+0000","last_peered":"2023-11-28T17:40:30.106076+0000","last_clean":"2023-11-28T17:40:30.106076+0000","last_became_active":"2023-11-28T17:40:27.951907+0000","last_became_peered":"2023-11-28T17:40:27.951907+0000","last_unstale":"2023-11-28T17:40:30.106076+0000","last_undegraded":"2023-11-28T17:40:30.106076+0000","last_fullsized":"2023-11-28T17:40:30.106076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:24.190196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.918883+0000","last_change":"2023-11-28T17:40:26.946081+0000","last_active":"2023-11-28T17:40:27.918883+0000","last_peered":"2023-11-28T17:40:27.918883+0000","last_clean":"2023-11-28T17:40:27.918883+0000","last_became_active":"2023-11-28T17:40:26.945847+0000","last_became_peered":"2023-11-28T17:40:26.945847+0000","last_unstale":"2023-11-28T17:40:27.918883+0000","last_undegraded":"2023-11-28T17:40:27.918883+0000","last_fullsized":"2023-11-28T17:40:27.918883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:28.336537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975115+0000","last_change":"2023-11-28T17:40:27.925069+0000","last_active":"2023-11-28T17:40:28.975115+0000","last_peered":"2023-11-28T17:40:28.975115+0000","last_clean":"2023-11-28T17:40:28.975115+0000","last_became_active":"2023-11-28T17:40:27.924556+0000","last_became_peered":"2023-11-28T17:40:27.924556+0000","last_unstale":"2023-11-28T17:40:28.975115+0000","last_undegraded":"2023-11-28T17:40:28.975115+0000","last_fullsized":"2023-11-28T17:40:28.975115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:49.294183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.925235+0000","last_change":"2023-11-28T17:40:26.931615+0000","last_active":"2023-11-28T17:40:27.925235+0000","last_peered":"2023-11-28T17:40:27.925235+0000","last_clean":"2023-11-28T17:40:27.925235+0000","last_became_active":"2023-11-28T17:40:26.931265+0000","last_became_peered":"2023-11-28T17:40:26.931265+0000","last_unstale":"2023-11-28T17:40:27.925235+0000","last_undegraded":"2023-11-28T17:40:27.925235+0000","last_fullsized":"2023-11-28T17:40:27.925235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:00.498563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940561+0000","last_change":"2023-11-28T17:40:27.952115+0000","last_active":"2023-11-28T17:40:28.940561+0000","last_peered":"2023-11-28T17:40:28.940561+0000","last_clean":"2023-11-28T17:40:28.940561+0000","last_became_active":"2023-11-28T17:40:27.951381+0000","last_became_peered":"2023-11-28T17:40:27.951381+0000","last_unstale":"2023-11-28T17:40:28.940561+0000","last_undegraded":"2023-11-28T17:40:28.940561+0000","last_fullsized":"2023-11-28T17:40:28.940561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:42:21.105746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951085+0000","last_change":"2023-11-28T17:40:26.939295+0000","last_active":"2023-11-28T17:40:27.951085+0000","last_peered":"2023-11-28T17:40:27.951085+0000","last_clean":"2023-11-28T17:40:27.951085+0000","last_became_active":"2023-11-28T17:40:26.938074+0000","last_became_peered":"2023-11-28T17:40:26.938074+0000","last_unstale":"2023-11-28T17:40:27.951085+0000","last_undegraded":"2023-11-28T17:40:27.951085+0000","last_fullsized":"2023-11-28T17:40:27.951085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:09.133492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935942+0000","last_change":"2023-11-28T17:40:27.950731+0000","last_active":"2023-11-28T17:40:28.935942+0000","last_peered":"2023-11-28T17:40:28.935942+0000","last_clean":"2023-11-28T17:40:28.935942+0000","last_became_active":"2023-11-28T17:40:27.949604+0000","last_became_peered":"2023-11-28T17:40:27.949604+0000","last_unstale":"2023-11-28T17:40:28.935942+0000","last_undegraded":"2023-11-28T17:40:28.935942+0000","last_fullsized":"2023-11-28T17:40:28.935942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:05.741714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941483+0000","last_change":"2023-11-28T17:40:26.927541+0000","last_active":"2023-11-28T17:40:28.941483+0000","last_peered":"2023-11-28T17:40:28.941483+0000","last_clean":"2023-11-28T17:40:28.941483+0000","last_became_active":"2023-11-28T17:40:26.926798+0000","last_became_peered":"2023-11-28T17:40:26.926798+0000","last_unstale":"2023-11-28T17:40:28.941483+0000","last_undegraded":"2023-11-28T17:40:28.941483+0000","last_fullsized":"2023-11-28T17:40:28.941483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:13.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941395+0000","last_change":"2023-11-28T17:40:27.964200+0000","last_active":"2023-11-28T17:40:28.941395+0000","last_peered":"2023-11-28T17:40:28.941395+0000","last_clean":"2023-11-28T17:40:28.941395+0000","last_became_active":"2023-11-28T17:40:27.963801+0000","last_became_peered":"2023-11-28T17:40:27.963801+0000","last_unstale":"2023-11-28T17:40:28.941395+0000","last_undegraded":"2023-11-28T17:40:28.941395+0000","last_fullsized":"2023-11-28T17:40:28.941395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:56:29.022310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.930045+0000","last_change":"2023-11-28T17:40:26.929535+0000","last_active":"2023-11-28T17:40:27.930045+0000","last_peered":"2023-11-28T17:40:27.930045+0000","last_clean":"2023-11-28T17:40:27.930045+0000","last_became_active":"2023-11-28T17:40:26.929195+0000","last_became_peered":"2023-11-28T17:40:26.929195+0000","last_unstale":"2023-11-28T17:40:27.930045+0000","last_undegraded":"2023-11-28T17:40:27.930045+0000","last_fullsized":"2023-11-28T17:40:27.930045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:48.337820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215994+0000","last_change":"2023-11-28T17:40:27.950605+0000","last_active":"2023-11-28T17:40:29.215994+0000","last_peered":"2023-11-28T17:40:29.215994+0000","last_clean":"2023-11-28T17:40:29.215994+0000","last_became_active":"2023-11-28T17:40:27.950249+0000","last_became_peered":"2023-11-28T17:40:27.950249+0000","last_unstale":"2023-11-28T17:40:29.215994+0000","last_undegraded":"2023-11-28T17:40:29.215994+0000","last_fullsized":"2023-11-28T17:40:29.215994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.937353+0000","last_change":"2023-11-28T17:40:26.938080+0000","last_active":"2023-11-28T17:40:27.937353+0000","last_peered":"2023-11-28T17:40:27.937353+0000","last_clean":"2023-11-28T17:40:27.937353+0000","last_became_active":"2023-11-28T17:40:26.937738+0000","last_became_peered":"2023-11-28T17:40:26.937738+0000","last_unstale":"2023-11-28T17:40:27.937353+0000","last_undegraded":"2023-11-28T17:40:27.937353+0000","last_fullsized":"2023-11-28T17:40:27.937353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:58.337146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107335+0000","last_change":"2023-11-28T17:40:27.954352+0000","last_active":"2023-11-28T17:40:30.107335+0000","last_peered":"2023-11-28T17:40:30.107335+0000","last_clean":"2023-11-28T17:40:30.107335+0000","last_became_active":"2023-11-28T17:40:27.954059+0000","last_became_peered":"2023-11-28T17:40:27.954059+0000","last_unstale":"2023-11-28T17:40:30.107335+0000","last_undegraded":"2023-11-28T17:40:30.107335+0000","last_fullsized":"2023-11-28T17:40:30.107335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:38.101907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.927949+0000","last_change":"2023-11-28T17:40:26.931119+0000","last_active":"2023-11-28T17:40:27.927949+0000","last_peered":"2023-11-28T17:40:27.927949+0000","last_clean":"2023-11-28T17:40:27.927949+0000","last_became_active":"2023-11-28T17:40:26.930806+0000","last_became_peered":"2023-11-28T17:40:26.930806+0000","last_unstale":"2023-11-28T17:40:27.927949+0000","last_undegraded":"2023-11-28T17:40:27.927949+0000","last_fullsized":"2023-11-28T17:40:27.927949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:17.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106858+0000","last_change":"2023-11-28T17:40:27.937688+0000","last_active":"2023-11-28T17:40:30.106858+0000","last_peered":"2023-11-28T17:40:30.106858+0000","last_clean":"2023-11-28T17:40:30.106858+0000","last_became_active":"2023-11-28T17:40:27.937334+0000","last_became_peered":"2023-11-28T17:40:27.937334+0000","last_unstale":"2023-11-28T17:40:30.106858+0000","last_undegraded":"2023-11-28T17:40:30.106858+0000","last_fullsized":"2023-11-28T17:40:30.106858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.940788+0000","last_change":"2023-11-28T17:40:26.932477+0000","last_active":"2023-11-28T17:40:27.940788+0000","last_peered":"2023-11-28T17:40:27.940788+0000","last_clean":"2023-11-28T17:40:27.940788+0000","last_became_active":"2023-11-28T17:40:26.930810+0000","last_became_peered":"2023-11-28T17:40:26.930810+0000","last_unstale":"2023-11-28T17:40:27.940788+0000","last_undegraded":"2023-11-28T17:40:27.940788+0000","last_fullsized":"2023-11-28T17:40:27.940788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:23.182794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935711+0000","last_change":"2023-11-28T17:40:27.949096+0000","last_active":"2023-11-28T17:40:28.935711+0000","last_peered":"2023-11-28T17:40:28.935711+0000","last_clean":"2023-11-28T17:40:28.935711+0000","last_became_active":"2023-11-28T17:40:27.948781+0000","last_became_peered":"2023-11-28T17:40:27.948781+0000","last_unstale":"2023-11-28T17:40:28.935711+0000","last_undegraded":"2023-11-28T17:40:28.935711+0000","last_fullsized":"2023-11-28T17:40:28.935711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:28.966721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.920356+0000","last_change":"2023-11-28T17:40:26.937241+0000","last_active":"2023-11-28T17:40:27.920356+0000","last_peered":"2023-11-28T17:40:27.920356+0000","last_clean":"2023-11-28T17:40:27.920356+0000","last_became_active":"2023-11-28T17:40:26.936877+0000","last_became_peered":"2023-11-28T17:40:26.936877+0000","last_unstale":"2023-11-28T17:40:27.920356+0000","last_undegraded":"2023-11-28T17:40:27.920356+0000","last_fullsized":"2023-11-28T17:40:27.920356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216241+0000","last_change":"2023-11-28T17:40:27.949193+0000","last_active":"2023-11-28T17:40:29.216241+0000","last_peered":"2023-11-28T17:40:29.216241+0000","last_clean":"2023-11-28T17:40:29.216241+0000","last_became_active":"2023-11-28T17:40:27.948365+0000","last_became_peered":"2023-11-28T17:40:27.948365+0000","last_unstale":"2023-11-28T17:40:29.216241+0000","last_undegraded":"2023-11-28T17:40:29.216241+0000","last_fullsized":"2023-11-28T17:40:29.216241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.935153+0000","last_change":"2023-11-28T17:40:26.933957+0000","last_active":"2023-11-28T17:40:27.935153+0000","last_peered":"2023-11-28T17:40:27.935153+0000","last_clean":"2023-11-28T17:40:27.935153+0000","last_became_active":"2023-11-28T17:40:26.933214+0000","last_became_peered":"2023-11-28T17:40:26.933214+0000","last_unstale":"2023-11-28T17:40:27.935153+0000","last_undegraded":"2023-11-28T17:40:27.935153+0000","last_fullsized":"2023-11-28T17:40:27.935153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:37.055697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.920809+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:40:27.920809+0000","last_peered":"2023-11-28T17:40:27.920809+0000","last_clean":"2023-11-28T17:40:27.920809+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:40:27.920809+0000","last_undegraded":"2023-11-28T17:40:27.920809+0000","last_fullsized":"2023-11-28T17:40:27.920809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.75},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.492,"5min":7.492,"15min":7.492},"last":0.55700000000000005}]},{"osd":1,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":0.623},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.70799999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.81299999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.65400000000000003}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":153074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":5.6840000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":0.871}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.754},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52900000000000003}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.62},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.69799999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":152216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.6779999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":5.3780000000000001,"5min":5.3780000000000001,"15min":5.3780000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.40500000000000003}]},{"osd":4,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.7640000000000002,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.56499999999999995}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.70499999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":8.3149999999999995,"5min":8.3149999999999995,"15min":8.3149999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.72699999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.502}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.67800000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":741878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.37},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.314}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41199999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.50800000000000001}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.54700000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.371},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.41799999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71199999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.56100000000000005}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.73599999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.499},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.83799999999999997}]},{"osd":5,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.754}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:40:34.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:40:34.199 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:40:36.614 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T17:40:36.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.762+0000 7fd1fca5f640 1 Processor -- start 2023-11-28T17:40:36.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.762+0000 7fd1fca5f640 1 -- start start 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1fca5f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd1f81548e0 0x7fd1f80ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1fca5f640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1f8072090 0x7fd1f80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1fca5f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f80cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1fca5f640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f815a6a0 con 0x7fd1f8072090 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1fca5f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f80ced30 con 0x7fd1f81548e0 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1fca5f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f815a8b0 con 0x7fd1f815b350 2023-11-28T17:40:36.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1f8072090 0x7fd1f80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1f8072090 0x7fd1f80cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37784/0 (socket says 172.21.15.16:37784) 2023-11-28T17:40:36.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 -- 172.21.15.16:0/2040616415 learned_addr learned my addr 172.21.15.16:0/2040616415 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:36.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1f6d9d640 1 --2- 172.21.15.16:0/2040616415 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f80cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1f659c640 1 --2- 172.21.15.16:0/2040616415 >> v2:172.21.15.64:3300/0 conn(0x7fd1f81548e0 0x7fd1f80ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 -- 172.21.15.16:0/2040616415 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 msgr2=0x7fd1f80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:36.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 --2- 172.21.15.16:0/2040616415 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f80cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 -- 172.21.15.16:0/2040616415 >> v2:172.21.15.64:3300/0 conn(0x7fd1f81548e0 msgr2=0x7fd1f80ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:36.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 --2- 172.21.15.16:0/2040616415 >> v2:172.21.15.64:3300/0 conn(0x7fd1f81548e0 0x7fd1f80ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1effff640 1 -- 172.21.15.16:0/2040616415 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f80cea50 con 0x7fd1f8072090 2023-11-28T17:40:36.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.766+0000 7fd1f659c640 1 --2- 172.21.15.16:0/2040616415 >> v2:172.21.15.64:3300/0 conn(0x7fd1f81548e0 0x7fd1f80ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:36.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1effff640 1 --2- 172.21.15.16:0/2040616415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80cef30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80744c0 tx=0x7fd1e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f930100da043c84 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:36.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1f5d9b640 1 -- 172.21.15.16:0/2040616415 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00aa5f0 con 0x7fd1f8072090 2023-11-28T17:40:36.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1f5d9b640 1 -- 172.21.15.16:0/2040616415 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e00aa750 con 0x7fd1f8072090 2023-11-28T17:40:36.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1f5d9b640 1 -- 172.21.15.16:0/2040616415 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e00aaae0 con 0x7fd1f8072090 2023-11-28T17:40:36.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 -- 172.21.15.16:0/2040616415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 msgr2=0x7fd1f80cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:36.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/2040616415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80cef30 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd1f80744c0 tx=0x7fd1e001c4d0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 -- 172.21.15.16:0/2040616415 shutdown_connections 2023-11-28T17:40:36.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/2040616415 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/2040616415 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80cef30 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/2040616415 >> v2:172.21.15.64:3300/0 conn(0x7fd1f81548e0 0x7fd1f80ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 -- 172.21.15.16:0/2040616415 >> 172.21.15.16:0/2040616415 conn(0x7fd1f806a5a0 msgr2=0x7fd1f806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:36.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 -- 172.21.15.16:0/2040616415 shutdown_connections 2023-11-28T17:40:36.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 -- 172.21.15.16:0/2040616415 wait complete. 2023-11-28T17:40:36.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 Processor -- start 2023-11-28T17:40:36.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.770+0000 7fd1fca5f640 1 -- start start 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1f81548e0 0x7fd1f813d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f81590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f813b680 con 0x7fd1f8072090 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f813def0 con 0x7fd1f81548e0 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f813e1d0 con 0x7fd1f815b350 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37792/0 (socket says 172.21.15.16:37792) 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 -- 172.21.15.16:0/3003188899 learned_addr learned my addr 172.21.15.16:0/3003188899 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:36.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1effff640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1f81548e0 0x7fd1f813d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f6d9d640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f81590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 -- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 msgr2=0x7fd1f81590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f81590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 -- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1f81548e0 msgr2=0x7fd1f813d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1f81548e0 0x7fd1f813d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 -- 172.21.15.16:0/3003188899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00094d0 con 0x7fd1f8072090 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1f659c640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80ade70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800e810 tx=0x7fd1e800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800c8d0 con 0x7fd1f8072090 2023-11-28T17:40:36.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e800ca30 con 0x7fd1f8072090 2023-11-28T17:40:36.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e800cde0 con 0x7fd1f8072090 2023-11-28T17:40:36.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f813e4b0 con 0x7fd1f8072090 2023-11-28T17:40:36.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f80ae3b0 con 0x7fd1f8072090 2023-11-28T17:40:36.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.774+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f813e6a0 con 0x7fd1f8072090 2023-11-28T17:40:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.778+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd1e8013410 con 0x7fd1f8072090 2023-11-28T17:40:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.778+0000 7fd1eeffd640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1d80668d0 0x7fd1d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.778+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1e8084330 con 0x7fd1f8072090 2023-11-28T17:40:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.778+0000 7fd1effff640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1d80668d0 0x7fd1d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:36.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.778+0000 7fd1effff640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1d80668d0 0x7fd1d8068d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00ae000 tx=0x7fd1e00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:36.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.782+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1f813e6a0 con 0x7fd1f8072090 2023-11-28T17:40:36.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.934+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1f813e6a0 con 0x7fd1d80668d0 2023-11-28T17:40:36.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.942+0000 7fd1eeffd640 1 -- 172.21.15.16:0/3003188899 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288768 (secure 0 0 0) 0x7fd1f813e6a0 con 0x7fd1d80668d0 2023-11-28T17:40:36.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:36.953 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-28T17:40:36.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1d80668d0 msgr2=0x7fd1d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:36.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1d80668d0 0x7fd1d8068d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd1e00ae000 tx=0x7fd1e00a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:36.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 msgr2=0x7fd1f80ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:36.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80ade70 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1e800e810 tx=0x7fd1e800ecd0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.954 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 shutdown_connections 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1f815b350 0x7fd1f81590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1d80668d0 0x7fd1d8068d90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1f81548e0 0x7fd1f813d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 --2- 172.21.15.16:0/3003188899 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1f8072090 0x7fd1f80ade70 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 >> 172.21.15.16:0/3003188899 conn(0x7fd1f806a5a0 msgr2=0x7fd1f8152260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 shutdown_connections 2023-11-28T17:40:36.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:36.946+0000 7fd1fca5f640 1 -- 172.21.15.16:0/3003188899 wait complete. 2023-11-28T17:40:36.971 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2023-11-28T17:40:36.778943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232908,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754741812,"statfs":{"total":773094113280,"available":772855615488,"internally_reserved":0,"allocated":4366336,"data_stored":2397076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12748,"internal_metadata":234016308},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.864958"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107018+0000","last_change":"2023-11-28T17:40:27.947483+0000","last_active":"2023-11-28T17:40:30.107018+0000","last_peered":"2023-11-28T17:40:30.107018+0000","last_clean":"2023-11-28T17:40:30.107018+0000","last_became_active":"2023-11-28T17:40:27.947107+0000","last_became_peered":"2023-11-28T17:40:27.947107+0000","last_unstale":"2023-11-28T17:40:30.107018+0000","last_undegraded":"2023-11-28T17:40:30.107018+0000","last_fullsized":"2023-11-28T17:40:30.107018+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941379+0000","last_change":"2023-11-28T17:40:27.938381+0000","last_active":"2023-11-28T17:40:28.941379+0000","last_peered":"2023-11-28T17:40:28.941379+0000","last_clean":"2023-11-28T17:40:28.941379+0000","last_became_active":"2023-11-28T17:40:27.938067+0000","last_became_peered":"2023-11-28T17:40:27.938067+0000","last_unstale":"2023-11-28T17:40:28.941379+0000","last_undegraded":"2023-11-28T17:40:28.941379+0000","last_fullsized":"2023-11-28T17:40:28.941379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975059+0000","last_change":"2023-11-28T17:40:27.935238+0000","last_active":"2023-11-28T17:40:28.975059+0000","last_peered":"2023-11-28T17:40:28.975059+0000","last_clean":"2023-11-28T17:40:28.975059+0000","last_became_active":"2023-11-28T17:40:27.934884+0000","last_became_peered":"2023-11-28T17:40:27.934884+0000","last_unstale":"2023-11-28T17:40:28.975059+0000","last_undegraded":"2023-11-28T17:40:28.975059+0000","last_fullsized":"2023-11-28T17:40:28.975059+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:08:02.431496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107163+0000","last_change":"2023-11-28T17:40:27.952280+0000","last_active":"2023-11-28T17:40:30.107163+0000","last_peered":"2023-11-28T17:40:30.107163+0000","last_clean":"2023-11-28T17:40:30.107163+0000","last_became_active":"2023-11-28T17:40:27.951937+0000","last_became_peered":"2023-11-28T17:40:27.951937+0000","last_unstale":"2023-11-28T17:40:30.107163+0000","last_undegraded":"2023-11-28T17:40:30.107163+0000","last_fullsized":"2023-11-28T17:40:30.107163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:46:22.497701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940895+0000","last_change":"2023-11-28T17:40:27.957901+0000","last_active":"2023-11-28T17:40:28.940895+0000","last_peered":"2023-11-28T17:40:28.940895+0000","last_clean":"2023-11-28T17:40:28.940895+0000","last_became_active":"2023-11-28T17:40:27.957453+0000","last_became_peered":"2023-11-28T17:40:27.957453+0000","last_unstale":"2023-11-28T17:40:28.940895+0000","last_undegraded":"2023-11-28T17:40:28.940895+0000","last_fullsized":"2023-11-28T17:40:28.940895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940923+0000","last_change":"2023-11-28T17:40:27.959407+0000","last_active":"2023-11-28T17:40:28.940923+0000","last_peered":"2023-11-28T17:40:28.940923+0000","last_clean":"2023-11-28T17:40:28.940923+0000","last_became_active":"2023-11-28T17:40:27.959094+0000","last_became_peered":"2023-11-28T17:40:27.959094+0000","last_unstale":"2023-11-28T17:40:28.940923+0000","last_undegraded":"2023-11-28T17:40:28.940923+0000","last_fullsized":"2023-11-28T17:40:28.940923+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:05:51.344460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107288+0000","last_change":"2023-11-28T17:40:27.948384+0000","last_active":"2023-11-28T17:40:30.107288+0000","last_peered":"2023-11-28T17:40:30.107288+0000","last_clean":"2023-11-28T17:40:30.107288+0000","last_became_active":"2023-11-28T17:40:27.941068+0000","last_became_peered":"2023-11-28T17:40:27.941068+0000","last_unstale":"2023-11-28T17:40:30.107288+0000","last_undegraded":"2023-11-28T17:40:30.107288+0000","last_fullsized":"2023-11-28T17:40:30.107288+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106675+0000","last_change":"2023-11-28T17:40:27.955864+0000","last_active":"2023-11-28T17:40:30.106675+0000","last_peered":"2023-11-28T17:40:30.106675+0000","last_clean":"2023-11-28T17:40:30.106675+0000","last_became_active":"2023-11-28T17:40:27.955297+0000","last_became_peered":"2023-11-28T17:40:27.955297+0000","last_unstale":"2023-11-28T17:40:30.106675+0000","last_undegraded":"2023-11-28T17:40:30.106675+0000","last_fullsized":"2023-11-28T17:40:30.106675+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.206124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975285+0000","last_change":"2023-11-28T17:40:27.934768+0000","last_active":"2023-11-28T17:40:28.975285+0000","last_peered":"2023-11-28T17:40:28.975285+0000","last_clean":"2023-11-28T17:40:28.975285+0000","last_became_active":"2023-11-28T17:40:27.934424+0000","last_became_peered":"2023-11-28T17:40:27.934424+0000","last_unstale":"2023-11-28T17:40:28.975285+0000","last_undegraded":"2023-11-28T17:40:28.975285+0000","last_fullsized":"2023-11-28T17:40:28.975285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:18.569746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107428+0000","last_change":"2023-11-28T17:40:27.939238+0000","last_active":"2023-11-28T17:40:30.107428+0000","last_peered":"2023-11-28T17:40:30.107428+0000","last_clean":"2023-11-28T17:40:30.107428+0000","last_became_active":"2023-11-28T17:40:27.938943+0000","last_became_peered":"2023-11-28T17:40:27.938943+0000","last_unstale":"2023-11-28T17:40:30.107428+0000","last_undegraded":"2023-11-28T17:40:30.107428+0000","last_fullsized":"2023-11-28T17:40:30.107428+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:38.063099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936003+0000","last_change":"2023-11-28T17:40:27.943150+0000","last_active":"2023-11-28T17:40:28.936003+0000","last_peered":"2023-11-28T17:40:28.936003+0000","last_clean":"2023-11-28T17:40:28.936003+0000","last_became_active":"2023-11-28T17:40:27.942601+0000","last_became_peered":"2023-11-28T17:40:27.942601+0000","last_unstale":"2023-11-28T17:40:28.936003+0000","last_undegraded":"2023-11-28T17:40:28.936003+0000","last_fullsized":"2023-11-28T17:40:28.936003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:22:45.297173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975080+0000","last_change":"2023-11-28T17:40:27.959079+0000","last_active":"2023-11-28T17:40:28.975080+0000","last_peered":"2023-11-28T17:40:28.975080+0000","last_clean":"2023-11-28T17:40:28.975080+0000","last_became_active":"2023-11-28T17:40:27.958809+0000","last_became_peered":"2023-11-28T17:40:27.958809+0000","last_unstale":"2023-11-28T17:40:28.975080+0000","last_undegraded":"2023-11-28T17:40:28.975080+0000","last_fullsized":"2023-11-28T17:40:28.975080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:35:27.083860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106246+0000","last_change":"2023-11-28T17:40:27.951239+0000","last_active":"2023-11-28T17:40:30.106246+0000","last_peered":"2023-11-28T17:40:30.106246+0000","last_clean":"2023-11-28T17:40:30.106246+0000","last_became_active":"2023-11-28T17:40:27.950948+0000","last_became_peered":"2023-11-28T17:40:27.950948+0000","last_unstale":"2023-11-28T17:40:30.106246+0000","last_undegraded":"2023-11-28T17:40:30.106246+0000","last_fullsized":"2023-11-28T17:40:30.106246+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:53.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106935+0000","last_change":"2023-11-28T17:40:27.940469+0000","last_active":"2023-11-28T17:40:30.106935+0000","last_peered":"2023-11-28T17:40:30.106935+0000","last_clean":"2023-11-28T17:40:30.106935+0000","last_became_active":"2023-11-28T17:40:27.940117+0000","last_became_peered":"2023-11-28T17:40:27.940117+0000","last_unstale":"2023-11-28T17:40:30.106935+0000","last_undegraded":"2023-11-28T17:40:30.106935+0000","last_fullsized":"2023-11-28T17:40:30.106935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216013+0000","last_change":"2023-11-28T17:40:27.950747+0000","last_active":"2023-11-28T17:40:29.216013+0000","last_peered":"2023-11-28T17:40:29.216013+0000","last_clean":"2023-11-28T17:40:29.216013+0000","last_became_active":"2023-11-28T17:40:27.950195+0000","last_became_peered":"2023-11-28T17:40:27.950195+0000","last_unstale":"2023-11-28T17:40:29.216013+0000","last_undegraded":"2023-11-28T17:40:29.216013+0000","last_fullsized":"2023-11-28T17:40:29.216013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215919+0000","last_change":"2023-11-28T17:40:27.951518+0000","last_active":"2023-11-28T17:40:29.215919+0000","last_peered":"2023-11-28T17:40:29.215919+0000","last_clean":"2023-11-28T17:40:29.215919+0000","last_became_active":"2023-11-28T17:40:27.951221+0000","last_became_peered":"2023-11-28T17:40:27.951221+0000","last_unstale":"2023-11-28T17:40:29.215919+0000","last_undegraded":"2023-11-28T17:40:29.215919+0000","last_fullsized":"2023-11-28T17:40:29.215919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935865+0000","last_change":"2023-11-28T17:40:27.946566+0000","last_active":"2023-11-28T17:40:28.935865+0000","last_peered":"2023-11-28T17:40:28.935865+0000","last_clean":"2023-11-28T17:40:28.935865+0000","last_became_active":"2023-11-28T17:40:27.946260+0000","last_became_peered":"2023-11-28T17:40:27.946260+0000","last_unstale":"2023-11-28T17:40:28.935865+0000","last_undegraded":"2023-11-28T17:40:28.935865+0000","last_fullsized":"2023-11-28T17:40:28.935865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:24:06.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940483+0000","last_change":"2023-11-28T17:40:27.952326+0000","last_active":"2023-11-28T17:40:28.940483+0000","last_peered":"2023-11-28T17:40:28.940483+0000","last_clean":"2023-11-28T17:40:28.940483+0000","last_became_active":"2023-11-28T17:40:27.951769+0000","last_became_peered":"2023-11-28T17:40:27.951769+0000","last_unstale":"2023-11-28T17:40:28.940483+0000","last_undegraded":"2023-11-28T17:40:28.940483+0000","last_fullsized":"2023-11-28T17:40:28.940483+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:01:10.285439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941104+0000","last_change":"2023-11-28T17:40:27.947358+0000","last_active":"2023-11-28T17:40:28.941104+0000","last_peered":"2023-11-28T17:40:28.941104+0000","last_clean":"2023-11-28T17:40:28.941104+0000","last_became_active":"2023-11-28T17:40:27.946690+0000","last_became_peered":"2023-11-28T17:40:27.946690+0000","last_unstale":"2023-11-28T17:40:28.941104+0000","last_undegraded":"2023-11-28T17:40:28.941104+0000","last_fullsized":"2023-11-28T17:40:28.941104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:17:19.293511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106564+0000","last_change":"2023-11-28T17:40:27.956892+0000","last_active":"2023-11-28T17:40:30.106564+0000","last_peered":"2023-11-28T17:40:30.106564+0000","last_clean":"2023-11-28T17:40:30.106564+0000","last_became_active":"2023-11-28T17:40:27.956511+0000","last_became_peered":"2023-11-28T17:40:27.956511+0000","last_unstale":"2023-11-28T17:40:30.106564+0000","last_undegraded":"2023-11-28T17:40:30.106564+0000","last_fullsized":"2023-11-28T17:40:30.106564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216224+0000","last_change":"2023-11-28T17:40:27.954597+0000","last_active":"2023-11-28T17:40:29.216224+0000","last_peered":"2023-11-28T17:40:29.216224+0000","last_clean":"2023-11-28T17:40:29.216224+0000","last_became_active":"2023-11-28T17:40:27.954320+0000","last_became_peered":"2023-11-28T17:40:27.954320+0000","last_unstale":"2023-11-28T17:40:29.216224+0000","last_undegraded":"2023-11-28T17:40:29.216224+0000","last_fullsized":"2023-11-28T17:40:29.216224+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106853+0000","last_change":"2023-11-28T17:40:27.954220+0000","last_active":"2023-11-28T17:40:30.106853+0000","last_peered":"2023-11-28T17:40:30.106853+0000","last_clean":"2023-11-28T17:40:30.106853+0000","last_became_active":"2023-11-28T17:40:27.953898+0000","last_became_peered":"2023-11-28T17:40:27.953898+0000","last_unstale":"2023-11-28T17:40:30.106853+0000","last_undegraded":"2023-11-28T17:40:30.106853+0000","last_fullsized":"2023-11-28T17:40:30.106853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:14.109959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106092+0000","last_change":"2023-11-28T17:40:27.948419+0000","last_active":"2023-11-28T17:40:30.106092+0000","last_peered":"2023-11-28T17:40:30.106092+0000","last_clean":"2023-11-28T17:40:30.106092+0000","last_became_active":"2023-11-28T17:40:27.948044+0000","last_became_peered":"2023-11-28T17:40:27.948044+0000","last_unstale":"2023-11-28T17:40:30.106092+0000","last_undegraded":"2023-11-28T17:40:30.106092+0000","last_fullsized":"2023-11-28T17:40:30.106092+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:18:37.206124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106732+0000","last_change":"2023-11-28T17:40:27.954027+0000","last_active":"2023-11-28T17:40:30.106732+0000","last_peered":"2023-11-28T17:40:30.106732+0000","last_clean":"2023-11-28T17:40:30.106732+0000","last_became_active":"2023-11-28T17:40:27.953655+0000","last_became_peered":"2023-11-28T17:40:27.953655+0000","last_unstale":"2023-11-28T17:40:30.106732+0000","last_undegraded":"2023-11-28T17:40:30.106732+0000","last_fullsized":"2023-11-28T17:40:30.106732+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:38:09.270172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107588+0000","last_change":"2023-11-28T17:40:27.936255+0000","last_active":"2023-11-28T17:40:30.107588+0000","last_peered":"2023-11-28T17:40:30.107588+0000","last_clean":"2023-11-28T17:40:30.107588+0000","last_became_active":"2023-11-28T17:40:27.935117+0000","last_became_peered":"2023-11-28T17:40:27.935117+0000","last_unstale":"2023-11-28T17:40:30.107588+0000","last_undegraded":"2023-11-28T17:40:30.107588+0000","last_fullsized":"2023-11-28T17:40:30.107588+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:14.342955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107481+0000","last_change":"2023-11-28T17:40:27.938784+0000","last_active":"2023-11-28T17:40:30.107481+0000","last_peered":"2023-11-28T17:40:30.107481+0000","last_clean":"2023-11-28T17:40:30.107481+0000","last_became_active":"2023-11-28T17:40:27.935137+0000","last_became_peered":"2023-11-28T17:40:27.935137+0000","last_unstale":"2023-11-28T17:40:30.107481+0000","last_undegraded":"2023-11-28T17:40:30.107481+0000","last_fullsized":"2023-11-28T17:40:30.107481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:13.629735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940812+0000","last_change":"2023-11-28T17:40:27.946225+0000","last_active":"2023-11-28T17:40:28.940812+0000","last_peered":"2023-11-28T17:40:28.940812+0000","last_clean":"2023-11-28T17:40:28.940812+0000","last_became_active":"2023-11-28T17:40:27.943256+0000","last_became_peered":"2023-11-28T17:40:27.943256+0000","last_unstale":"2023-11-28T17:40:28.940812+0000","last_undegraded":"2023-11-28T17:40:28.940812+0000","last_fullsized":"2023-11-28T17:40:28.940812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107134+0000","last_change":"2023-11-28T17:40:27.957876+0000","last_active":"2023-11-28T17:40:30.107134+0000","last_peered":"2023-11-28T17:40:30.107134+0000","last_clean":"2023-11-28T17:40:30.107134+0000","last_became_active":"2023-11-28T17:40:27.957607+0000","last_became_peered":"2023-11-28T17:40:27.957607+0000","last_unstale":"2023-11-28T17:40:30.107134+0000","last_undegraded":"2023-11-28T17:40:30.107134+0000","last_fullsized":"2023-11-28T17:40:30.107134+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216013+0000","last_change":"2023-11-28T17:40:27.939111+0000","last_active":"2023-11-28T17:40:29.216013+0000","last_peered":"2023-11-28T17:40:29.216013+0000","last_clean":"2023-11-28T17:40:29.216013+0000","last_became_active":"2023-11-28T17:40:27.938816+0000","last_became_peered":"2023-11-28T17:40:27.938816+0000","last_unstale":"2023-11-28T17:40:29.216013+0000","last_undegraded":"2023-11-28T17:40:29.216013+0000","last_fullsized":"2023-11-28T17:40:29.216013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:51.221215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215980+0000","last_change":"2023-11-28T17:40:27.938903+0000","last_active":"2023-11-28T17:40:29.215980+0000","last_peered":"2023-11-28T17:40:29.215980+0000","last_clean":"2023-11-28T17:40:29.215980+0000","last_became_active":"2023-11-28T17:40:27.938637+0000","last_became_peered":"2023-11-28T17:40:27.938637+0000","last_unstale":"2023-11-28T17:40:29.215980+0000","last_undegraded":"2023-11-28T17:40:29.215980+0000","last_fullsized":"2023-11-28T17:40:29.215980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106823+0000","last_change":"2023-11-28T17:40:27.955627+0000","last_active":"2023-11-28T17:40:30.106823+0000","last_peered":"2023-11-28T17:40:30.106823+0000","last_clean":"2023-11-28T17:40:30.106823+0000","last_became_active":"2023-11-28T17:40:27.955308+0000","last_became_peered":"2023-11-28T17:40:27.955308+0000","last_unstale":"2023-11-28T17:40:30.106823+0000","last_undegraded":"2023-11-28T17:40:30.106823+0000","last_fullsized":"2023-11-28T17:40:30.106823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:53.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936104+0000","last_change":"2023-11-28T17:40:27.942869+0000","last_active":"2023-11-28T17:40:28.936104+0000","last_peered":"2023-11-28T17:40:28.936104+0000","last_clean":"2023-11-28T17:40:28.936104+0000","last_became_active":"2023-11-28T17:40:27.942548+0000","last_became_peered":"2023-11-28T17:40:27.942548+0000","last_unstale":"2023-11-28T17:40:28.936104+0000","last_undegraded":"2023-11-28T17:40:28.936104+0000","last_fullsized":"2023-11-28T17:40:28.936104+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:27:51.203222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106586+0000","last_change":"2023-11-28T17:40:27.947426+0000","last_active":"2023-11-28T17:40:30.106586+0000","last_peered":"2023-11-28T17:40:30.106586+0000","last_clean":"2023-11-28T17:40:30.106586+0000","last_became_active":"2023-11-28T17:40:27.946841+0000","last_became_peered":"2023-11-28T17:40:27.946841+0000","last_unstale":"2023-11-28T17:40:30.106586+0000","last_undegraded":"2023-11-28T17:40:30.106586+0000","last_fullsized":"2023-11-28T17:40:30.106586+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.958478+0000","last_change":"2023-11-28T17:40:26.927946+0000","last_active":"2023-11-28T17:40:27.958478+0000","last_peered":"2023-11-28T17:40:27.958478+0000","last_clean":"2023-11-28T17:40:27.958478+0000","last_became_active":"2023-11-28T17:40:26.927239+0000","last_became_peered":"2023-11-28T17:40:26.927239+0000","last_unstale":"2023-11-28T17:40:27.958478+0000","last_undegraded":"2023-11-28T17:40:27.958478+0000","last_fullsized":"2023-11-28T17:40:27.958478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:22:13.335553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107166+0000","last_change":"2023-11-28T17:40:27.939400+0000","last_active":"2023-11-28T17:40:30.107166+0000","last_peered":"2023-11-28T17:40:30.107166+0000","last_clean":"2023-11-28T17:40:30.107166+0000","last_became_active":"2023-11-28T17:40:27.939101+0000","last_became_peered":"2023-11-28T17:40:27.939101+0000","last_unstale":"2023-11-28T17:40:30.107166+0000","last_undegraded":"2023-11-28T17:40:30.107166+0000","last_fullsized":"2023-11-28T17:40:30.107166+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.953772+0000","last_change":"2023-11-28T17:40:26.936375+0000","last_active":"2023-11-28T17:40:27.953772+0000","last_peered":"2023-11-28T17:40:27.953772+0000","last_clean":"2023-11-28T17:40:27.953772+0000","last_became_active":"2023-11-28T17:40:26.936085+0000","last_became_peered":"2023-11-28T17:40:26.936085+0000","last_unstale":"2023-11-28T17:40:27.953772+0000","last_undegraded":"2023-11-28T17:40:27.953772+0000","last_fullsized":"2023-11-28T17:40:27.953772+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:25.903111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107203+0000","last_change":"2023-11-28T17:40:27.954138+0000","last_active":"2023-11-28T17:40:30.107203+0000","last_peered":"2023-11-28T17:40:30.107203+0000","last_clean":"2023-11-28T17:40:30.107203+0000","last_became_active":"2023-11-28T17:40:27.953676+0000","last_became_peered":"2023-11-28T17:40:27.953676+0000","last_unstale":"2023-11-28T17:40:30.107203+0000","last_undegraded":"2023-11-28T17:40:30.107203+0000","last_fullsized":"2023-11-28T17:40:30.107203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941503+0000","last_change":"2023-11-28T17:40:26.934639+0000","last_active":"2023-11-28T17:40:28.941503+0000","last_peered":"2023-11-28T17:40:28.941503+0000","last_clean":"2023-11-28T17:40:28.941503+0000","last_became_active":"2023-11-28T17:40:26.934345+0000","last_became_peered":"2023-11-28T17:40:26.934345+0000","last_unstale":"2023-11-28T17:40:28.941503+0000","last_undegraded":"2023-11-28T17:40:28.941503+0000","last_fullsized":"2023-11-28T17:40:28.941503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:31.675585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107352+0000","last_change":"2023-11-28T17:40:27.952787+0000","last_active":"2023-11-28T17:40:30.107352+0000","last_peered":"2023-11-28T17:40:30.107352+0000","last_clean":"2023-11-28T17:40:30.107352+0000","last_became_active":"2023-11-28T17:40:27.952511+0000","last_became_peered":"2023-11-28T17:40:27.952511+0000","last_unstale":"2023-11-28T17:40:30.107352+0000","last_undegraded":"2023-11-28T17:40:30.107352+0000","last_fullsized":"2023-11-28T17:40:30.107352+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:14.162764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.962995+0000","last_change":"2023-11-28T17:40:26.935178+0000","last_active":"2023-11-28T17:40:27.962995+0000","last_peered":"2023-11-28T17:40:27.962995+0000","last_clean":"2023-11-28T17:40:27.962995+0000","last_became_active":"2023-11-28T17:40:26.934878+0000","last_became_peered":"2023-11-28T17:40:26.934878+0000","last_unstale":"2023-11-28T17:40:27.962995+0000","last_undegraded":"2023-11-28T17:40:27.962995+0000","last_fullsized":"2023-11-28T17:40:27.962995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:06:50.213813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975174+0000","last_change":"2023-11-28T17:40:27.934749+0000","last_active":"2023-11-28T17:40:28.975174+0000","last_peered":"2023-11-28T17:40:28.975174+0000","last_clean":"2023-11-28T17:40:28.975174+0000","last_became_active":"2023-11-28T17:40:27.934482+0000","last_became_peered":"2023-11-28T17:40:27.934482+0000","last_unstale":"2023-11-28T17:40:28.975174+0000","last_undegraded":"2023-11-28T17:40:28.975174+0000","last_fullsized":"2023-11-28T17:40:28.975174+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:18:42.240654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.954048+0000","last_change":"2023-11-28T17:40:26.934061+0000","last_active":"2023-11-28T17:40:27.954048+0000","last_peered":"2023-11-28T17:40:27.954048+0000","last_clean":"2023-11-28T17:40:27.954048+0000","last_became_active":"2023-11-28T17:40:26.932628+0000","last_became_peered":"2023-11-28T17:40:26.932628+0000","last_unstale":"2023-11-28T17:40:27.954048+0000","last_undegraded":"2023-11-28T17:40:27.954048+0000","last_fullsized":"2023-11-28T17:40:27.954048+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:48.337820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106949+0000","last_change":"2023-11-28T17:40:27.952140+0000","last_active":"2023-11-28T17:40:30.106949+0000","last_peered":"2023-11-28T17:40:30.106949+0000","last_clean":"2023-11-28T17:40:30.106949+0000","last_became_active":"2023-11-28T17:40:27.948771+0000","last_became_peered":"2023-11-28T17:40:27.948771+0000","last_unstale":"2023-11-28T17:40:30.106949+0000","last_undegraded":"2023-11-28T17:40:30.106949+0000","last_fullsized":"2023-11-28T17:40:30.106949+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:26.910513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.957197+0000","last_change":"2023-11-28T17:40:26.935301+0000","last_active":"2023-11-28T17:40:27.957197+0000","last_peered":"2023-11-28T17:40:27.957197+0000","last_clean":"2023-11-28T17:40:27.957197+0000","last_became_active":"2023-11-28T17:40:26.932982+0000","last_became_peered":"2023-11-28T17:40:26.932982+0000","last_unstale":"2023-11-28T17:40:27.957197+0000","last_undegraded":"2023-11-28T17:40:27.957197+0000","last_fullsized":"2023-11-28T17:40:27.957197+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975003+0000","last_change":"2023-11-28T17:40:27.933484+0000","last_active":"2023-11-28T17:40:28.975003+0000","last_peered":"2023-11-28T17:40:28.975003+0000","last_clean":"2023-11-28T17:40:28.975003+0000","last_became_active":"2023-11-28T17:40:27.932519+0000","last_became_peered":"2023-11-28T17:40:27.932519+0000","last_unstale":"2023-11-28T17:40:28.975003+0000","last_undegraded":"2023-11-28T17:40:28.975003+0000","last_fullsized":"2023-11-28T17:40:28.975003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:16:03.460782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940267+0000","last_change":"2023-11-28T17:40:26.938953+0000","last_active":"2023-11-28T17:40:28.940267+0000","last_peered":"2023-11-28T17:40:28.940267+0000","last_clean":"2023-11-28T17:40:28.940267+0000","last_became_active":"2023-11-28T17:40:26.935951+0000","last_became_peered":"2023-11-28T17:40:26.935951+0000","last_unstale":"2023-11-28T17:40:28.940267+0000","last_undegraded":"2023-11-28T17:40:28.940267+0000","last_fullsized":"2023-11-28T17:40:28.940267+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:24:26.480682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106813+0000","last_change":"2023-11-28T17:40:27.934329+0000","last_active":"2023-11-28T17:40:30.106813+0000","last_peered":"2023-11-28T17:40:30.106813+0000","last_clean":"2023-11-28T17:40:30.106813+0000","last_became_active":"2023-11-28T17:40:27.933994+0000","last_became_peered":"2023-11-28T17:40:27.933994+0000","last_unstale":"2023-11-28T17:40:30.106813+0000","last_undegraded":"2023-11-28T17:40:30.106813+0000","last_fullsized":"2023-11-28T17:40:30.106813+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:07:22.336664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.935649+0000","last_change":"2023-11-28T17:40:26.933807+0000","last_active":"2023-11-28T17:40:27.935649+0000","last_peered":"2023-11-28T17:40:27.935649+0000","last_clean":"2023-11-28T17:40:27.935649+0000","last_became_active":"2023-11-28T17:40:26.933505+0000","last_became_peered":"2023-11-28T17:40:26.933505+0000","last_unstale":"2023-11-28T17:40:27.935649+0000","last_undegraded":"2023-11-28T17:40:27.935649+0000","last_fullsized":"2023-11-28T17:40:27.935649+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:38:48.648901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935872+0000","last_change":"2023-11-28T17:40:27.947376+0000","last_active":"2023-11-28T17:40:28.935872+0000","last_peered":"2023-11-28T17:40:28.935872+0000","last_clean":"2023-11-28T17:40:28.935872+0000","last_became_active":"2023-11-28T17:40:27.947051+0000","last_became_peered":"2023-11-28T17:40:27.947051+0000","last_unstale":"2023-11-28T17:40:28.935872+0000","last_undegraded":"2023-11-28T17:40:28.935872+0000","last_fullsized":"2023-11-28T17:40:28.935872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:16:18.077272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.930522+0000","last_change":"2023-11-28T17:40:26.942248+0000","last_active":"2023-11-28T17:40:27.930522+0000","last_peered":"2023-11-28T17:40:27.930522+0000","last_clean":"2023-11-28T17:40:27.930522+0000","last_became_active":"2023-11-28T17:40:26.941803+0000","last_became_peered":"2023-11-28T17:40:26.941803+0000","last_unstale":"2023-11-28T17:40:27.930522+0000","last_undegraded":"2023-11-28T17:40:27.930522+0000","last_fullsized":"2023-11-28T17:40:27.930522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:22:25.903111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107611+0000","last_change":"2023-11-28T17:40:27.941143+0000","last_active":"2023-11-28T17:40:30.107611+0000","last_peered":"2023-11-28T17:40:30.107611+0000","last_clean":"2023-11-28T17:40:30.107611+0000","last_became_active":"2023-11-28T17:40:27.940852+0000","last_became_peered":"2023-11-28T17:40:27.940852+0000","last_unstale":"2023-11-28T17:40:30.107611+0000","last_undegraded":"2023-11-28T17:40:30.107611+0000","last_fullsized":"2023-11-28T17:40:30.107611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:00.453594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.926512+0000","last_change":"2023-11-28T17:40:26.927546+0000","last_active":"2023-11-28T17:40:27.926512+0000","last_peered":"2023-11-28T17:40:27.926512+0000","last_clean":"2023-11-28T17:40:27.926512+0000","last_became_active":"2023-11-28T17:40:26.927255+0000","last_became_peered":"2023-11-28T17:40:26.927255+0000","last_unstale":"2023-11-28T17:40:27.926512+0000","last_undegraded":"2023-11-28T17:40:27.926512+0000","last_fullsized":"2023-11-28T17:40:27.926512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:25:52.481426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107190+0000","last_change":"2023-11-28T17:40:27.950552+0000","last_active":"2023-11-28T17:40:30.107190+0000","last_peered":"2023-11-28T17:40:30.107190+0000","last_clean":"2023-11-28T17:40:30.107190+0000","last_became_active":"2023-11-28T17:40:27.950272+0000","last_became_peered":"2023-11-28T17:40:27.950272+0000","last_unstale":"2023-11-28T17:40:30.107190+0000","last_undegraded":"2023-11-28T17:40:30.107190+0000","last_fullsized":"2023-11-28T17:40:30.107190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:01.505965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.957480+0000","last_change":"2023-11-28T17:40:26.936775+0000","last_active":"2023-11-28T17:40:27.957480+0000","last_peered":"2023-11-28T17:40:27.957480+0000","last_clean":"2023-11-28T17:40:27.957480+0000","last_became_active":"2023-11-28T17:40:26.936489+0000","last_became_peered":"2023-11-28T17:40:26.936489+0000","last_unstale":"2023-11-28T17:40:27.957480+0000","last_undegraded":"2023-11-28T17:40:27.957480+0000","last_fullsized":"2023-11-28T17:40:27.957480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:12.622333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.936000+0000","last_change":"2023-11-28T17:40:27.942869+0000","last_active":"2023-11-28T17:40:28.936000+0000","last_peered":"2023-11-28T17:40:28.936000+0000","last_clean":"2023-11-28T17:40:28.936000+0000","last_became_active":"2023-11-28T17:40:27.942336+0000","last_became_peered":"2023-11-28T17:40:27.942336+0000","last_unstale":"2023-11-28T17:40:28.936000+0000","last_undegraded":"2023-11-28T17:40:28.936000+0000","last_fullsized":"2023-11-28T17:40:28.936000+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:22:28.761668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.969170+0000","last_change":"2023-11-28T17:40:26.941495+0000","last_active":"2023-11-28T17:40:27.969170+0000","last_peered":"2023-11-28T17:40:27.969170+0000","last_clean":"2023-11-28T17:40:27.969170+0000","last_became_active":"2023-11-28T17:40:26.941160+0000","last_became_peered":"2023-11-28T17:40:26.941160+0000","last_unstale":"2023-11-28T17:40:27.969170+0000","last_undegraded":"2023-11-28T17:40:27.969170+0000","last_fullsized":"2023-11-28T17:40:27.969170+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106179+0000","last_change":"2023-11-28T17:40:27.943820+0000","last_active":"2023-11-28T17:40:30.106179+0000","last_peered":"2023-11-28T17:40:30.106179+0000","last_clean":"2023-11-28T17:40:30.106179+0000","last_became_active":"2023-11-28T17:40:27.943514+0000","last_became_peered":"2023-11-28T17:40:27.943514+0000","last_unstale":"2023-11-28T17:40:30.106179+0000","last_undegraded":"2023-11-28T17:40:30.106179+0000","last_fullsized":"2023-11-28T17:40:30.106179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:38:09.270172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.952342+0000","last_change":"2023-11-28T17:40:26.937343+0000","last_active":"2023-11-28T17:40:27.952342+0000","last_peered":"2023-11-28T17:40:27.952342+0000","last_clean":"2023-11-28T17:40:27.952342+0000","last_became_active":"2023-11-28T17:40:26.937064+0000","last_became_peered":"2023-11-28T17:40:26.937064+0000","last_unstale":"2023-11-28T17:40:27.952342+0000","last_undegraded":"2023-11-28T17:40:27.952342+0000","last_fullsized":"2023-11-28T17:40:27.952342+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:58.337146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107141+0000","last_change":"2023-11-28T17:40:27.959543+0000","last_active":"2023-11-28T17:40:30.107141+0000","last_peered":"2023-11-28T17:40:30.107141+0000","last_clean":"2023-11-28T17:40:30.107141+0000","last_became_active":"2023-11-28T17:40:27.959257+0000","last_became_peered":"2023-11-28T17:40:27.959257+0000","last_unstale":"2023-11-28T17:40:30.107141+0000","last_undegraded":"2023-11-28T17:40:30.107141+0000","last_fullsized":"2023-11-28T17:40:30.107141+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:38:14.042176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.922464+0000","last_change":"2023-11-28T17:40:26.935707+0000","last_active":"2023-11-28T17:40:27.922464+0000","last_peered":"2023-11-28T17:40:27.922464+0000","last_clean":"2023-11-28T17:40:27.922464+0000","last_became_active":"2023-11-28T17:40:26.935413+0000","last_became_peered":"2023-11-28T17:40:26.935413+0000","last_unstale":"2023-11-28T17:40:27.922464+0000","last_undegraded":"2023-11-28T17:40:27.922464+0000","last_fullsized":"2023-11-28T17:40:27.922464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:13.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106826+0000","last_change":"2023-11-28T17:40:27.941465+0000","last_active":"2023-11-28T17:40:30.106826+0000","last_peered":"2023-11-28T17:40:30.106826+0000","last_clean":"2023-11-28T17:40:30.106826+0000","last_became_active":"2023-11-28T17:40:27.940962+0000","last_became_peered":"2023-11-28T17:40:27.940962+0000","last_unstale":"2023-11-28T17:40:30.106826+0000","last_undegraded":"2023-11-28T17:40:30.106826+0000","last_fullsized":"2023-11-28T17:40:30.106826+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:11.345803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.921851+0000","last_change":"2023-11-28T17:40:26.938693+0000","last_active":"2023-11-28T17:40:27.921851+0000","last_peered":"2023-11-28T17:40:27.921851+0000","last_clean":"2023-11-28T17:40:27.921851+0000","last_became_active":"2023-11-28T17:40:26.937922+0000","last_became_peered":"2023-11-28T17:40:26.937922+0000","last_unstale":"2023-11-28T17:40:27.921851+0000","last_undegraded":"2023-11-28T17:40:27.921851+0000","last_fullsized":"2023-11-28T17:40:27.921851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:10.338401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935682+0000","last_change":"2023-11-28T17:40:27.944600+0000","last_active":"2023-11-28T17:40:28.935682+0000","last_peered":"2023-11-28T17:40:28.935682+0000","last_clean":"2023-11-28T17:40:28.935682+0000","last_became_active":"2023-11-28T17:40:27.944295+0000","last_became_peered":"2023-11-28T17:40:27.944295+0000","last_unstale":"2023-11-28T17:40:28.935682+0000","last_undegraded":"2023-11-28T17:40:28.935682+0000","last_fullsized":"2023-11-28T17:40:28.935682+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:20:00.453594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940214+0000","last_change":"2023-11-28T17:40:26.940626+0000","last_active":"2023-11-28T17:40:28.940214+0000","last_peered":"2023-11-28T17:40:28.940214+0000","last_clean":"2023-11-28T17:40:28.940214+0000","last_became_active":"2023-11-28T17:40:26.938026+0000","last_became_peered":"2023-11-28T17:40:26.938026+0000","last_unstale":"2023-11-28T17:40:28.940214+0000","last_undegraded":"2023-11-28T17:40:28.940214+0000","last_fullsized":"2023-11-28T17:40:28.940214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:09:56.702406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935998+0000","last_change":"2023-11-28T17:40:27.933249+0000","last_active":"2023-11-28T17:40:28.935998+0000","last_peered":"2023-11-28T17:40:28.935998+0000","last_clean":"2023-11-28T17:40:28.935998+0000","last_became_active":"2023-11-28T17:40:27.932961+0000","last_became_peered":"2023-11-28T17:40:27.932961+0000","last_unstale":"2023-11-28T17:40:28.935998+0000","last_undegraded":"2023-11-28T17:40:28.935998+0000","last_fullsized":"2023-11-28T17:40:28.935998+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:09:01.314498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940599+0000","last_change":"2023-11-28T17:40:26.939525+0000","last_active":"2023-11-28T17:40:28.940599+0000","last_peered":"2023-11-28T17:40:28.940599+0000","last_clean":"2023-11-28T17:40:28.940599+0000","last_became_active":"2023-11-28T17:40:26.939241+0000","last_became_peered":"2023-11-28T17:40:26.939241+0000","last_unstale":"2023-11-28T17:40:28.940599+0000","last_undegraded":"2023-11-28T17:40:28.940599+0000","last_fullsized":"2023-11-28T17:40:28.940599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:34:33.623664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975332+0000","last_change":"2023-11-28T17:40:27.932349+0000","last_active":"2023-11-28T17:40:28.975332+0000","last_peered":"2023-11-28T17:40:28.975332+0000","last_clean":"2023-11-28T17:40:28.975332+0000","last_became_active":"2023-11-28T17:40:27.930754+0000","last_became_peered":"2023-11-28T17:40:27.930754+0000","last_unstale":"2023-11-28T17:40:28.975332+0000","last_undegraded":"2023-11-28T17:40:28.975332+0000","last_fullsized":"2023-11-28T17:40:28.975332+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:36:44.527346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951285+0000","last_change":"2023-11-28T17:40:26.931143+0000","last_active":"2023-11-28T17:40:27.951285+0000","last_peered":"2023-11-28T17:40:27.951285+0000","last_clean":"2023-11-28T17:40:27.951285+0000","last_became_active":"2023-11-28T17:40:26.930860+0000","last_became_peered":"2023-11-28T17:40:26.930860+0000","last_unstale":"2023-11-28T17:40:27.951285+0000","last_undegraded":"2023-11-28T17:40:27.951285+0000","last_fullsized":"2023-11-28T17:40:27.951285+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:04:12.304015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940783+0000","last_change":"2023-11-28T17:40:27.935780+0000","last_active":"2023-11-28T17:40:28.940783+0000","last_peered":"2023-11-28T17:40:28.940783+0000","last_clean":"2023-11-28T17:40:28.940783+0000","last_became_active":"2023-11-28T17:40:27.935486+0000","last_became_peered":"2023-11-28T17:40:27.935486+0000","last_unstale":"2023-11-28T17:40:28.940783+0000","last_undegraded":"2023-11-28T17:40:28.940783+0000","last_fullsized":"2023-11-28T17:40:28.940783+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.956347+0000","last_change":"2023-11-28T17:40:26.934185+0000","last_active":"2023-11-28T17:40:27.956347+0000","last_peered":"2023-11-28T17:40:27.956347+0000","last_clean":"2023-11-28T17:40:27.956347+0000","last_became_active":"2023-11-28T17:40:26.933685+0000","last_became_peered":"2023-11-28T17:40:26.933685+0000","last_unstale":"2023-11-28T17:40:27.956347+0000","last_undegraded":"2023-11-28T17:40:27.956347+0000","last_fullsized":"2023-11-28T17:40:27.956347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:27:13.155362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941245+0000","last_change":"2023-11-28T17:40:27.947556+0000","last_active":"2023-11-28T17:40:28.941245+0000","last_peered":"2023-11-28T17:40:28.941245+0000","last_clean":"2023-11-28T17:40:28.941245+0000","last_became_active":"2023-11-28T17:40:27.947021+0000","last_became_peered":"2023-11-28T17:40:27.947021+0000","last_unstale":"2023-11-28T17:40:28.941245+0000","last_undegraded":"2023-11-28T17:40:28.941245+0000","last_fullsized":"2023-11-28T17:40:28.941245+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:48:42.830805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.917361+0000","last_change":"2023-11-28T17:40:26.933719+0000","last_active":"2023-11-28T17:40:27.917361+0000","last_peered":"2023-11-28T17:40:27.917361+0000","last_clean":"2023-11-28T17:40:27.917361+0000","last_became_active":"2023-11-28T17:40:26.932832+0000","last_became_peered":"2023-11-28T17:40:26.932832+0000","last_unstale":"2023-11-28T17:40:27.917361+0000","last_undegraded":"2023-11-28T17:40:27.917361+0000","last_fullsized":"2023-11-28T17:40:27.917361+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:23.182794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106367+0000","last_change":"2023-11-28T17:40:27.943358+0000","last_active":"2023-11-28T17:40:30.106367+0000","last_peered":"2023-11-28T17:40:30.106367+0000","last_clean":"2023-11-28T17:40:30.106367+0000","last_became_active":"2023-11-28T17:40:27.943032+0000","last_became_peered":"2023-11-28T17:40:27.943032+0000","last_unstale":"2023-11-28T17:40:30.106367+0000","last_undegraded":"2023-11-28T17:40:30.106367+0000","last_fullsized":"2023-11-28T17:40:30.106367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:11.345803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951408+0000","last_change":"2023-11-28T17:40:26.932256+0000","last_active":"2023-11-28T17:40:27.951408+0000","last_peered":"2023-11-28T17:40:27.951408+0000","last_clean":"2023-11-28T17:40:27.951408+0000","last_became_active":"2023-11-28T17:40:26.931963+0000","last_became_peered":"2023-11-28T17:40:26.931963+0000","last_unstale":"2023-11-28T17:40:27.951408+0000","last_undegraded":"2023-11-28T17:40:27.951408+0000","last_fullsized":"2023-11-28T17:40:27.951408+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:15:10.338401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941041+0000","last_change":"2023-11-28T17:40:27.948756+0000","last_active":"2023-11-28T17:40:28.941041+0000","last_peered":"2023-11-28T17:40:28.941041+0000","last_clean":"2023-11-28T17:40:28.941041+0000","last_became_active":"2023-11-28T17:40:27.948477+0000","last_became_peered":"2023-11-28T17:40:27.948477+0000","last_unstale":"2023-11-28T17:40:28.941041+0000","last_undegraded":"2023-11-28T17:40:28.941041+0000","last_fullsized":"2023-11-28T17:40:28.941041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.936202+0000","last_change":"2023-11-28T17:40:26.931177+0000","last_active":"2023-11-28T17:40:27.936202+0000","last_peered":"2023-11-28T17:40:27.936202+0000","last_clean":"2023-11-28T17:40:27.936202+0000","last_became_active":"2023-11-28T17:40:26.930885+0000","last_became_peered":"2023-11-28T17:40:26.930885+0000","last_unstale":"2023-11-28T17:40:27.936202+0000","last_undegraded":"2023-11-28T17:40:27.936202+0000","last_fullsized":"2023-11-28T17:40:27.936202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:09.133492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106076+0000","last_change":"2023-11-28T17:40:27.952232+0000","last_active":"2023-11-28T17:40:30.106076+0000","last_peered":"2023-11-28T17:40:30.106076+0000","last_clean":"2023-11-28T17:40:30.106076+0000","last_became_active":"2023-11-28T17:40:27.951907+0000","last_became_peered":"2023-11-28T17:40:27.951907+0000","last_unstale":"2023-11-28T17:40:30.106076+0000","last_undegraded":"2023-11-28T17:40:30.106076+0000","last_fullsized":"2023-11-28T17:40:30.106076+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:24.190196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.918883+0000","last_change":"2023-11-28T17:40:26.946081+0000","last_active":"2023-11-28T17:40:27.918883+0000","last_peered":"2023-11-28T17:40:27.918883+0000","last_clean":"2023-11-28T17:40:27.918883+0000","last_became_active":"2023-11-28T17:40:26.945847+0000","last_became_peered":"2023-11-28T17:40:26.945847+0000","last_unstale":"2023-11-28T17:40:27.918883+0000","last_undegraded":"2023-11-28T17:40:27.918883+0000","last_fullsized":"2023-11-28T17:40:27.918883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:30:28.336537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.975115+0000","last_change":"2023-11-28T17:40:27.925069+0000","last_active":"2023-11-28T17:40:28.975115+0000","last_peered":"2023-11-28T17:40:28.975115+0000","last_clean":"2023-11-28T17:40:28.975115+0000","last_became_active":"2023-11-28T17:40:27.924556+0000","last_became_peered":"2023-11-28T17:40:27.924556+0000","last_unstale":"2023-11-28T17:40:28.975115+0000","last_undegraded":"2023-11-28T17:40:28.975115+0000","last_fullsized":"2023-11-28T17:40:28.975115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:55:49.294183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.925235+0000","last_change":"2023-11-28T17:40:26.931615+0000","last_active":"2023-11-28T17:40:27.925235+0000","last_peered":"2023-11-28T17:40:27.925235+0000","last_clean":"2023-11-28T17:40:27.925235+0000","last_became_active":"2023-11-28T17:40:26.931265+0000","last_became_peered":"2023-11-28T17:40:26.931265+0000","last_unstale":"2023-11-28T17:40:27.925235+0000","last_undegraded":"2023-11-28T17:40:27.925235+0000","last_fullsized":"2023-11-28T17:40:27.925235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T18:29:00.498563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.940561+0000","last_change":"2023-11-28T17:40:27.952115+0000","last_active":"2023-11-28T17:40:28.940561+0000","last_peered":"2023-11-28T17:40:28.940561+0000","last_clean":"2023-11-28T17:40:28.940561+0000","last_became_active":"2023-11-28T17:40:27.951381+0000","last_became_peered":"2023-11-28T17:40:27.951381+0000","last_unstale":"2023-11-28T17:40:28.940561+0000","last_undegraded":"2023-11-28T17:40:28.940561+0000","last_fullsized":"2023-11-28T17:40:28.940561+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:42:21.105746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.951085+0000","last_change":"2023-11-28T17:40:26.939295+0000","last_active":"2023-11-28T17:40:27.951085+0000","last_peered":"2023-11-28T17:40:27.951085+0000","last_clean":"2023-11-28T17:40:27.951085+0000","last_became_active":"2023-11-28T17:40:26.938074+0000","last_became_peered":"2023-11-28T17:40:26.938074+0000","last_unstale":"2023-11-28T17:40:27.951085+0000","last_undegraded":"2023-11-28T17:40:27.951085+0000","last_fullsized":"2023-11-28T17:40:27.951085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:33:09.133492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935942+0000","last_change":"2023-11-28T17:40:27.950731+0000","last_active":"2023-11-28T17:40:28.935942+0000","last_peered":"2023-11-28T17:40:28.935942+0000","last_clean":"2023-11-28T17:40:28.935942+0000","last_became_active":"2023-11-28T17:40:27.949604+0000","last_became_peered":"2023-11-28T17:40:27.949604+0000","last_unstale":"2023-11-28T17:40:28.935942+0000","last_undegraded":"2023-11-28T17:40:28.935942+0000","last_fullsized":"2023-11-28T17:40:28.935942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:01:05.741714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941483+0000","last_change":"2023-11-28T17:40:26.927541+0000","last_active":"2023-11-28T17:40:28.941483+0000","last_peered":"2023-11-28T17:40:28.941483+0000","last_clean":"2023-11-28T17:40:28.941483+0000","last_became_active":"2023-11-28T17:40:26.926798+0000","last_became_peered":"2023-11-28T17:40:26.926798+0000","last_unstale":"2023-11-28T17:40:28.941483+0000","last_undegraded":"2023-11-28T17:40:28.941483+0000","last_fullsized":"2023-11-28T17:40:28.941483+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:00:13.102558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.941395+0000","last_change":"2023-11-28T17:40:27.964200+0000","last_active":"2023-11-28T17:40:28.941395+0000","last_peered":"2023-11-28T17:40:28.941395+0000","last_clean":"2023-11-28T17:40:28.941395+0000","last_became_active":"2023-11-28T17:40:27.963801+0000","last_became_peered":"2023-11-28T17:40:27.963801+0000","last_unstale":"2023-11-28T17:40:28.941395+0000","last_undegraded":"2023-11-28T17:40:28.941395+0000","last_fullsized":"2023-11-28T17:40:28.941395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:56:29.022310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.930045+0000","last_change":"2023-11-28T17:40:26.929535+0000","last_active":"2023-11-28T17:40:27.930045+0000","last_peered":"2023-11-28T17:40:27.930045+0000","last_clean":"2023-11-28T17:40:27.930045+0000","last_became_active":"2023-11-28T17:40:26.929195+0000","last_became_peered":"2023-11-28T17:40:26.929195+0000","last_unstale":"2023-11-28T17:40:27.930045+0000","last_undegraded":"2023-11-28T17:40:27.930045+0000","last_fullsized":"2023-11-28T17:40:27.930045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:45:48.337820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.215994+0000","last_change":"2023-11-28T17:40:27.950605+0000","last_active":"2023-11-28T17:40:29.215994+0000","last_peered":"2023-11-28T17:40:29.215994+0000","last_clean":"2023-11-28T17:40:29.215994+0000","last_became_active":"2023-11-28T17:40:27.950249+0000","last_became_peered":"2023-11-28T17:40:27.950249+0000","last_unstale":"2023-11-28T17:40:29.215994+0000","last_undegraded":"2023-11-28T17:40:29.215994+0000","last_fullsized":"2023-11-28T17:40:29.215994+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:17:44.102741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.937353+0000","last_change":"2023-11-28T17:40:26.938080+0000","last_active":"2023-11-28T17:40:27.937353+0000","last_peered":"2023-11-28T17:40:27.937353+0000","last_clean":"2023-11-28T17:40:27.937353+0000","last_became_active":"2023-11-28T17:40:26.937738+0000","last_became_peered":"2023-11-28T17:40:26.937738+0000","last_unstale":"2023-11-28T17:40:27.937353+0000","last_undegraded":"2023-11-28T17:40:27.937353+0000","last_fullsized":"2023-11-28T17:40:27.937353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:57:58.337146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.107335+0000","last_change":"2023-11-28T17:40:27.954352+0000","last_active":"2023-11-28T17:40:30.107335+0000","last_peered":"2023-11-28T17:40:30.107335+0000","last_clean":"2023-11-28T17:40:30.107335+0000","last_became_active":"2023-11-28T17:40:27.954059+0000","last_became_peered":"2023-11-28T17:40:27.954059+0000","last_unstale":"2023-11-28T17:40:30.107335+0000","last_undegraded":"2023-11-28T17:40:30.107335+0000","last_fullsized":"2023-11-28T17:40:30.107335+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:41:38.101907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.927949+0000","last_change":"2023-11-28T17:40:26.931119+0000","last_active":"2023-11-28T17:40:27.927949+0000","last_peered":"2023-11-28T17:40:27.927949+0000","last_clean":"2023-11-28T17:40:27.927949+0000","last_became_active":"2023-11-28T17:40:26.930806+0000","last_became_peered":"2023-11-28T17:40:26.930806+0000","last_unstale":"2023-11-28T17:40:27.927949+0000","last_undegraded":"2023-11-28T17:40:27.927949+0000","last_fullsized":"2023-11-28T17:40:27.927949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:42:17.562344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:30.106858+0000","last_change":"2023-11-28T17:40:27.937688+0000","last_active":"2023-11-28T17:40:30.106858+0000","last_peered":"2023-11-28T17:40:30.106858+0000","last_clean":"2023-11-28T17:40:30.106858+0000","last_became_active":"2023-11-28T17:40:27.937334+0000","last_became_peered":"2023-11-28T17:40:27.937334+0000","last_unstale":"2023-11-28T17:40:30.106858+0000","last_undegraded":"2023-11-28T17:40:30.106858+0000","last_fullsized":"2023-11-28T17:40:30.106858+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:07:46.542991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.940788+0000","last_change":"2023-11-28T17:40:26.932477+0000","last_active":"2023-11-28T17:40:27.940788+0000","last_peered":"2023-11-28T17:40:27.940788+0000","last_clean":"2023-11-28T17:40:27.940788+0000","last_became_active":"2023-11-28T17:40:26.930810+0000","last_became_peered":"2023-11-28T17:40:26.930810+0000","last_unstale":"2023-11-28T17:40:27.940788+0000","last_undegraded":"2023-11-28T17:40:27.940788+0000","last_fullsized":"2023-11-28T17:40:27.940788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:50:23.182794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:28.935711+0000","last_change":"2023-11-28T17:40:27.949096+0000","last_active":"2023-11-28T17:40:28.935711+0000","last_peered":"2023-11-28T17:40:28.935711+0000","last_clean":"2023-11-28T17:40:28.935711+0000","last_became_active":"2023-11-28T17:40:27.948781+0000","last_became_peered":"2023-11-28T17:40:27.948781+0000","last_unstale":"2023-11-28T17:40:28.935711+0000","last_undegraded":"2023-11-28T17:40:28.935711+0000","last_fullsized":"2023-11-28T17:40:28.935711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:47:28.966721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.920356+0000","last_change":"2023-11-28T17:40:26.937241+0000","last_active":"2023-11-28T17:40:27.920356+0000","last_peered":"2023-11-28T17:40:27.920356+0000","last_clean":"2023-11-28T17:40:27.920356+0000","last_became_active":"2023-11-28T17:40:26.936877+0000","last_became_peered":"2023-11-28T17:40:26.936877+0000","last_unstale":"2023-11-28T17:40:27.920356+0000","last_undegraded":"2023-11-28T17:40:27.920356+0000","last_fullsized":"2023-11-28T17:40:27.920356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:02:05.451705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-28T17:40:29.216241+0000","last_change":"2023-11-28T17:40:27.949193+0000","last_active":"2023-11-28T17:40:29.216241+0000","last_peered":"2023-11-28T17:40:29.216241+0000","last_clean":"2023-11-28T17:40:29.216241+0000","last_became_active":"2023-11-28T17:40:27.948365+0000","last_became_peered":"2023-11-28T17:40:27.948365+0000","last_unstale":"2023-11-28T17:40:29.216241+0000","last_undegraded":"2023-11-28T17:40:29.216241+0000","last_fullsized":"2023-11-28T17:40:29.216241+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:26.903668+0000","last_clean_scrub_stamp":"2023-11-28T17:40:26.903668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:54:20.336265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.935153+0000","last_change":"2023-11-28T17:40:26.933957+0000","last_active":"2023-11-28T17:40:27.935153+0000","last_peered":"2023-11-28T17:40:27.935153+0000","last_clean":"2023-11-28T17:40:27.935153+0000","last_became_active":"2023-11-28T17:40:26.933214+0000","last_became_peered":"2023-11-28T17:40:26.933214+0000","last_unstale":"2023-11-28T17:40:27.935153+0000","last_undegraded":"2023-11-28T17:40:27.935153+0000","last_fullsized":"2023-11-28T17:40:27.935153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:40:25.896266+0000","last_clean_scrub_stamp":"2023-11-28T17:40:25.896266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:04:37.055697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-11-28T17:40:27.920809+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-28T17:40:27.920809+0000","last_peered":"2023-11-28T17:40:27.920809+0000","last_clean":"2023-11-28T17:40:27.920809+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-28T17:40:27.920809+0000","last_undegraded":"2023-11-28T17:40:27.920809+0000","last_fullsized":"2023-11-28T17:40:27.920809+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424509457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":153052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":3.5459999999999998,"5min":3.5459999999999998,"15min":3.5459999999999998},"last":0.75},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.492,"5min":7.492,"15min":7.492},"last":0.55700000000000005}]},{"osd":1,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":2.585,"5min":2.585,"15min":2.585},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5070000000000001,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":0.83199999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.609,"5min":3.609,"15min":3.609},"last":0.623},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":3.6709999999999998,"5min":3.6709999999999998,"15min":3.6709999999999998},"last":0.70799999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.4089999999999998,"5min":2.4089999999999998,"15min":2.4089999999999998},"last":0.73299999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":0.50900000000000001}]},{"osd":5,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.86799999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.81299999999999994}]}]},{"osd":5,"up_from":15,"seq":64424509458,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":742390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":3.8780000000000001,"5min":3.8780000000000001,"15min":3.8780000000000001},"last":0.60799999999999998}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":5.476,"5min":5.476,"15min":5.476},"last":0.65400000000000003}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.5170000000000003,"5min":5.5170000000000003,"15min":5.5170000000000003},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6879999999999999,"5min":1.6879999999999999,"15min":1.6879999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":0.746}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.76400000000000001}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":0.86299999999999999}]},{"osd":7,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.78000000000000003}]}]},{"osd":4,"up_from":15,"seq":64424509457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":153074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.73,"5min":2.73,"15min":2.73},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.6840000000000002,"5min":5.6840000000000002,"15min":5.6840000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.079,"5min":1.079,"15min":1.079},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":0.871}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.754},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":2.7269999999999999,"5min":2.7269999999999999,"15min":2.7269999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.52900000000000003}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.62},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.69799999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":405504,"data_stored":152216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":3.754,"5min":3.754,"15min":3.754},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":3.9300000000000002,"5min":3.9300000000000002,"15min":3.9300000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.6779999999999999,"5min":7.6779999999999999,"15min":7.6779999999999999},"last":0.36599999999999999}]},{"osd":2,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":5.3780000000000001,"5min":5.3780000000000001,"15min":5.3780000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":8.1649999999999991,"5min":8.1649999999999991,"15min":8.1649999999999991},"last":0.40500000000000003}]},{"osd":4,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.242,"5min":4.242,"15min":4.242},"last":0.61599999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":4.7640000000000002,"5min":4.7640000000000002,"15min":4.7640000000000002},"last":0.56499999999999995}]},{"osd":5,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":5.1719999999999997,"5min":5.1719999999999997,"15min":5.1719999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":8.2810000000000006,"5min":8.2810000000000006,"15min":8.2810000000000006},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":4.2809999999999997,"5min":4.2809999999999997,"15min":4.2809999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":4.9640000000000004,"5min":4.9640000000000004,"15min":4.9640000000000004},"last":0.70499999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:24 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":8.3149999999999995,"5min":8.3149999999999995,"15min":8.3149999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.72699999999999998}]}]},{"osd":2,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.46700000000000003}]},{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.39200000000000002}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.49299999999999999}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.502}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.57499999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":1.6459999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.67800000000000005}]}]},{"osd":1,"up_from":15,"seq":64424509457,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":741878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.37},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.314}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.41199999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.50800000000000001}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.54700000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":393216,"data_stored":151530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.371},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.41799999999999998}]},{"osd":4,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.53400000000000003}]},{"osd":5,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":0.82899999999999996}]},{"osd":6,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Tue Nov 28 17:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.71199999999999997}]}]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":151462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.495},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.51900000000000002}]},{"osd":1,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54900000000000004}]},{"osd":2,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.58499999999999996}]},{"osd":3,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.1850000000000001,"5min":3.1850000000000001,"15min":3.1850000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.131,"5min":1.131,"15min":1.131},"last":0.63500000000000001}]},{"osd":4,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.876}]},{"osd":5,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.60699999999999998}]},{"osd":6,"last update":"Tue Nov 28 17:40:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.82699999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T17:40:36.976 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T17:40:36.976 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T17:40:37.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72bc9d8640 1 Processor -- start 2023-11-28T17:40:37.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72bc9d8640 1 -- start start 2023-11-28T17:40:37.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72bc9d8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72b80cf3b0 0x7f72b80714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72bc9d8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80ce4f0 con 0x7f72b80cef30 2023-11-28T17:40:37.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72bc9d8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b80ce7d0 con 0x7f72b8144c80 2023-11-28T17:40:37.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72bc9d8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b80709b0 con 0x7f72b80cf3b0 2023-11-28T17:40:37.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b6d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72b80cf3b0 0x7f72b80714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b5d9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f72b80cef30 0x7f72b8070dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51174/0 (socket says 172.21.15.16:51174) 2023-11-28T17:40:37.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b5d9b640 1 -- 172.21.15.16:0/695941555 learned_addr learned my addr 172.21.15.16:0/695941555 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:37.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b6d9d640 1 -- 172.21.15.16:0/695941555 >> v1:172.21.15.64:6789/0 conn(0x7f72b8144c80 legacy=0x7f72b80cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b6d9d640 1 -- 172.21.15.16:0/695941555 >> v1:172.21.15.16:6789/0 conn(0x7f72b80cef30 legacy=0x7f72b8070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b559a640 1 -- 172.21.15.16:0/695941555 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492247698 0 0) 0x7f72b80ce4f0 con 0x7f72b80cef30 2023-11-28T17:40:37.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.158+0000 7f72b6d9d640 1 -- 172.21.15.16:0/695941555 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b80ceab0 con 0x7f72b80cf3b0 2023-11-28T17:40:37.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72b6d9d640 1 --2- 172.21.15.16:0/695941555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b80cf3b0 0x7f72b80714e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009d90 tx=0x7f72b001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=991e61074e714b46 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72b559a640 1 -- 172.21.15.16:0/695941555 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00a5920 con 0x7f72b80cf3b0 2023-11-28T17:40:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72b559a640 1 -- 172.21.15.16:0/695941555 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00a5a80 con 0x7f72b80cf3b0 2023-11-28T17:40:37.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72b559a640 1 -- 172.21.15.16:0/695941555 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00a5e10 con 0x7f72b80cf3b0 2023-11-28T17:40:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 -- 172.21.15.16:0/695941555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b80cf3b0 msgr2=0x7f72b80714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/695941555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b80cf3b0 0x7f72b80714e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009d90 tx=0x7f72b001c950 comp rx=0 tx=0).stop 2023-11-28T17:40:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 -- 172.21.15.16:0/695941555 shutdown_connections 2023-11-28T17:40:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/695941555 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b80cf3b0 0x7f72b80714e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 -- 172.21.15.16:0/695941555 >> 172.21.15.16:0/695941555 conn(0x7f72b806a5a0 msgr2=0x7f72b806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:37.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 -- 172.21.15.16:0/695941555 shutdown_connections 2023-11-28T17:40:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.162+0000 7f72bc9d8640 1 -- 172.21.15.16:0/695941555 wait complete. 2023-11-28T17:40:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 Processor -- start 2023-11-28T17:40:37.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 -- start start 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80cef30 0x7f72b813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b80cf3b0 0x7f72b80acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 0x7f72b8139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b81380b0 con 0x7f72b8144c80 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8135f20 con 0x7f72b80cf3b0 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b8136200 con 0x7f72b80cef30 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 0x7f72b8139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 0x7f72b8139a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36908/0 (socket says 172.21.15.16:36908) 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b80cf3b0 0x7f72b80acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b659c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80cef30 0x7f72b813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 -- 172.21.15.16:0/298676583 learned_addr learned my addr 172.21.15.16:0/298676583 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 -- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80cef30 msgr2=0x7f72b813b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80cef30 0x7f72b813b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 -- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b80cf3b0 msgr2=0x7f72b80acb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b80cf3b0 0x7f72b80acb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.172 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 -- 172.21.15.16:0/298676583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b0009a70 con 0x7f72b8144c80 2023-11-28T17:40:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72b6d9d640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 0x7f72b8139a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f72b00b0040 tx=0x7f72b00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00ade40 con 0x7f72b8144c80 2023-11-28T17:40:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00b9450 con 0x7f72b8144c80 2023-11-28T17:40:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b8137a60 con 0x7f72b8144c80 2023-11-28T17:40:37.173 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b00b9800 con 0x7f72b8144c80 2023-11-28T17:40:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.166+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b80b1a90 con 0x7f72b8144c80 2023-11-28T17:40:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.170+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b81378c0 con 0x7f72b8144c80 2023-11-28T17:40:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.170+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f72b00b9960 con 0x7f72b8144c80 2023-11-28T17:40:37.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.170+0000 7f72a6ffd640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72980668d0 0x7f7298068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.170+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72b011fb70 con 0x7f72b8144c80 2023-11-28T17:40:37.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.170+0000 7f72b659c640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72980668d0 0x7f7298068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.170+0000 7f72b659c640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72980668d0 0x7f7298068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f72a8007fd0 tx=0x7f72a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:37.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.174+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72b81378c0 con 0x7f72b8144c80 2023-11-28T17:40:37.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.386+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f72b81378c0 con 0x7f72b8144c80 2023-11-28T17:40:37.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.390+0000 7f72a6ffd640 1 -- 172.21.15.16:0/298676583 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f72b81378c0 con 0x7f72b8144c80 2023-11-28T17:40:37.395 INFO:teuthology.orchestra.run.smithi016.stdout:[client.0] 2023-11-28T17:40:37.395 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCdJWZlpXX7AhAAyFkBG56tVWNiwFf2q9XkoA== 2023-11-28T17:40:37.395 INFO:teuthology.orchestra.run.smithi016.stdout: caps mds = "allow" 2023-11-28T17:40:37.395 INFO:teuthology.orchestra.run.smithi016.stdout: caps mon = "allow r" 2023-11-28T17:40:37.395 INFO:teuthology.orchestra.run.smithi016.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T17:40:37.396 INFO:teuthology.orchestra.run.smithi016.stderr:updated caps for client.0 2023-11-28T17:40:37.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72980668d0 msgr2=0x7f7298068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72980668d0 0x7f7298068d90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f72a8007fd0 tx=0x7f72a8009040 comp rx=0 tx=0).stop 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 msgr2=0x7f72b8139a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 0x7f72b8139a90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f72b00b0040 tx=0x7f72b00196f0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 shutdown_connections 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72b8144c80 0x7f72b8139a90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72980668d0 0x7f7298068d90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72b80cf3b0 0x7f72b80acb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 --2- 172.21.15.16:0/298676583 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72b80cef30 0x7f72b813b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 >> 172.21.15.16:0/298676583 conn(0x7f72b806a5a0 msgr2=0x7f72b80add60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:37.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 shutdown_connections 2023-11-28T17:40:37.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.394+0000 7f72bc9d8640 1 -- 172.21.15.16:0/298676583 wait complete. 2023-11-28T17:40:37.416 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T17:40:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c7d0f640 1 Processor -- start 2023-11-28T17:40:37.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c7d0f640 1 -- start start 2023-11-28T17:40:37.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c7d0f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f87c01548e0 0x7f87c00ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c7d0f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c015a8b0 con 0x7f87c0072090 2023-11-28T17:40:37.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c7d0f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00cea50 con 0x7f87c00cf640 2023-11-28T17:40:37.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c7d0f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c015a6a0 con 0x7f87c01548e0 2023-11-28T17:40:37.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c52aa640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f87c0072090 0x7f87c00cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51188/0 (socket says 172.21.15.16:51188) 2023-11-28T17:40:37.561 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.554+0000 7f87c52aa640 1 -- 172.21.15.16:0/2934439250 learned_addr learned my addr 172.21.15.16:0/2934439250 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:37.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 --2- 172.21.15.16:0/2934439250 >> v2:172.21.15.64:3300/0 conn(0x7f87c01548e0 0x7f87c00ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.562 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549204573 0 0) 0x7f87c015a8b0 con 0x7f87c0072090 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87ac003530 con 0x7f87c0072090 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 133875986 0 0) 0x7f87ac003530 con 0x7f87c0072090 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 >> v2:172.21.15.64:3300/0 conn(0x7f87c01548e0 msgr2=0x7f87c00ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 --2- 172.21.15.16:0/2934439250 >> v2:172.21.15.64:3300/0 conn(0x7f87c01548e0 0x7f87c00ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 >> v1:172.21.15.64:6789/0 conn(0x7f87c00cf640 legacy=0x7f87c00cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c015ab50 con 0x7f87c0072090 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f87b0001680 con 0x7f87c0072090 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 >> v1:172.21.15.16:6789/0 conn(0x7f87c0072090 legacy=0x7f87c00cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87ac003980 0x7f87ac003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87ac004380 0x7f87ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac005050 0x7f87ac00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c015a6a0 con 0x7f87ac003980 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00bfb0 con 0x7f87ac004380 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87ac00c170 con 0x7f87ac005050 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87ac003980 0x7f87ac003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c52aa640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87ac004380 0x7f87ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c62ac640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac005050 0x7f87ac00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 -- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac005050 msgr2=0x7f87ac00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac005050 0x7f87ac00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 -- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87ac004380 msgr2=0x7f87ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87ac004380 0x7f87ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c5aab640 1 -- 172.21.15.16:0/2934439250 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ac003530 con 0x7f87ac003980 2023-11-28T17:40:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c62ac640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac005050 0x7f87ac00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:37.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.558+0000 7f87c62ac640 1 -- 172.21.15.16:0/2934439250 reap_dead start 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c5aab640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87ac003980 0x7f87ac003d60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009ae0 tx=0x7f87bc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618592680a893657 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0a5640 con 0x7f87ac003980 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc0a57a0 con 0x7f87ac003980 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c4aa9640 1 -- 172.21.15.16:0/2934439250 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0a5b50 con 0x7f87ac003980 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 -- 172.21.15.16:0/2934439250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87ac003980 msgr2=0x7f87ac003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87ac003980 0x7f87ac003d60 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009ae0 tx=0x7f87bc01ca50 comp rx=0 tx=0).stop 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 -- 172.21.15.16:0/2934439250 shutdown_connections 2023-11-28T17:40:37.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/2934439250 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87ac003980 0x7f87ac003d60 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 -- 172.21.15.16:0/2934439250 >> 172.21.15.16:0/2934439250 conn(0x7f87c006a5a0 msgr2=0x7f87c006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:37.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 -- 172.21.15.16:0/2934439250 shutdown_connections 2023-11-28T17:40:37.567 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 -- 172.21.15.16:0/2934439250 wait complete. 2023-11-28T17:40:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 Processor -- start 2023-11-28T17:40:37.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.562+0000 7f87c7d0f640 1 -- start start 2023-11-28T17:40:37.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac003980 0x7f87c0144870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c0159130 0x7f87c01595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 0x7f87c01f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01f6d30 con 0x7f87c01f2f00 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c01515a0 con 0x7f87c0159130 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c0159af0 con 0x7f87ac003980 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 0x7f87c01f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c5aab640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac003980 0x7f87c0144870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 0x7f87c01f3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36926/0 (socket says 172.21.15.16:36926) 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 -- 172.21.15.16:0/4012179150 learned_addr learned my addr 172.21.15.16:0/4012179150 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:37.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c52aa640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c0159130 0x7f87c01595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 -- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac003980 msgr2=0x7f87c0144870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac003980 0x7f87c0144870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 -- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c0159130 msgr2=0x7f87c01595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c0159130 0x7f87c01595b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 -- 172.21.15.16:0/4012179150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c01f3e60 con 0x7f87c01f2f00 2023-11-28T17:40:37.571 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c62ac640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 0x7f87c01f3380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cc200 tx=0x7f87b8011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800fc90 con 0x7f87c01f2f00 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b800fdf0 con 0x7f87c01f2f00 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c01f38c0 con 0x7f87c01f2f00 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b8015630 con 0x7f87c01f2f00 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c01f6670 con 0x7f87c01f2f00 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c01f64d0 con 0x7f87c01f2f00 2023-11-28T17:40:37.572 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.566+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f87b8015790 con 0x7f87c01f2f00 2023-11-28T17:40:37.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.570+0000 7f87b67fc640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f87a40668d0 0x7f87a4068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:37.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.570+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87b8087700 con 0x7f87c01f2f00 2023-11-28T17:40:37.573 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.570+0000 7f87c5aab640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f87a40668d0 0x7f87a4068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:37.574 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.570+0000 7f87c5aab640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f87a40668d0 0x7f87a4068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0af000 tx=0x7f87bc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:37.577 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.574+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87c01f64d0 con 0x7f87c01f2f00 2023-11-28T17:40:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.762+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87c01f6e70 con 0x7f87c01f2f00 2023-11-28T17:40:37.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.762+0000 7f87b67fc640 1 -- 172.21.15.16:0/4012179150 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f87c01f6e70 con 0x7f87c01f2f00 2023-11-28T17:40:37.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:40:37.769 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:40:27.311390+0000","modified":"2023-11-28T17:40:30.336858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6836/2775576031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2775576031},{"type":"v1","addr":"172.21.15.64:6836","nonce":2775576031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T17:40:37.769 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2023-11-28T17:40:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f87a40668d0 msgr2=0x7f87a4068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f87a40668d0 0x7f87a4068d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0af000 tx=0x7f87bc0046d0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 msgr2=0x7f87c01f3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 0x7f87c01f3380 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f87c00cc200 tx=0x7f87b8011f80 comp rx=0 tx=0).stop 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 shutdown_connections 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f87c01f2f00 0x7f87c01f3380 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f87a40668d0 0x7f87a4068d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f87c0159130 0x7f87c01595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 --2- 172.21.15.16:0/4012179150 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f87ac003980 0x7f87c0144870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 >> 172.21.15.16:0/4012179150 conn(0x7f87c006a5a0 msgr2=0x7f87c00b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 shutdown_connections 2023-11-28T17:40:37.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:37.766+0000 7f87c7d0f640 1 -- 172.21.15.16:0/4012179150 wait complete. 2023-11-28T17:40:38.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T17:40:27.311390+0000', 'modified': '2023-11-28T17:40:30.336858+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5055}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5055': {'gid': 5055, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.64:6836/2775576031', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 2775576031}, {'type': 'v1', 'addr': '172.21.15.64:6836', 'nonce': 2775576031}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T17:40:38.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T17:40:38.192 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-28T17:40:38.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.334+0000 7f0a1b8fe640 1 Processor -- start 2023-11-28T17:40:38.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.334+0000 7f0a1b8fe640 1 -- start start 2023-11-28T17:40:38.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.334+0000 7f0a1b8fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1415d620 0x7f0a140cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.334+0000 7f0a1b8fe640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a140cbcd0 con 0x7f0a1406e880 2023-11-28T17:40:38.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.334+0000 7f0a1b8fe640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a140cee20 con 0x7f0a1406d300 2023-11-28T17:40:38.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.334+0000 7f0a1b8fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a140cf100 con 0x7f0a1415d620 2023-11-28T17:40:38.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a19e9b640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f0a1406e880 0x7f0a140d1330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51190/0 (socket says 172.21.15.16:51190) 2023-11-28T17:40:38.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a19e9b640 1 -- 172.21.15.16:0/2470333530 learned_addr learned my addr 172.21.15.16:0/2470333530 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a1969a640 1 --2- 172.21.15.16:0/2470333530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1415d620 0x7f0a140cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781953338 0 0) 0x7f0a140cbcd0 con 0x7f0a1406e880 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a00003530 con 0x7f0a1406e880 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283487451 0 0) 0x7f0a140cee20 con 0x7f0a1406d300 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a140cbcd0 con 0x7f0a1406d300 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a1969a640 1 -- 172.21.15.16:0/2470333530 >> v1:172.21.15.64:6789/0 conn(0x7f0a1406d300 legacy=0x7f0a14161a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a1969a640 1 -- 172.21.15.16:0/2470333530 >> v1:172.21.15.16:6789/0 conn(0x7f0a1406e880 legacy=0x7f0a140d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a1969a640 1 -- 172.21.15.16:0/2470333530 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140cf3e0 con 0x7f0a1415d620 2023-11-28T17:40:38.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a1969a640 1 --2- 172.21.15.16:0/2470333530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1415d620 0x7f0a140cb790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a100097f0 tx=0x7f0a1001c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b16f08171b3eded7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100ac620 con 0x7f0a1415d620 2023-11-28T17:40:38.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100ac780 con 0x7f0a1415d620 2023-11-28T17:40:38.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.338+0000 7f0a0bfff640 1 -- 172.21.15.16:0/2470333530 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100acb10 con 0x7f0a1415d620 2023-11-28T17:40:38.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/2470333530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1415d620 msgr2=0x7f0a140cb790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/2470333530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1415d620 0x7f0a140cb790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a100097f0 tx=0x7f0a1001c490 comp rx=0 tx=0).stop 2023-11-28T17:40:38.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/2470333530 shutdown_connections 2023-11-28T17:40:38.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/2470333530 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1415d620 0x7f0a140cb790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/2470333530 >> 172.21.15.16:0/2470333530 conn(0x7f0a1406a5a0 msgr2=0x7f0a1406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/2470333530 shutdown_connections 2023-11-28T17:40:38.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/2470333530 wait complete. 2023-11-28T17:40:38.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 Processor -- start 2023-11-28T17:40:38.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- start start 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a1406d300 0x7f0a14152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1406e880 0x7f0a14158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 0x7f0a140c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a141545c0 con 0x7f0a1415d620 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1415bda0 con 0x7f0a1406d300 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1b8fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1415c080 con 0x7f0a1406e880 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a19e9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 0x7f0a140c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a19e9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 0x7f0a140c4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36934/0 (socket says 172.21.15.16:36934) 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a19e9b640 1 -- 172.21.15.16:0/759421379 learned_addr learned my addr 172.21.15.16:0/759421379 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a1969a640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a1406d300 0x7f0a14152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.342+0000 7f0a18e99640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1406e880 0x7f0a14158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a19e9b640 1 -- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1406e880 msgr2=0x7f0a14158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1406e880 0x7f0a14158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a19e9b640 1 -- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a1406d300 msgr2=0x7f0a14152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a1406d300 0x7f0a14152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a19e9b640 1 -- 172.21.15.16:0/759421379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a10009420 con 0x7f0a1415d620 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 0x7f0a140c4150 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00cba0 tx=0x7f0a0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a09ffb640 1 -- 172.21.15.16:0/759421379 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c00ace0 con 0x7f0a1415d620 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a09ffb640 1 -- 172.21.15.16:0/759421379 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c00ae40 con 0x7f0a1415d620 2023-11-28T17:40:38.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a09ffb640 1 -- 172.21.15.16:0/759421379 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c012620 con 0x7f0a1415d620 2023-11-28T17:40:38.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1415c360 con 0x7f0a1415d620 2023-11-28T17:40:38.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a141591c0 con 0x7f0a1415d620 2023-11-28T17:40:38.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a09ffb640 1 -- 172.21.15.16:0/759421379 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f0a0c007070 con 0x7f0a1415d620 2023-11-28T17:40:38.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a09ffb640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f09f80668d0 0x7f09f8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.346+0000 7f0a09ffb640 1 -- 172.21.15.16:0/759421379 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a0c0844b0 con 0x7f0a1415d620 2023-11-28T17:40:38.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f09f80668d0 0x7f09f8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 Processor -- start 2023-11-28T17:40:38.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- start start 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f09f80668d0 0x7f09f8068d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x5615859e0110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x561585992fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x5615859938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158585c110 con 0x5615859dfd30 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615857ec9a0 con 0x5615859e0650 2023-11-28T17:40:38.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615857e9ed0 con 0x561585993500 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x5615859e0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x5615859e0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36936/0 (socket says 172.21.15.16:36936) 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 -- 172.21.15.16:0/2056555897 learned_addr learned my addr 172.21.15.16:0/2056555897 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a18e99640 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x561585992fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x5615859938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 -- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 msgr2=0x5615859938e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x5615859938e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 -- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 msgr2=0x561585992fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x561585992fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 -- 172.21.15.16:0/2056555897 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615854dd890 con 0x5615859dfd30 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1969a640 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x5615859e0110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0a1001a0c0 tx=0x7f0a10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bad17b8d33788f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f09f6ffd640 1 -- 172.21.15.16:0/2056555897 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100b6640 con 0x5615859dfd30 2023-11-28T17:40:38.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f09f6ffd640 1 -- 172.21.15.16:0/2056555897 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100c6070 con 0x5615859dfd30 2023-11-28T17:40:38.357 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f09f6ffd640 1 -- 172.21.15.16:0/2056555897 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100b69c0 con 0x5615859dfd30 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2056555897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 msgr2=0x5615859e0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x5615859e0110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0a1001a0c0 tx=0x7f0a10004740 comp rx=0 tx=0).stop 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2056555897 shutdown_connections 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x5615859938e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x561585992fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2056555897 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x5615859e0110 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2056555897 >> 172.21.15.16:0/2056555897 conn(0x5615859c08c0 msgr2=0x5615859c2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2056555897 shutdown_connections 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2056555897 wait complete. 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.350+0000 7f0a1ec66000 1 -- start start 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 Processor -- start 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561585993500 0x561585999520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x561585999a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859e0650 0x561585999fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615857e57c0 con 0x5615859dfd30 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158579dbf0 con 0x561585993500 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615857a3a90 con 0x5615859e0650 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 10 client.0 _ll_register_callbacks cb 0x561585980e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T17:40:38.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x561585999a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x561585999a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36948/0 (socket says 172.21.15.16:36948) 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 -- 172.21.15.16:0/3222778658 learned_addr learned my addr 172.21.15.16:0/3222778658 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1969a640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561585993500 0x561585999520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859e0650 0x561585999fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 -- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859e0650 msgr2=0x561585999fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859e0650 0x561585999fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 -- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561585993500 msgr2=0x561585999520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561585993500 0x561585999520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 -- 172.21.15.16:0/3222778658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a100bc070 con 0x5615859dfd30 2023-11-28T17:40:38.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859e0650 0x561585999fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a18e99640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x561585999a60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0a04012310 tx=0x7f0a040127d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a96e9a6c93110bc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f09effff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f09effff640 1 -- 172.21.15.16:0/3222778658 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0401a030 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f09effff640 1 -- 172.21.15.16:0/3222778658 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a0401b070 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615857a7470 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f09effff640 1 -- 172.21.15.16:0/3222778658 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a04005320 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 10 client.5250 fetch_fsmap learned FSMap version 17 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5615857a6190 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f09effff640 1 -- 172.21.15.16:0/3222778658 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a04025020 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f09effff640 1 -- 172.21.15.16:0/3222778658 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a04007030 con 0x5615859dfd30 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 10 client.5250 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T17:40:38.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 10 client.5250 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 20 client.5250 populate_metadata read hostname 'smithi016' 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x56158599a9b0 0x5615859f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 4 client.5250 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 --> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615857aab50 con 0x56158599a9b0 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.354+0000 7f0a1969a640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x56158599a9b0 0x5615859f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1969a640 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x56158599a9b0 0x5615859f1ff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f35cf09ce80bb07 server_cookie=9afe6ec1803b72f6 in_seq=0 out_seq=0 2023-11-28T17:40:38.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f09effff640 10 client.5250 ms_handle_connect on v2:172.21.15.64:6834/2775576031 2023-11-28T17:40:38.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f09effff640 1 -- 172.21.15.16:0/3222778658 <== mds.0 v2:172.21.15.64:6834/2775576031 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5615857aab50 con 0x56158599a9b0 2023-11-28T17:40:38.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f09effff640 10 client.5250 handle_command_reply: tid=0 2023-11-28T17:40:38.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 client.5250 shutdown 2023-11-28T17:40:38.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 msgr2=0x561585999a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x561585999a60 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0a04012310 tx=0x7f0a040127d0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 shutdown_connections 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x56158599a9b0 0x5615859f1ff0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859e0650 0x561585999fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859dfd30 0x561585999a60 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/3222778658 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x561585993500 0x561585999520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f09effff640 0 client.5250 ms_handle_reset on v2:172.21.15.64:6834/2775576031 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 >> 172.21.15.16:0/3222778658 conn(0x5615859c08c0 msgr2=0x5615859926b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 shutdown_connections 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 1 -- 172.21.15.16:0/3222778658 wait complete. 2023-11-28T17:40:38.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.358+0000 7f0a1ec66000 20 client.5250 trim_cache size 0 max 16384 2023-11-28T17:40:38.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 Processor -- start 2023-11-28T17:40:38.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- start start 2023-11-28T17:40:38.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x561585a3c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859dfd30 0x561585a3c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 0x561585a3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158549e940 con 0x5615859e0650 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615857e4650 con 0x5615859dfd30 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615857dfac0 con 0x561585993500 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 0x561585a3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 0x561585a3cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36952/0 (socket says 172.21.15.16:36952) 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 -- 172.21.15.16:0/2044682625 learned_addr learned my addr 172.21.15.16:0/2044682625 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a18e99640 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859dfd30 0x561585a3c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1969a640 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x561585a3c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 -- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 msgr2=0x561585a3c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x561585a3c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 -- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859dfd30 msgr2=0x561585a3c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859dfd30 0x561585a3c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 -- 172.21.15.16:0/2044682625 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56158578c490 con 0x5615859e0650 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 0x561585a3cd10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c055300 tx=0x7f0a0c084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb230ae6e6ec273 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f09f77fe640 1 -- 172.21.15.16:0/2044682625 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c059160 con 0x5615859e0650 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f09f77fe640 1 -- 172.21.15.16:0/2044682625 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0c051ad0 con 0x5615859e0650 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f09f77fe640 1 -- 172.21.15.16:0/2044682625 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0c055840 con 0x5615859e0650 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2044682625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 msgr2=0x561585a3cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 0x561585a3cd10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c055300 tx=0x7f0a0c084040 comp rx=0 tx=0).stop 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2044682625 shutdown_connections 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x5615859e0650 0x561585a3cd10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859dfd30 0x561585a3c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/2044682625 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x561585993500 0x561585a3c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2044682625 >> 172.21.15.16:0/2044682625 conn(0x5615859c08c0 msgr2=0x5615859ed320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2044682625 shutdown_connections 2023-11-28T17:40:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.374+0000 7f0a1ec66000 1 -- 172.21.15.16:0/2044682625 wait complete. 2023-11-28T17:40:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- start start 2023-11-28T17:40:38.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 Processor -- start 2023-11-28T17:40:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 0x561585a403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859dfd30 0x561585a40930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x5615859fba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615857ded40 con 0x561585993500 2023-11-28T17:40:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x56158579ca10 con 0x5615859e0650 2023-11-28T17:40:38.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x5615857f08e0 con 0x5615859dfd30 2023-11-28T17:40:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 10 client.0 _ll_register_callbacks cb 0x56158585c060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T17:40:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 0x561585a403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 0x561585a403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36956/0 (socket says 172.21.15.16:36956) 2023-11-28T17:40:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 -- 172.21.15.16:0/297427900 learned_addr learned my addr 172.21.15.16:0/297427900 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:38.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a19e9b640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x5615859fba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a18e99640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859dfd30 0x561585a40930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 -- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859dfd30 msgr2=0x561585a40930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859dfd30 0x561585a40930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 -- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 msgr2=0x5615859fba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x5615859fba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 -- 172.21.15.16:0/297427900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a141591c0 con 0x561585993500 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1969a640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 0x561585a403f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a1001a0c0 tx=0x7f0a100046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538185b7eadf2b71 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f09effff640 10 client.0 ms_handle_connect on v2:172.21.15.16:3300/0 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f09effff640 1 -- 172.21.15.16:0/297427900 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100ac420 con 0x561585993500 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615857e4110 con 0x561585993500 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f09effff640 1 -- 172.21.15.16:0/297427900 <== mon.0 v2:172.21.15.16:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a100d5450 con 0x561585993500 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f09effff640 1 -- 172.21.15.16:0/297427900 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a100d5610 con 0x561585993500 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 10 client.5256 fetch_fsmap learned FSMap version 17 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5615854ddcc0 con 0x561585993500 2023-11-28T17:40:38.390 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f09effff640 1 -- 172.21.15.16:0/297427900 <== mon.0 v2:172.21.15.16:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5615857e4110 con 0x561585993500 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f09effff640 1 -- 172.21.15.16:0/297427900 <== mon.0 v2:172.21.15.16:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0a100d5770 con 0x561585993500 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 10 client.5256 fetch_fsmap finished waiting for FSMap version 17 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 10 client.5256 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 20 client.5256 populate_metadata read hostname 'smithi016' 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x561585a47250 0x561585a49640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 4 client.5256 mds_command: new command op to 5055 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.378+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 --> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561585812650 con 0x561585a47250 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a18e99640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x561585a47250 0x561585a49640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a18e99640 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x561585a47250 0x561585a49640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9301b19c5c62cf13 server_cookie=18087d1fca7be58e in_seq=0 out_seq=0 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f09effff640 10 client.5256 ms_handle_connect on v2:172.21.15.64:6834/2775576031 2023-11-28T17:40:38.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f09effff640 1 -- 172.21.15.16:0/297427900 <== mds.0 v2:172.21.15.64:6834/2775576031 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x561585812650 con 0x561585a47250 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f09effff640 10 client.5256 handle_command_reply: tid=0 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 client.5256 shutdown 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 msgr2=0x561585a403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 0x561585a403f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a1001a0c0 tx=0x7f0a100046d0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 shutdown_connections 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:6834/2775576031,v1:172.21.15.64:6836/2775576031] conn(0x561585a47250 0x561585a49640 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5615859e0650 0x5615859fba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x5615859dfd30 0x561585a40930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 --2- 172.21.15.16:0/297427900 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x561585993500 0x561585a403f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 >> 172.21.15.16:0/297427900 conn(0x5615859c08c0 msgr2=0x561585991720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f09effff640 0 client.5256 ms_handle_reset on v2:172.21.15.64:6834/2775576031 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 shutdown_connections 2023-11-28T17:40:38.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 1 -- 172.21.15.16:0/297427900 wait complete. 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1ec66000 20 client.5256 trim_cache size 0 max 16384 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout: "cluster_fsid": "412d3c1b-e5e1-47ba-972b-0544ebc8f3e9", 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout: "whoami": 0, 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout: "id": 5055, 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout: "want_state": "up:active", 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout: "state": "up:active", 2023-11-28T17:40:38.393 INFO:teuthology.orchestra.run.smithi016.stdout: "fs_name": "cephfs", 2023-11-28T17:40:38.394 INFO:teuthology.orchestra.run.smithi016.stdout: "rank_uptime": 10.472393240000001, 2023-11-28T17:40:38.394 INFO:teuthology.orchestra.run.smithi016.stdout: "mdsmap_epoch": 17, 2023-11-28T17:40:38.394 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch": 35, 2023-11-28T17:40:38.394 INFO:teuthology.orchestra.run.smithi016.stdout: "osdmap_epoch_barrier": 35, 2023-11-28T17:40:38.394 INFO:teuthology.orchestra.run.smithi016.stdout: "uptime": 18.317527122000001 2023-11-28T17:40:38.394 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f09f80668d0 msgr2=0x7f09f8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f09f80668d0 0x7f09f8068d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100a7000 comp rx=0 tx=0).stop 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 msgr2=0x7f0a140c4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 0x7f0a140c4150 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c00cba0 tx=0x7f0a0c00a430 comp rx=0 tx=0).stop 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 shutdown_connections 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f0a1415d620 0x7f0a140c4150 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f0a1406e880 0x7f0a14158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f09f80668d0 0x7f09f8068d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 --2- 172.21.15.16:0/759421379 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a1406d300 0x7f0a14152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 >> 172.21.15.16:0/759421379 conn(0x7f0a1406a5a0 msgr2=0x7f0a1406b670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 shutdown_connections 2023-11-28T17:40:38.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.382+0000 7f0a1b8fe640 1 -- 172.21.15.16:0/759421379 wait complete. 2023-11-28T17:40:38.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T17:40:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1ca489c640 1 Processor -- start 2023-11-28T17:40:38.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1ca489c640 1 -- start start 2023-11-28T17:40:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1ca489c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1ca015d540 0x7f1ca00b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1ca489c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00b32c0 con 0x7f1ca00d1f50 2023-11-28T17:40:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1ca489c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca00b35a0 con 0x7f1ca00d3690 2023-11-28T17:40:38.551 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1ca489c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ca015d920 con 0x7f1ca015d540 2023-11-28T17:40:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c97fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1ca00d1f50 0x7f1ca00d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:51194/0 (socket says 172.21.15.16:51194) 2023-11-28T17:40:38.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c97fff640 1 -- 172.21.15.16:0/3881233326 learned_addr learned my addr 172.21.15.16:0/3881233326 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:40:38.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3881233326 >> v2:172.21.15.64:3300/0 conn(0x7f1ca015d540 0x7f1ca00b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1520220805 0 0) 0x7f1ca00b32c0 con 0x7f1ca00d1f50 2023-11-28T17:40:38.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c8c003530 con 0x7f1ca00d1f50 2023-11-28T17:40:38.554 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360591953 0 0) 0x7f1c8c003530 con 0x7f1ca00d1f50 2023-11-28T17:40:38.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 >> v2:172.21.15.64:3300/0 conn(0x7f1ca015d540 msgr2=0x7f1ca00b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 --2- 172.21.15.16:0/3881233326 >> v2:172.21.15.64:3300/0 conn(0x7f1ca015d540 0x7f1ca00b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 >> v1:172.21.15.64:6789/0 conn(0x7f1ca00d3690 legacy=0x7f1ca00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00b3880 con 0x7f1ca00d1f50 2023-11-28T17:40:38.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f1c88001680 con 0x7f1ca00d1f50 2023-11-28T17:40:38.555 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3881233326 >> v2:172.21.15.64:3300/0 conn(0x7f1ca015d540 0x7f1ca00b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 >> v1:172.21.15.16:6789/0 conn(0x7f1ca00d1f50 legacy=0x7f1ca00d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1c8c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c8c0047d0 0x7f1c8c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c8c0051e0 0x7f1c8c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca015d920 con 0x7f1c8c0051e0 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c00c130 con 0x7f1c8c0047d0 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c00c2f0 con 0x7f1c8c0039d0 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1c8c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c9ed9d640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c8c0051e0 0x7f1c8c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.546+0000 7f1c97fff640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c8c0047d0 0x7f1c8c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9e59c640 1 -- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c8c0047d0 msgr2=0x7f1c8c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c8c0047d0 0x7f1c8c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.557 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9e59c640 1 -- 172.21.15.16:0/3881233326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c8c0051e0 msgr2=0x7f1c8c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:40:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c8c0051e0 0x7f1c8c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9e59c640 1 -- 172.21.15.16:0/3881233326 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c003530 con 0x7f1c8c0039d0 2023-11-28T17:40:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9ed9d640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1c8c0051e0 0x7f1c8c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:38.558 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9ed9d640 1 -- 172.21.15.16:0/3881233326 reap_dead start 2023-11-28T17:40:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1c8c003df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009c80 tx=0x7f1c9001cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d45f34ca1b8c0ab8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900a5740 con 0x7f1c8c0039d0 2023-11-28T17:40:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c900a58a0 con 0x7f1c8c0039d0 2023-11-28T17:40:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.550+0000 7f1c9dd9b640 1 -- 172.21.15.16:0/3881233326 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900a5c90 con 0x7f1c8c0039d0 2023-11-28T17:40:38.559 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 msgr2=0x7f1c8c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1c8c003df0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009c80 tx=0x7f1c9001cb90 comp rx=0 tx=0).stop 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- 172.21.15.16:0/3881233326 shutdown_connections 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3881233326 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1c8c003df0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- 172.21.15.16:0/3881233326 >> 172.21.15.16:0/3881233326 conn(0x7f1ca008ccf0 msgr2=0x7f1ca009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- 172.21.15.16:0/3881233326 shutdown_connections 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- 172.21.15.16:0/3881233326 wait complete. 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 Processor -- start 2023-11-28T17:40:38.560 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- start start 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1ca0153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 0x7f1ca00b8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ca01548d0 0x7f1ca00cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b7350 con 0x7f1ca01543a0 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b18e0 con 0x7f1ca01548d0 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1ca489c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca00b75a0 con 0x7f1c8c0039d0 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 0x7f1ca00b8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.563 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c97fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 0x7f1ca00b8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:36970/0 (socket says 172.21.15.16:36970) 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c97fff640 1 -- 172.21.15.16:0/3306082147 learned_addr learned my addr 172.21.15.16:0/3306082147 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1ca0153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c9ed9d640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ca01548d0 0x7f1ca00cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c97fff640 1 -- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 msgr2=0x7f1ca0153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c97fff640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1ca0153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.554+0000 7f1c97fff640 1 -- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ca01548d0 msgr2=0x7f1ca00cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c97fff640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ca01548d0 0x7f1ca00cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c97fff640 1 -- 172.21.15.16:0/3306082147 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca00b7880 con 0x7f1ca01543a0 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1ca0153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c97fff640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 0x7f1ca00b8640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c880124a0 tx=0x7f1c880128a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c88014810 con 0x7f1ca01543a0 2023-11-28T17:40:38.564 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c880149b0 con 0x7f1ca01543a0 2023-11-28T17:40:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca00b7b60 con 0x7f1ca01543a0 2023-11-28T17:40:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c88014d60 con 0x7f1ca01543a0 2023-11-28T17:40:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca00b8120 con 0x7f1ca01543a0 2023-11-28T17:40:38.565 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca00b8310 con 0x7f1ca01543a0 2023-11-28T17:40:38.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1c880153e0 con 0x7f1ca01543a0 2023-11-28T17:40:38.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c96ffd640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c800668d0 0x7f1c80068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:40:38.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c88087240 con 0x7f1ca01543a0 2023-11-28T17:40:38.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.558+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c800668d0 0x7f1c80068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:40:38.566 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.562+0000 7f1c9e59c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c800668d0 0x7f1c80068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c900af000 tx=0x7f1c900a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:40:38.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.562+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c88054490 con 0x7f1ca01543a0 2023-11-28T17:40:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.754+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1ca0068860 con 0x7f1ca01543a0 2023-11-28T17:40:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1c96ffd640 1 -- 172.21.15.16:0/3306082147 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c88057ab0 con 0x7f1ca01543a0 2023-11-28T17:40:38.761 INFO:teuthology.orchestra.run.smithi016.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T17:40:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c800668d0 msgr2=0x7f1c80068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c800668d0 0x7f1c80068d90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c900af000 tx=0x7f1c900a7040 comp rx=0 tx=0).stop 2023-11-28T17:40:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 msgr2=0x7f1ca00b8640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:40:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 0x7f1ca00b8640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1c880124a0 tx=0x7f1c880128a0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 shutdown_connections 2023-11-28T17:40:38.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1c800668d0 0x7f1c80068d90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1ca01548d0 0x7f1ca00cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1ca01543a0 0x7f1ca00b8640 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 --2- 172.21.15.16:0/3306082147 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1c8c0039d0 0x7f1ca0153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:40:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 >> 172.21.15.16:0/3306082147 conn(0x7f1ca008ccf0 msgr2=0x7f1ca006ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:40:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 shutdown_connections 2023-11-28T17:40:38.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:40:38.758+0000 7f1ca489c640 1 -- 172.21.15.16:0/3306082147 wait complete. 2023-11-28T17:40:38.782 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi016.front.sepia.ceph.com 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T17:40:38.783 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T17:40:38.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:38.784 DEBUG:teuthology.orchestra.run.smithi016:> ip addr 2023-11-28T17:40:38.795 INFO:teuthology.orchestra.run.smithi016.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T17:40:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T17:40:38.795 INFO:teuthology.orchestra.run.smithi016.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T17:40:38.796 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.796 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 ::1/128 scope host 2023-11-28T17:40:38.796 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.796 INFO:teuthology.orchestra.run.smithi016.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:40:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e0 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:40:38.797 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f0 2023-11-28T17:40:38.798 INFO:teuthology.orchestra.run.smithi016.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:40:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:6b:fd:e1 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:40:38.798 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp7s0f1 2023-11-28T17:40:38.799 INFO:teuthology.orchestra.run.smithi016.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T17:40:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:64 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:40:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f0 2023-11-28T17:40:38.799 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.21.15.16/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft 42349sec preferred_lft 42349sec 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::ec4:7aff:febd:1564/64 scope link 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0c:c4:7a:bd:15:65 brd ff:ff:ff:ff:ff:ff 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout: altname enp1s0f1 2023-11-28T17:40:38.800 INFO:teuthology.orchestra.run.smithi016.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T17:40:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 02:42:be:b9:3b:dc brd ff:ff:ff:ff:ff:ff 2023-11-28T17:40:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T17:40:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.801 INFO:teuthology.orchestra.run.smithi016.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T17:40:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T17:40:38.801 INFO:teuthology.orchestra.run.smithi016.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T17:40:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T17:40:38.802 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.802 INFO:teuthology.orchestra.run.smithi016.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T17:40:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T17:40:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T17:40:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.803 INFO:teuthology.orchestra.run.smithi016.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T17:40:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-28T17:40:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-11-28T17:40:38.804 INFO:teuthology.orchestra.run.smithi016.stdout: valid_lft forever preferred_lft forever 2023-11-28T17:40:38.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:38.805 DEBUG:teuthology.orchestra.run.smithi016:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T17:40:38.860 INFO:teuthology.orchestra.run.smithi016.stdout:1 2023-11-28T17:40:38.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:38.863 DEBUG:teuthology.orchestra.run.smithi016:> route 2023-11-28T17:40:38.915 INFO:teuthology.orchestra.run.smithi016.stdout:Kernel IP routing table 2023-11-28T17:40:38.915 INFO:teuthology.orchestra.run.smithi016.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T17:40:38.915 INFO:teuthology.orchestra.run.smithi016.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-11-28T17:40:38.916 INFO:teuthology.orchestra.run.smithi016.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T17:40:38.916 INFO:teuthology.orchestra.run.smithi016.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-11-28T17:40:38.916 INFO:teuthology.orchestra.run.smithi016.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T17:40:38.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:38.918 DEBUG:teuthology.orchestra.run.smithi016:> (cd / && exec bash -c ' 2023-11-28T17:40:38.919 DEBUG:teuthology.orchestra.run.smithi016:> set -e 2023-11-28T17:40:38.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-11-28T17:40:38.919 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-11-28T17:40:38.920 DEBUG:teuthology.orchestra.run.smithi016:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-11-28T17:40:38.920 DEBUG:teuthology.orchestra.run.smithi016:> ') 2023-11-28T17:40:39.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.013 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-28T17:40:39.023 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T17:40:39.023 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-28T17:40:39.023 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T17:40:39.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link set brx.0 up 2023-11-28T17:40:39.086 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:40:39.086 DEBUG:teuthology.orchestra.run.smithi016:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T17:40:39.137 INFO:teuthology.orchestra.run.smithi016.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T17:40:39.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T17:40:39.138 DEBUG:teuthology.orchestra.run.smithi016:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T17:40:39.188 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-28T17:40:39.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.189 DEBUG:teuthology.orchestra.run.smithi016:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:40:39.284 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:40:39.284 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T17:40:39.284 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:40:39.299 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:40:39.300 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T17:40:39.300 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:40:39.300 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:40:39.300 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:invalid new device string format 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:3300,172.21.15.64:3300,172.21.15.64:3301" 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: resolved to: "172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790" 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.16:6789,172.21.15.64:6789,172.21.15.64:6790:/ 2023-11-28T17:40:39.309 INFO:teuthology.orchestra.run.smithi016.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=412d3c1b-e5e1-47ba-972b-0544ebc8f3e9" will pass to kernel 2023-11-28T17:40:39.312 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T17:40:39.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T17:40:39.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.334 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T17:40:39.401 INFO:teuthology.orchestra.run.smithi016.stdout:client5224 2023-11-28T17:40:39.401 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:40:39.402 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T17:40:39.453 DEBUG:teuthology.orchestra.run.smithi016:> mktemp -d --suffix=xfstests-dev 2023-11-28T17:40:39.508 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.SqFPnd7Bgcxfstests-dev 2023-11-28T17:40:39.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.509 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.SqFPnd7Bgcxfstests-dev) 2023-11-28T17:40:39.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:39.580 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.SqFPnd7Bgcxfstests-dev) 2023-11-28T17:40:39.639 INFO:teuthology.orchestra.run.smithi016.stderr:Cloning into '/tmp/tmp.SqFPnd7Bgcxfstests-dev'... 2023-11-28T17:40:40.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:40.534 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-28T17:40:40.596 DEBUG:teuthology.orchestra.run.smithi016:> mktemp -d --suffix=test 2023-11-28T17:40:40.649 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.bPlePXOp82test 2023-11-28T17:40:40.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:40:40.649 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-28T17:40:40.705 DEBUG:teuthology.orchestra.run.smithi016:> mktemp -d --suffix=scratch 2023-11-28T17:40:40.757 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:40:40.757 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-11-28T17:40:40.757 DEBUG:teuthology.orchestra.run.smithi016:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2023-11-28T17:40:40.877 INFO:teuthology.orchestra.run.smithi016.stdout:Reading package lists... 2023-11-28T17:40:41.050 INFO:teuthology.orchestra.run.smithi016.stdout:Building dependency tree... 2023-11-28T17:40:41.050 INFO:teuthology.orchestra.run.smithi016.stdout:Reading state information... 2023-11-28T17:40:41.207 INFO:teuthology.orchestra.run.smithi016.stdout:acl is already the newest version (2.3.1-1). 2023-11-28T17:40:41.207 INFO:teuthology.orchestra.run.smithi016.stdout:acl set to manually installed. 2023-11-28T17:40:41.207 INFO:teuthology.orchestra.run.smithi016.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-11-28T17:40:41.207 INFO:teuthology.orchestra.run.smithi016.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-11-28T17:40:41.207 INFO:teuthology.orchestra.run.smithi016.stdout:bc is already the newest version (1.07.1-3build1). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:gcc set to manually installed. 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:libtool is already the newest version (2.4.6-15build2). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:40:41.208 INFO:teuthology.orchestra.run.smithi016.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:make is already the newest version (4.3-4.1build1). 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:make set to manually installed. 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:psmisc is already the newest version (23.4-2build3). 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:quota is already the newest version (4.06-1build2). 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:sed is already the newest version (4.8-1ubuntu2). 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:40:41.209 INFO:teuthology.orchestra.run.smithi016.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:dbench is already the newest version (4.0-2build1). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:dump is already the newest version (0.4b47-3). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2023-11-28T17:40:41.210 INFO:teuthology.orchestra.run.smithi016.stdout:python3 is already the newest version (3.10.6-1~22.04). 2023-11-28T17:40:41.211 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T17:40:41.211 INFO:teuthology.orchestra.run.smithi016.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-11-28T17:40:41.211 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-11-28T17:40:41.211 INFO:teuthology.orchestra.run.smithi016.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-11-28T17:40:41.211 INFO:teuthology.orchestra.run.smithi016.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-11-28T17:40:41.212 INFO:teuthology.orchestra.run.smithi016.stdout: python2.7 python2.7-dev python2.7-minimal 2023-11-28T17:40:41.212 INFO:teuthology.orchestra.run.smithi016.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T17:40:41.212 INFO:teuthology.orchestra.run.smithi016.stdout:The following additional packages will be installed: 2023-11-28T17:40:41.212 INFO:teuthology.orchestra.run.smithi016.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2023-11-28T17:40:41.212 INFO:teuthology.orchestra.run.smithi016.stdout:Suggested packages: 2023-11-28T17:40:41.212 INFO:teuthology.orchestra.run.smithi016.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2023-11-28T17:40:41.253 INFO:teuthology.orchestra.run.smithi016.stdout:The following NEW packages will be installed: 2023-11-28T17:40:41.253 INFO:teuthology.orchestra.run.smithi016.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2023-11-28T17:40:41.254 INFO:teuthology.orchestra.run.smithi016.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2023-11-28T17:40:41.257 INFO:teuthology.orchestra.run.smithi016.stdout:The following packages will be upgraded: 2023-11-28T17:40:41.257 INFO:teuthology.orchestra.run.smithi016.stdout: gawk libcap2 2023-11-28T17:40:41.315 INFO:teuthology.orchestra.run.smithi016.stdout:2 upgraded, 14 newly installed, 0 to remove and 261 not upgraded. 2023-11-28T17:40:41.315 INFO:teuthology.orchestra.run.smithi016.stdout:Need to get 6,641 kB of archives. 2023-11-28T17:40:41.315 INFO:teuthology.orchestra.run.smithi016.stdout:After this operation, 14.2 MB of additional disk space will be used. 2023-11-28T17:40:41.315 INFO:teuthology.orchestra.run.smithi016.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-11-28T17:40:41.458 INFO:teuthology.orchestra.run.smithi016.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2023-11-28T17:40:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2023-11-28T17:40:41.459 INFO:teuthology.orchestra.run.smithi016.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2023-11-28T17:40:41.460 INFO:teuthology.orchestra.run.smithi016.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2023-11-28T17:40:41.461 INFO:teuthology.orchestra.run.smithi016.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2023-11-28T17:40:41.491 INFO:teuthology.orchestra.run.smithi016.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2023-11-28T17:40:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2023-11-28T17:40:41.492 INFO:teuthology.orchestra.run.smithi016.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2023-11-28T17:40:41.498 INFO:teuthology.orchestra.run.smithi016.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-11-28T17:40:41.499 INFO:teuthology.orchestra.run.smithi016.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-11-28T17:40:41.559 INFO:teuthology.orchestra.run.smithi016.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2023-11-28T17:40:41.559 INFO:teuthology.orchestra.run.smithi016.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-11-28T17:40:41.560 INFO:teuthology.orchestra.run.smithi016.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2023-11-28T17:40:41.561 INFO:teuthology.orchestra.run.smithi016.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-11-28T17:40:41.568 INFO:teuthology.orchestra.run.smithi016.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2023-11-28T17:40:41.840 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: unable to initialize frontend: Dialog 2023-11-28T17:40:41.840 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T17:40:41.840 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: falling back to frontend: Readline 2023-11-28T17:40:41.854 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: unable to initialize frontend: Readline 2023-11-28T17:40:41.855 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: (This frontend requires a controlling tty.) 2023-11-28T17:40:41.855 INFO:teuthology.orchestra.run.smithi016.stderr:debconf: falling back to frontend: Teletype 2023-11-28T17:40:41.862 INFO:teuthology.orchestra.run.smithi016.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-11-28T17:40:41.901 INFO:teuthology.orchestra.run.smithi016.stdout:Fetched 6,641 kB in 0s (21.6 MB/s) 2023-11-28T17:40:42.164 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143367 files and directories currently installed.) 2023-11-28T17:40:42.168 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-11-28T17:40:42.302 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-11-28T17:40:42.954 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2023-11-28T17:40:42.969 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-28T17:40:43.054 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T17:40:43.383 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libqb100:amd64. 2023-11-28T17:40:43.398 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2023-11-28T17:40:43.433 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-28T17:40:43.735 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcmap4:amd64. 2023-11-28T17:40:43.752 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-28T17:40:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T17:40:44.122 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libdlm3:amd64. 2023-11-28T17:40:44.139 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-libdlm3_4.1.1-1build1_amd64.deb ... 2023-11-28T17:40:44.325 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2023-11-28T17:40:44.676 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package ocfs2-tools. 2023-11-28T17:40:44.692 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2023-11-28T17:40:44.734 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2023-11-28T17:40:45.139 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:40:45.298 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2023-11-28T17:40:45.625 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T17:40:45.915 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package exfatprogs. 2023-11-28T17:40:45.998 INFO:teuthology.orchestra.run.smithi016.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143441 files and directories currently installed.) 2023-11-28T17:40:46.002 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../0-exfatprogs_1.1.3-1_amd64.deb ... 2023-11-28T17:40:46.038 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking exfatprogs (1.1.3-1) ... 2023-11-28T17:40:46.300 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package f2fs-tools. 2023-11-28T17:40:46.317 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../1-f2fs-tools_1.14.0-2build1_amd64.deb ... 2023-11-28T17:40:46.409 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2023-11-28T17:40:46.805 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-11-28T17:40:46.822 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../2-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-11-28T17:40:46.863 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-28T17:40:47.158 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package fio. 2023-11-28T17:40:47.174 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../3-fio_3.28-1_amd64.deb ... 2023-11-28T17:40:47.216 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking fio (3.28-1) ... 2023-11-28T17:40:47.587 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libcap-dev:amd64. 2023-11-28T17:40:47.602 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../4-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T17:40:47.637 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T17:40:47.908 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-11-28T17:40:47.923 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../5-libgdbm-dev_1.23-1_amd64.deb ... 2023-11-28T17:40:47.967 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-11-28T17:40:48.295 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package liburing-dev:amd64. 2023-11-28T17:40:48.311 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../6-liburing-dev_2.1-2build1_amd64.deb ... 2023-11-28T17:40:48.353 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2023-11-28T17:40:48.598 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package sqlite3. 2023-11-28T17:40:48.614 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../7-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-11-28T17:40:48.657 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-28T17:40:49.026 INFO:teuthology.orchestra.run.smithi016.stdout:Selecting previously unselected package udftools. 2023-11-28T17:40:49.044 INFO:teuthology.orchestra.run.smithi016.stdout:Preparing to unpack .../8-udftools_2.3-1_amd64.deb ... 2023-11-28T17:40:49.099 INFO:teuthology.orchestra.run.smithi016.stdout:Unpacking udftools (2.3-1) ... 2023-11-28T17:40:49.437 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up exfatprogs (1.1.3-1) ... 2023-11-28T17:40:49.564 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-11-28T17:40:49.784 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2023-11-28T17:40:49.893 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-28T17:40:50.002 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T17:40:50.120 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-28T17:40:50.246 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up udftools (2.3-1) ... 2023-11-28T17:40:50.406 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2023-11-28T17:40:50.532 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-11-28T17:40:50.693 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T17:40:50.809 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-28T17:40:50.935 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2023-11-28T17:40:51.061 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T17:40:51.187 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up fio (3.28-1) ... 2023-11-28T17:40:51.772 INFO:teuthology.orchestra.run.smithi016.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2023-11-28T17:40:52.072 INFO:teuthology.orchestra.run.smithi016.stdout:debconf: unable to initialize frontend: Dialog 2023-11-28T17:40:52.073 INFO:teuthology.orchestra.run.smithi016.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T17:40:52.073 INFO:teuthology.orchestra.run.smithi016.stdout:debconf: falling back to frontend: Readline 2023-11-28T17:40:53.218 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-11-28T17:40:53.329 INFO:teuthology.orchestra.run.smithi016.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T17:41:04.258 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:41:04.262 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:41:08.447 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T17:41:08.610 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T17:41:10.078 INFO:teuthology.orchestra.run.smithi016.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T17:41:10.610 DEBUG:teuthology.orchestra.run.smithi016:> sudo useradd -m fsgqa 2023-11-28T17:41:10.630 INFO:teuthology.orchestra.run.smithi016.stderr:useradd: user 'fsgqa' already exists 2023-11-28T17:41:10.632 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-28T17:41:10.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo groupadd fsgqa 2023-11-28T17:41:10.696 INFO:teuthology.orchestra.run.smithi016.stderr:groupadd: group 'fsgqa' already exists 2023-11-28T17:41:10.697 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-28T17:41:10.698 DEBUG:teuthology.orchestra.run.smithi016:> sudo useradd fsgqa2 2023-11-28T17:41:11.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo useradd 123456-fsgqa 2023-11-28T17:41:11.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-28T17:41:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 Processor -- start 2023-11-28T17:41:11.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 -- start start 2023-11-28T17:41:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990070460 0x7f49900708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:11.709 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4990145100 0x7f4990145570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4990070e00 con 0x7f4990161710 2023-11-28T17:41:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499006c6d0 con 0x7f4990145100 2023-11-28T17:41:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f499646b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499006c9b0 con 0x7f4990070460 2023-11-28T17:41:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f4994a08640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4990145100 0x7f4990145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f4994a08640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4990145100 0x7f4990145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57790/0 (socket says 172.21.15.16:57790) 2023-11-28T17:41:11.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.701+0000 7f4994a08640 1 -- 172.21.15.16:0/1343846457 learned_addr learned my addr 172.21.15.16:0/1343846457 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:41:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f498f7fe640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990070460 0x7f49900708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f4994a08640 1 -- 172.21.15.16:0/1343846457 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990070460 msgr2=0x7f49900708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T17:41:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f4994a08640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990070460 0x7f49900708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f4994a08640 1 -- 172.21.15.16:0/1343846457 >> v1:172.21.15.64:6789/0 conn(0x7f4990161710 legacy=0x7f4990165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f4994a08640 1 -- 172.21.15.16:0/1343846457 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499006cc90 con 0x7f4990145100 2023-11-28T17:41:11.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f498f7fe640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990070460 0x7f49900708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f4994a08640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990145100 0x7f4990145570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4988009e50 tx=0x7f498801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32e206bc5f01cbd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f498effd640 1 -- 172.21.15.16:0/1343846457 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880a58a0 con 0x7f4990145100 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f498effd640 1 -- 172.21.15.16:0/1343846457 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880a5a00 con 0x7f4990145100 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.705+0000 7f498effd640 1 -- 172.21.15.16:0/1343846457 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880a5d90 con 0x7f4990145100 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- 172.21.15.16:0/1343846457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990145100 msgr2=0x7f4990145570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990145100 0x7f4990145570 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4988009e50 tx=0x7f498801c9e0 comp rx=0 tx=0).stop 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- 172.21.15.16:0/1343846457 shutdown_connections 2023-11-28T17:41:11.714 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990145100 0x7f4990145570 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 --2- 172.21.15.16:0/1343846457 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990070460 0x7f49900708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- 172.21.15.16:0/1343846457 >> 172.21.15.16:0/1343846457 conn(0x7f499006a5a0 msgr2=0x7f499006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:41:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- 172.21.15.16:0/1343846457 shutdown_connections 2023-11-28T17:41:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- 172.21.15.16:0/1343846457 wait complete. 2023-11-28T17:41:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 Processor -- start 2023-11-28T17:41:11.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- start start 2023-11-28T17:41:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4990070460 0x7f499014a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990145100 0x7f499015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 0x7f49901424e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499015ac70 con 0x7f4990161710 2023-11-28T17:41:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990142a20 con 0x7f4990070460 2023-11-28T17:41:11.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f499646b640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990143860 con 0x7f4990145100 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 0x7f49901424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 0x7f49901424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57802/0 (socket says 172.21.15.16:57802) 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 -- 172.21.15.16:0/2790160398 learned_addr learned my addr 172.21.15.16:0/2790160398 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f498f7fe640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990145100 0x7f499015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f498ffff640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4990070460 0x7f499014a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 -- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990145100 msgr2=0x7f499015a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990145100 0x7f499015a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 -- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4990070460 msgr2=0x7f499014a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4990070460 0x7f499014a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.709+0000 7f4994a08640 1 -- 172.21.15.16:0/2790160398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4988009b30 con 0x7f4990161710 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f4994a08640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 0x7f49901424e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49880af040 tx=0x7f4988019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:41:11.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880b8670 con 0x7f4990161710 2023-11-28T17:41:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49880b87f0 con 0x7f4990161710 2023-11-28T17:41:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49880b8ba0 con 0x7f4990161710 2023-11-28T17:41:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4990142c50 con 0x7f4990161710 2023-11-28T17:41:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4990143210 con 0x7f4990161710 2023-11-28T17:41:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4990160f30 con 0x7f4990161710 2023-11-28T17:41:11.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f49880b8d00 con 0x7f4990161710 2023-11-28T17:41:11.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498cff9640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f497c0668d0 0x7f497c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:11.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f498811fa90 con 0x7f4990161710 2023-11-28T17:41:11.720 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.713+0000 7f498ffff640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f497c0668d0 0x7f497c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:11.721 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.717+0000 7f498ffff640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f497c0668d0 0x7f497c068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4980000f70 tx=0x7f4980009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:41:11.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.721+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f49880eccf0 con 0x7f4990161710 2023-11-28T17:41:11.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.933+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f49901439d0 con 0x7f4990161710 2023-11-28T17:41:12.011 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.933+0000 7f498cff9640 1 -- 172.21.15.16:0/2790160398 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7f49880f0310 con 0x7f4990161710 2023-11-28T17:41:12.011 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:41:12.012 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":1,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","modified":"2023-11-28T17:38:35.854042Z","created":"2023-11-28T17:38:35.854042Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:3300","nonce":0},{"type":"v1","addr":"172.21.15.16:6789","nonce":0}]},"addr":"172.21.15.16:6789/0","public_addr":"172.21.15.16:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3301","nonce":0},{"type":"v1","addr":"172.21.15.64:6790","nonce":0}]},"addr":"172.21.15.64:6790/0","public_addr":"172.21.15.64:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-28T17:41:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:dumped monmap epoch 1 2023-11-28T17:41:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f497c0668d0 msgr2=0x7f497c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f497c0668d0 0x7f497c068d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4980000f70 tx=0x7f4980009040 comp rx=0 tx=0).stop 2023-11-28T17:41:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 msgr2=0x7f49901424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 0x7f49901424e0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f49880af040 tx=0x7f4988019780 comp rx=0 tx=0).stop 2023-11-28T17:41:12.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 shutdown_connections 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4990161710 0x7f49901424e0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4990145100 0x7f499015a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f497c0668d0 0x7f497c068d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 --2- 172.21.15.16:0/2790160398 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4990070460 0x7f499014a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 >> 172.21.15.16:0/2790160398 conn(0x7f499006a5a0 msgr2=0x7f499013de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 shutdown_connections 2023-11-28T17:41:12.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:11.937+0000 7f499646b640 1 -- 172.21.15.16:0/2790160398 wait complete. 2023-11-28T17:41:12.016 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-28T17:41:12.163 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.157+0000 7fc88ee79640 1 Processor -- start 2023-11-28T17:41:12.164 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.157+0000 7fc88ee79640 1 -- start start 2023-11-28T17:41:12.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.157+0000 7fc88ee79640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc8880aed60 0x7fc888144f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:12.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.157+0000 7fc88ee79640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc88806ae00 con 0x7fc8880b2b70 2023-11-28T17:41:12.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.157+0000 7fc88ee79640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc888161cd0 con 0x7fc8881616b0 2023-11-28T17:41:12.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.157+0000 7fc88ee79640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc88806a5a0 con 0x7fc8880aed60 2023-11-28T17:41:12.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc887fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fc8880b2b70 0x7fc888160fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:53918/0 (socket says 172.21.15.16:53918) 2023-11-28T17:41:12.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc887fff640 1 -- 172.21.15.16:0/524377515 learned_addr learned my addr 172.21.15.16:0/524377515 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc88cc15640 1 --2- 172.21.15.16:0/524377515 >> v2:172.21.15.64:3300/0 conn(0x7fc8880aed60 0x7fc888144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc8877fe640 1 -- 172.21.15.16:0/524377515 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 86017357 0 0) 0x7fc88806ae00 con 0x7fc8880b2b70 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc8877fe640 1 -- 172.21.15.16:0/524377515 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc878003530 con 0x7fc8880b2b70 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc8877fe640 1 -- 172.21.15.16:0/524377515 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227616692 0 0) 0x7fc878003530 con 0x7fc8880b2b70 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc88cc15640 1 -- 172.21.15.16:0/524377515 >> v1:172.21.15.64:6789/0 conn(0x7fc8881616b0 legacy=0x7fc88806b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc88cc15640 1 -- 172.21.15.16:0/524377515 >> v1:172.21.15.16:6789/0 conn(0x7fc8880b2b70 legacy=0x7fc888160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc88cc15640 1 -- 172.21.15.16:0/524377515 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88806a7b0 con 0x7fc8880aed60 2023-11-28T17:41:12.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.161+0000 7fc88cc15640 1 --2- 172.21.15.16:0/524377515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880aed60 0x7fc888144f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0097c0 tx=0x7fc87c01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b8e6a1637b1009 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:41:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc8877fe640 1 -- 172.21.15.16:0/524377515 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc874001680 con 0x7fc8880aed60 2023-11-28T17:41:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc8877fe640 1 -- 172.21.15.16:0/524377515 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c0a7050 con 0x7fc8880aed60 2023-11-28T17:41:12.169 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc8877fe640 1 -- 172.21.15.16:0/524377515 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0ab620 con 0x7fc8880aed60 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- 172.21.15.16:0/524377515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880aed60 msgr2=0x7fc888144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 --2- 172.21.15.16:0/524377515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880aed60 0x7fc888144f40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0097c0 tx=0x7fc87c01c310 comp rx=0 tx=0).stop 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- 172.21.15.16:0/524377515 shutdown_connections 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 --2- 172.21.15.16:0/524377515 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880aed60 0x7fc888144f40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- 172.21.15.16:0/524377515 >> 172.21.15.16:0/524377515 conn(0x7fc8880b1de0 msgr2=0x7fc8880cf850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- 172.21.15.16:0/524377515 shutdown_connections 2023-11-28T17:41:12.170 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- 172.21.15.16:0/524377515 wait complete. 2023-11-28T17:41:12.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 Processor -- start 2023-11-28T17:41:12.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- start start 2023-11-28T17:41:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 0x7fc88813e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880b2b70 0x7fc888145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc8881616b0 0x7fc8880cd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880cc780 con 0x7fc8880aed60 2023-11-28T17:41:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880cca60 con 0x7fc8880b2b70 2023-11-28T17:41:12.174 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88ee79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8880ccd40 con 0x7fc8881616b0 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.165+0000 7fc88cc15640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 0x7fc88813e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 0x7fc88813e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:57812/0 (socket says 172.21.15.16:57812) 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 -- 172.21.15.16:0/3569537079 learned_addr learned my addr 172.21.15.16:0/3569537079 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc887fff640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880b2b70 0x7fc888145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88d416640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc8881616b0 0x7fc8880cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 -- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc8881616b0 msgr2=0x7fc8880cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc8881616b0 0x7fc8880cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 -- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880b2b70 msgr2=0x7fc888145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880b2b70 0x7fc888145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 -- 172.21.15.16:0/3569537079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c009420 con 0x7fc8880aed60 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88cc15640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 0x7fc88813e3e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0ae040 tx=0x7fc87c01ab50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:41:12.175 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0abda0 con 0x7fc8880aed60 2023-11-28T17:41:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87c004020 con 0x7fc8880aed60 2023-11-28T17:41:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c004390 con 0x7fc8880aed60 2023-11-28T17:41:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8880cd020 con 0x7fc8880aed60 2023-11-28T17:41:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc88813e920 con 0x7fc8880aed60 2023-11-28T17:41:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc888068860 con 0x7fc8880aed60 2023-11-28T17:41:12.176 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.169+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc87c003620 con 0x7fc8880aed60 2023-11-28T17:41:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.173+0000 7fc8857fa640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc86c0668d0 0x7fc86c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T17:41:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.173+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc87c11ebb0 con 0x7fc8880aed60 2023-11-28T17:41:12.177 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.173+0000 7fc887fff640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc86c0668d0 0x7fc86c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T17:41:12.178 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.173+0000 7fc887fff640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc86c0668d0 0x7fc86c068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc888157f30 tx=0x7fc874001a60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T17:41:12.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.177+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc87c0ebfb0 con 0x7fc8880aed60 2023-11-28T17:41:12.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.389+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fc8880b27b0 con 0x7fc8880aed60 2023-11-28T17:41:12.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.389+0000 7fc8857fa640 1 -- 172.21.15.16:0/3569537079 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7fc87c0ef5d0 con 0x7fc8880aed60 2023-11-28T17:41:12.396 INFO:teuthology.orchestra.run.smithi016.stdout:[client.admin] 2023-11-28T17:41:12.396 INFO:teuthology.orchestra.run.smithi016.stdout: key = AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc86c0668d0 msgr2=0x7fc86c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc86c0668d0 0x7fc86c068d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc888157f30 tx=0x7fc874001a60 comp rx=0 tx=0).stop 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 msgr2=0x7fc88813e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 0x7fc88813e3e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0ae040 tx=0x7fc87c01ab50 comp rx=0 tx=0).stop 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 shutdown_connections 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc8881616b0 0x7fc8880cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc86c0668d0 0x7fc86c068d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8880b2b70 0x7fc888145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 --2- 172.21.15.16:0/3569537079 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc8880aed60 0x7fc88813e3e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T17:41:12.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 >> 172.21.15.16:0/3569537079 conn(0x7fc8880b1de0 msgr2=0x7fc88806caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T17:41:12.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 shutdown_connections 2023-11-28T17:41:12.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-28T17:41:12.393+0000 7fc88ee79640 1 -- 172.21.15.16:0/3569537079 wait complete. 2023-11-28T17:41:12.417 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:41:12.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/tmp/tmp.SqFPnd7Bgcxfstests-dev/local.config 2023-11-28T17:41:12.438 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.16:6789:/test export TEST_DIR=/tmp/tmp.bPlePXOp82test export SCRATCH_DEV=172.21.15.16:6789:/scratch export SCRATCH_MNT=/tmp/tmp.Vlt2oGtC1Iscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw==" 2023-11-28T17:41:12.438 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-28T17:41:12.438 DEBUG:teuthology.orchestra.run.smithi016:> sudo dd of=/tmp/tmp.SqFPnd7Bgcxfstests-dev/ceph.exclude 2023-11-28T17:41:12.505 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo make) 2023-11-28T17:41:12.573 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize -cfi 2023-11-28T17:41:12.898 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-28T17:41:12.898 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './config.guess' 2023-11-28T17:41:12.907 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './config.sub' 2023-11-28T17:41:12.926 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './install-sh' 2023-11-28T17:41:12.937 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file './ltmain.sh' 2023-11-28T17:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-28T17:41:12.990 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-28T17:41:13.001 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-28T17:41:13.012 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-28T17:41:13.022 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-28T17:41:13.033 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-28T17:41:13.043 INFO:teuthology.orchestra.run.smithi016.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-28T17:41:13.046 INFO:teuthology.orchestra.run.smithi016.stdout:cp include/install-sh . 2023-11-28T17:41:13.048 INFO:teuthology.orchestra.run.smithi016.stdout:aclocal -I m4 2023-11-28T17:41:14.130 INFO:teuthology.orchestra.run.smithi016.stdout:autoheader 2023-11-28T17:41:14.517 INFO:teuthology.orchestra.run.smithi016.stdout:autoconf 2023-11-28T17:41:14.948 INFO:teuthology.orchestra.run.smithi016.stdout:./configure \ 2023-11-28T17:41:14.948 INFO:teuthology.orchestra.run.smithi016.stdout: --libexecdir=/usr/lib \ 2023-11-28T17:41:14.948 INFO:teuthology.orchestra.run.smithi016.stdout: --exec_prefix=/var/lib 2023-11-28T17:41:15.501 INFO:teuthology.orchestra.run.smithi016.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-28T17:41:15.501 INFO:teuthology.orchestra.run.smithi016.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-28T17:41:15.544 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to print strings... printf 2023-11-28T17:41:15.544 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc... gcc 2023-11-28T17:41:15.743 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether the C compiler works... yes 2023-11-28T17:41:15.743 INFO:teuthology.orchestra.run.smithi016.stdout:checking for C compiler default output file name... a.out 2023-11-28T17:41:15.787 INFO:teuthology.orchestra.run.smithi016.stdout:checking for suffix of executables... 2023-11-28T17:41:15.869 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether we are cross compiling... no 2023-11-28T17:41:15.898 INFO:teuthology.orchestra.run.smithi016.stdout:checking for suffix of object files... o 2023-11-28T17:41:15.922 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether the compiler supports GNU C... yes 2023-11-28T17:41:15.948 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether gcc accepts -g... yes 2023-11-28T17:41:16.094 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc option to enable C11 features... none needed 2023-11-28T17:41:16.101 INFO:teuthology.orchestra.run.smithi016.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-28T17:41:16.108 INFO:teuthology.orchestra.run.smithi016.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-28T17:41:16.109 INFO:teuthology.orchestra.run.smithi016.stdout:checking for egrep... /usr/bin/grep -E 2023-11-28T17:41:16.112 INFO:teuthology.orchestra.run.smithi016.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-28T17:41:16.120 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-28T17:41:16.123 INFO:teuthology.orchestra.run.smithi016.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-28T17:41:16.139 INFO:teuthology.orchestra.run.smithi016.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-28T17:41:16.171 INFO:teuthology.orchestra.run.smithi016.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-28T17:41:16.171 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether ln -s works... yes 2023-11-28T17:41:16.185 INFO:teuthology.orchestra.run.smithi016.stdout:checking the maximum length of command line arguments... 1572864 2023-11-28T17:41:16.191 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-28T17:41:16.191 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-28T17:41:16.191 INFO:teuthology.orchestra.run.smithi016.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-28T17:41:16.191 INFO:teuthology.orchestra.run.smithi016.stdout:checking for objdump... objdump 2023-11-28T17:41:16.191 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to recognize dependent libraries... pass_all 2023-11-28T17:41:16.192 INFO:teuthology.orchestra.run.smithi016.stdout:checking for dlltool... no 2023-11-28T17:41:16.192 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-28T17:41:16.192 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ar... ar 2023-11-28T17:41:16.240 INFO:teuthology.orchestra.run.smithi016.stdout:checking for archiver @FILE support... @ 2023-11-28T17:41:16.240 INFO:teuthology.orchestra.run.smithi016.stdout:checking for strip... strip 2023-11-28T17:41:16.240 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ranlib... ranlib 2023-11-28T17:41:16.241 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gawk... gawk 2023-11-28T17:41:16.332 INFO:teuthology.orchestra.run.smithi016.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-28T17:41:16.335 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sysroot... no 2023-11-28T17:41:16.343 INFO:teuthology.orchestra.run.smithi016.stdout:checking for a working dd... /usr/bin/dd 2023-11-28T17:41:16.350 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-28T17:41:16.370 INFO:teuthology.orchestra.run.smithi016.stdout:checking for mt... mt 2023-11-28T17:41:16.383 INFO:teuthology.orchestra.run.smithi016.stdout:checking if mt is a manifest tool... no 2023-11-28T17:41:16.421 INFO:teuthology.orchestra.run.smithi016.stdout:checking for stdio.h... yes 2023-11-28T17:41:16.465 INFO:teuthology.orchestra.run.smithi016.stdout:checking for stdlib.h... yes 2023-11-28T17:41:16.501 INFO:teuthology.orchestra.run.smithi016.stdout:checking for string.h... yes 2023-11-28T17:41:16.545 INFO:teuthology.orchestra.run.smithi016.stdout:checking for inttypes.h... yes 2023-11-28T17:41:16.579 INFO:teuthology.orchestra.run.smithi016.stdout:checking for stdint.h... yes 2023-11-28T17:41:16.613 INFO:teuthology.orchestra.run.smithi016.stdout:checking for strings.h... yes 2023-11-28T17:41:16.652 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/stat.h... yes 2023-11-28T17:41:16.688 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/types.h... yes 2023-11-28T17:41:16.747 INFO:teuthology.orchestra.run.smithi016.stdout:checking for unistd.h... yes 2023-11-28T17:41:16.787 INFO:teuthology.orchestra.run.smithi016.stdout:checking for dlfcn.h... yes 2023-11-28T17:41:16.793 INFO:teuthology.orchestra.run.smithi016.stdout:checking for objdir... .libs 2023-11-28T17:41:16.915 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-28T17:41:16.915 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-28T17:41:16.943 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-28T17:41:17.174 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc static flag -static works... yes 2023-11-28T17:41:17.216 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc supports -c -o file.o... yes 2023-11-28T17:41:17.216 INFO:teuthology.orchestra.run.smithi016.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-28T17:41:17.231 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-28T17:41:17.268 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether -lc should be explicitly linked in... no 2023-11-28T17:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-28T17:41:17.365 INFO:teuthology.orchestra.run.smithi016.stdout:checking how to hardcode library paths into programs... immediate 2023-11-28T17:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether stripping libraries is possible... yes 2023-11-28T17:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout:checking if libtool supports shared libraries... yes 2023-11-28T17:41:17.373 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether to build shared libraries... yes 2023-11-28T17:41:17.374 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether to build static libraries... yes 2023-11-28T17:41:17.389 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc... (cached) gcc 2023-11-28T17:41:17.433 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-28T17:41:17.433 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-28T17:41:17.433 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-28T17:41:17.433 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gmake... /usr/bin/gmake 2023-11-28T17:41:17.433 INFO:teuthology.orchestra.run.smithi016.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-11-28T17:41:17.434 INFO:teuthology.orchestra.run.smithi016.stdout:checking for tar... /bin/tar 2023-11-28T17:41:17.434 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gzip... /bin/gzip 2023-11-28T17:41:17.450 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether gcc -MM is supported... yes 2023-11-28T17:41:17.450 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sort... /bin/sort 2023-11-28T17:41:17.450 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether ln -s works... yes 2023-11-28T17:41:17.450 INFO:teuthology.orchestra.run.smithi016.stdout:checking for rpm... no 2023-11-28T17:41:17.492 INFO:teuthology.orchestra.run.smithi016.stdout:checking for assert.h... yes 2023-11-28T17:41:17.537 INFO:teuthology.orchestra.run.smithi016.stdout:checking for bstring.h... no 2023-11-28T17:41:17.585 INFO:teuthology.orchestra.run.smithi016.stdout:checking for libgen.h... yes 2023-11-28T17:41:17.661 INFO:teuthology.orchestra.run.smithi016.stdout:checking for dirent.h... yes 2023-11-28T17:41:17.740 INFO:teuthology.orchestra.run.smithi016.stdout:checking for errno.h... yes 2023-11-28T17:41:17.780 INFO:teuthology.orchestra.run.smithi016.stdout:checking for malloc.h... yes 2023-11-28T17:41:17.823 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid.h... no 2023-11-28T17:41:17.874 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid/uuid.h... yes 2023-11-28T17:41:17.918 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/uuid.h... no 2023-11-28T17:41:17.959 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/file.h... yes 2023-11-28T17:41:17.998 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/fcntl.h... yes 2023-11-28T17:41:18.041 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/syssgi.h... no 2023-11-28T17:41:18.096 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/param.h... yes 2023-11-28T17:41:18.097 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/stat.h... (cached) yes 2023-11-28T17:41:18.136 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/statvfs.h... yes 2023-11-28T17:41:18.175 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/time.h... yes 2023-11-28T17:41:18.227 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/ioctl.h... yes 2023-11-28T17:41:18.269 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/wait.h... yes 2023-11-28T17:41:18.269 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/types.h... (cached) yes 2023-11-28T17:41:18.269 INFO:teuthology.orchestra.run.smithi016.stdout:checking for strings.h... (cached) yes 2023-11-28T17:41:18.308 INFO:teuthology.orchestra.run.smithi016.stdout:checking for err.h... yes 2023-11-28T17:41:18.347 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/falloc.h... yes 2023-11-28T17:41:18.390 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-28T17:41:18.434 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-28T17:41:18.477 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/platform_defs.h... no 2023-11-28T17:41:18.520 INFO:teuthology.orchestra.run.smithi016.stdout:checking for btrfs/ioctl.h... no 2023-11-28T17:41:18.563 INFO:teuthology.orchestra.run.smithi016.stdout:checking for cifs/ioctl.h... no 2023-11-28T17:41:18.604 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/mman.h... yes 2023-11-28T17:41:18.628 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/xfs_log_format.h... no 2023-11-28T17:41:18.688 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid_compare... no 2023-11-28T17:41:18.738 INFO:teuthology.orchestra.run.smithi016.stdout:checking for uuid_compare in -luuid... yes 2023-11-28T17:41:18.852 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/xfs.h... yes 2023-11-28T17:41:18.877 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/libxfs.h... no 2023-11-28T17:41:18.927 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-28T17:41:18.960 INFO:teuthology.orchestra.run.smithi016.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-28T17:41:19.009 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/xqm.h... yes 2023-11-28T17:41:19.085 INFO:teuthology.orchestra.run.smithi016.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-28T17:41:19.127 INFO:teuthology.orchestra.run.smithi016.stdout:checking for xfs/handle.h... yes 2023-11-28T17:41:19.177 INFO:teuthology.orchestra.run.smithi016.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-28T17:41:19.226 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/acl.h... yes 2023-11-28T17:41:19.276 INFO:teuthology.orchestra.run.smithi016.stdout:checking for acl/libacl.h... yes 2023-11-28T17:41:19.328 INFO:teuthology.orchestra.run.smithi016.stdout:checking for acl_init in -lacl... yes 2023-11-28T17:41:19.370 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gdbm-ndbm.h... no 2023-11-28T17:41:19.414 INFO:teuthology.orchestra.run.smithi016.stdout:checking for gdbm/ndbm.h... no 2023-11-28T17:41:19.457 INFO:teuthology.orchestra.run.smithi016.stdout:checking for ndbm.h... no 2023-11-28T17:41:19.501 INFO:teuthology.orchestra.run.smithi016.stdout:checking for libaio.h... yes 2023-11-28T17:41:19.578 INFO:teuthology.orchestra.run.smithi016.stdout:checking for liburing.h... yes 2023-11-28T17:41:19.626 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/capability.h... yes 2023-11-28T17:41:19.667 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/fiemap.h... yes 2023-11-28T17:41:19.719 INFO:teuthology.orchestra.run.smithi016.stdout:checking for fallocate... yes 2023-11-28T17:41:19.774 INFO:teuthology.orchestra.run.smithi016.stdout:checking for open_by_handle_at... yes 2023-11-28T17:41:19.818 INFO:teuthology.orchestra.run.smithi016.stdout:checking for sys/prctl.h... yes 2023-11-28T17:41:19.857 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/fs.h... yes 2023-11-28T17:41:19.900 INFO:teuthology.orchestra.run.smithi016.stdout:checking for btrfsutil.h... no 2023-11-28T17:41:19.957 INFO:teuthology.orchestra.run.smithi016.stdout:checking for copy_file_range... yes 2023-11-28T17:41:20.017 INFO:teuthology.orchestra.run.smithi016.stdout:checking for SEEK_DATA... yes 2023-11-28T17:41:20.096 INFO:teuthology.orchestra.run.smithi016.stdout:checking for BMV_OF_SHARED... yes 2023-11-28T17:41:20.154 INFO:teuthology.orchestra.run.smithi016.stdout:checking for nftw... yes 2023-11-28T17:41:20.210 INFO:teuthology.orchestra.run.smithi016.stdout:checking for RLIMIT_NOFILE... yes 2023-11-28T17:41:20.246 INFO:teuthology.orchestra.run.smithi016.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-28T17:41:20.301 INFO:teuthology.orchestra.run.smithi016.stdout:checking for renameat2... yes 2023-11-28T17:41:20.353 INFO:teuthology.orchestra.run.smithi016.stdout:checking for reallocarray... yes 2023-11-28T17:41:20.407 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct mount_attr... yes 2023-11-28T17:41:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-28T17:41:20.524 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-28T17:41:20.577 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-28T17:41:20.632 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-28T17:41:20.688 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-28T17:41:20.743 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-28T17:41:20.799 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-28T17:41:20.840 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/btrfs.h... yes 2023-11-28T17:41:20.883 INFO:teuthology.orchestra.run.smithi016.stdout:checking for linux/btrfs_tree.h... yes 2023-11-28T17:41:20.912 INFO:teuthology.orchestra.run.smithi016.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-28T17:41:20.940 INFO:teuthology.orchestra.run.smithi016.stdout:configure: creating ./config.status 2023-11-28T17:41:21.807 INFO:teuthology.orchestra.run.smithi016.stdout:config.status: creating include/builddefs 2023-11-28T17:41:21.836 INFO:teuthology.orchestra.run.smithi016.stdout:config.status: creating include/config.h 2023-11-28T17:41:21.858 INFO:teuthology.orchestra.run.smithi016.stdout:config.status: executing libtool commands 2023-11-28T17:41:21.928 INFO:teuthology.orchestra.run.smithi016.stdout:Building include 2023-11-28T17:41:21.935 INFO:teuthology.orchestra.run.smithi016.stdout:Building lib 2023-11-28T17:41:21.941 INFO:teuthology.orchestra.run.smithi016.stdout: [LTDEP] 2023-11-28T17:41:22.141 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dataascii.lo 2023-11-28T17:41:22.300 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] databin.lo 2023-11-28T17:41:22.494 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] datapid.lo 2023-11-28T17:41:22.638 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] file_lock.lo 2023-11-28T17:41:22.837 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] forker.lo 2023-11-28T17:41:23.016 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] pattern.lo 2023-11-28T17:41:23.166 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] open_flags.lo 2023-11-28T17:41:23.350 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] random_range.lo 2023-11-28T17:41:23.619 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] string_to_tokens.lo 2023-11-28T17:41:23.752 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] str_to_bytes.lo 2023-11-28T17:41:23.928 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] tlibio.lo 2023-11-28T17:41:24.229 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] write_log.lo 2023-11-28T17:41:24.318 INFO:teuthology.orchestra.run.smithi016.stderr:write_log.c: In function 'wlog_record_write': 2023-11-28T17:41:24.318 INFO:teuthology.orchestra.run.smithi016.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:24.318 INFO:teuthology.orchestra.run.smithi016.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-11-28T17:41:24.319 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:24.319 INFO:teuthology.orchestra.run.smithi016.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:24.319 INFO:teuthology.orchestra.run.smithi016.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-11-28T17:41:24.319 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:24.512 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] random.lo 2023-11-28T17:41:24.645 INFO:teuthology.orchestra.run.smithi016.stdout: [LD] 2023-11-28T17:41:24.763 INFO:teuthology.orchestra.run.smithi016.stdout:Building ltp 2023-11-28T17:41:24.768 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-11-28T17:41:24.977 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] doio 2023-11-28T17:41:25.750 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsstress 2023-11-28T17:41:27.372 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsx 2023-11-28T17:41:28.247 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] growfiles 2023-11-28T17:41:28.860 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] iogen 2023-11-28T17:41:29.033 INFO:teuthology.orchestra.run.smithi016.stderr:iogen.c: In function 'main': 2023-11-28T17:41:29.033 INFO:teuthology.orchestra.run.smithi016.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:29.033 INFO:teuthology.orchestra.run.smithi016.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-11-28T17:41:29.033 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:29.036 INFO:teuthology.orchestra.run.smithi016.stderr:iogen.c: In function 'parse_cmdline': 2023-11-28T17:41:29.036 INFO:teuthology.orchestra.run.smithi016.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:29.037 INFO:teuthology.orchestra.run.smithi016.stderr: 1535 | getcwd(fptr->f_path, 2023-11-28T17:41:29.037 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:29.037 INFO:teuthology.orchestra.run.smithi016.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-11-28T17:41:29.037 INFO:teuthology.orchestra.run.smithi016.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:29.333 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-stress 2023-11-28T17:41:29.503 INFO:teuthology.orchestra.run.smithi016.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-11-28T17:41:29.504 INFO:teuthology.orchestra.run.smithi016.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:29.504 INFO:teuthology.orchestra.run.smithi016.stderr: 1013 | ftruncate(fd, total_ram); 2023-11-28T17:41:29.504 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:29.838 INFO:teuthology.orchestra.run.smithi016.stdout:Building src 2023-11-28T17:41:29.846 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-11-28T17:41:32.332 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-11-28T17:41:32.381 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-11-28T17:41:32.395 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-11-28T17:41:32.739 INFO:teuthology.orchestra.run.smithi016.stdout: [DEP] 2023-11-28T17:41:32.778 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dirstress 2023-11-28T17:41:33.086 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fill 2023-11-28T17:41:33.286 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fill2 2023-11-28T17:41:33.578 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] getpagesize 2023-11-28T17:41:33.759 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] holes 2023-11-28T17:41:34.010 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] lstat64 2023-11-28T17:41:34.246 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] nametest 2023-11-28T17:41:34.313 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:41:34.317 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:41:34.417 INFO:teuthology.orchestra.run.smithi016.stderr:nametest.c: In function 'main': 2023-11-28T17:41:34.417 INFO:teuthology.orchestra.run.smithi016.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:34.417 INFO:teuthology.orchestra.run.smithi016.stderr: 236 | write(1, "\n", 1); 2023-11-28T17:41:34.417 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:34.418 INFO:teuthology.orchestra.run.smithi016.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:34.418 INFO:teuthology.orchestra.run.smithi016.stderr: 238 | write(1, ".", 1); 2023-11-28T17:41:34.418 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:34.418 INFO:teuthology.orchestra.run.smithi016.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:34.418 INFO:teuthology.orchestra.run.smithi016.stderr: 288 | write(1, ".", 1); 2023-11-28T17:41:34.418 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:34.546 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] permname 2023-11-28T17:41:34.804 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] randholes 2023-11-28T17:41:35.114 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] runas 2023-11-28T17:41:35.343 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] truncfile 2023-11-28T17:41:35.578 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] usemem 2023-11-28T17:41:35.777 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mmapcat 2023-11-28T17:41:35.929 INFO:teuthology.orchestra.run.smithi016.stderr:mmapcat.c: In function 'main': 2023-11-28T17:41:35.929 INFO:teuthology.orchestra.run.smithi016.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:35.929 INFO:teuthology.orchestra.run.smithi016.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-11-28T17:41:35.930 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:35.974 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] append_reader 2023-11-28T17:41:36.177 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] append_writer 2023-11-28T17:41:36.379 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dirperf 2023-11-28T17:41:36.667 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] metaperf 2023-11-28T17:41:36.829 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c: In function 'crfiles': 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr: 166 | write(fd, buf, fsize); 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c: In function 't_linkun': 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr: 454 | link("a", *fnp); 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~ 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c: In function 't_chown': 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:36.830 INFO:teuthology.orchestra.run.smithi016.stderr: 404 | chown(*fnp, 2, -1); 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: 406 | chown(*fnp, 1, -1); 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c: In function 'i_chown': 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: 291 | chown(*fnp, 1, -1); 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c: In function 'main': 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: 152 | chdir(".."); 2023-11-28T17:41:36.831 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~ 2023-11-28T17:41:37.016 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] devzero 2023-11-28T17:41:37.247 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] feature 2023-11-28T17:41:37.538 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] alloc 2023-11-28T17:41:37.708 INFO:teuthology.orchestra.run.smithi016.stderr:alloc.c: In function 'main': 2023-11-28T17:41:37.708 INFO:teuthology.orchestra.run.smithi016.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:37.708 INFO:teuthology.orchestra.run.smithi016.stderr: 247 | mkstemp(tmpfile); 2023-11-28T17:41:37.708 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:37.810 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fault 2023-11-28T17:41:38.026 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fstest 2023-11-28T17:41:38.324 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_access_root 2023-11-28T17:41:38.477 INFO:teuthology.orchestra.run.smithi016.stderr:t_access_root.c: In function 'main': 2023-11-28T17:41:38.478 INFO:teuthology.orchestra.run.smithi016.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:38.478 INFO:teuthology.orchestra.run.smithi016.stderr: 55 | system(cmd); 2023-11-28T17:41:38.478 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~ 2023-11-28T17:41:38.530 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] godown 2023-11-28T17:41:38.755 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] resvtest 2023-11-28T17:41:39.002 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] writemod 2023-11-28T17:41:39.197 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] writev_on_pagefault 2023-11-28T17:41:39.408 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] makeextents 2023-11-28T17:41:39.642 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] itrash 2023-11-28T17:41:39.845 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] rename 2023-11-28T17:41:40.031 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] multi_open_unlink 2023-11-28T17:41:40.251 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] unwritten_sync 2023-11-28T17:41:40.486 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] genhashnames 2023-11-28T17:41:40.725 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_holes 2023-11-28T17:41:40.922 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_writev 2023-11-28T17:41:41.120 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_truncate_cmtime 2023-11-28T17:41:41.329 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dirhash_collide 2023-11-28T17:41:41.565 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_rename_overwrite 2023-11-28T17:41:41.752 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] holetest 2023-11-28T17:41:41.914 INFO:teuthology.orchestra.run.smithi016.stderr:holetest.c: In function 'pt_write_marker': 2023-11-28T17:41:41.914 INFO:teuthology.orchestra.run.smithi016.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:41.914 INFO:teuthology.orchestra.run.smithi016.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-11-28T17:41:41.914 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:42.036 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_truncate_self 2023-11-28T17:41:42.224 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] af_unix 2023-11-28T17:41:42.427 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_stale_pmd 2023-11-28T17:41:42.582 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr: 42 | ftruncate(fd, 0); 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr: 43 | ftruncate(fd, MiB(4)); 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-11-28T17:41:42.583 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:42.632 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_cow_race 2023-11-28T17:41:42.790 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_cow_race.c: In function 'main': 2023-11-28T17:41:42.790 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:42.790 INFO:teuthology.orchestra.run.smithi016.stderr: 61 | ftruncate(fd, 0); 2023-11-28T17:41:42.790 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:42.790 INFO:teuthology.orchestra.run.smithi016.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:42.791 INFO:teuthology.orchestra.run.smithi016.stderr: 62 | ftruncate(fd, MiB(2)); 2023-11-28T17:41:42.791 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:42.849 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_fallocate 2023-11-28T17:41:43.050 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsync-err 2023-11-28T17:41:43.289 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_write_ro 2023-11-28T17:41:43.493 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-28T17:41:43.650 INFO:teuthology.orchestra.run.smithi016.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-11-28T17:41:43.651 INFO:teuthology.orchestra.run.smithi016.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:43.651 INFO:teuthology.orchestra.run.smithi016.stderr: 61 | ftruncate(fd, 0); 2023-11-28T17:41:43.651 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:43.706 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-28T17:41:44.023 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_ofd_locks 2023-11-28T17:41:44.275 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_collision 2023-11-28T17:41:44.530 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mmap-write-concurrent 2023-11-28T17:41:44.752 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_get_file_time 2023-11-28T17:41:44.949 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_create_short_dirs 2023-11-28T17:41:45.167 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_create_long_dirs 2023-11-28T17:41:45.382 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_enospc 2023-11-28T17:41:45.634 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_writev_overlap 2023-11-28T17:41:45.856 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] checkpoint_journal 2023-11-28T17:41:46.063 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mmap-rw-fault 2023-11-28T17:41:46.300 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] allocstale 2023-11-28T17:41:46.522 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_cow_memory_failure 2023-11-28T17:41:46.748 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fake-dump-rootino 2023-11-28T17:41:46.950 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dio-buf-fault 2023-11-28T17:41:47.154 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] rewinddir-test 2023-11-28T17:41:47.377 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] xfsctl 2023-11-28T17:41:47.624 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bstat 2023-11-28T17:41:47.892 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mtab 2023-11-28T17:41:48.053 INFO:teuthology.orchestra.run.smithi016.stderr:t_mtab.c: In function 'update_mtab': 2023-11-28T17:41:48.053 INFO:teuthology.orchestra.run.smithi016.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:48.054 INFO:teuthology.orchestra.run.smithi016.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-11-28T17:41:48.054 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:48.137 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] getdevicesize 2023-11-28T17:41:48.329 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] preallo_rw_pattern_reader 2023-11-28T17:41:48.494 INFO:teuthology.orchestra.run.smithi016.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-11-28T17:41:48.495 INFO:teuthology.orchestra.run.smithi016.stderr:iopat.c: In function 'main': 2023-11-28T17:41:48.495 INFO:teuthology.orchestra.run.smithi016.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:48.495 INFO:teuthology.orchestra.run.smithi016.stderr: 38 | read(fd, &x, 1048576); 2023-11-28T17:41:48.495 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:48.540 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] preallo_rw_pattern_writer 2023-11-28T17:41:48.706 INFO:teuthology.orchestra.run.smithi016.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-11-28T17:41:48.706 INFO:teuthology.orchestra.run.smithi016.stderr:iopat.c: In function 'main': 2023-11-28T17:41:48.706 INFO:teuthology.orchestra.run.smithi016.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:48.707 INFO:teuthology.orchestra.run.smithi016.stderr: 34 | write(fd, &x, 1048576); 2023-11-28T17:41:48.707 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:48.751 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] ftrunc 2023-11-28T17:41:48.950 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] trunc 2023-11-28T17:41:49.170 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fs_perms 2023-11-28T17:41:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c: In function 'main': 2023-11-28T17:41:49.327 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: 54 | system("rm -f test.file"); 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c: In function 'testsetup': 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: 67 | system("cp testx.file test.file"); 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c: In function 'testfperm': 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: 123 | seteuid(0); 2023-11-28T17:41:49.328 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~ 2023-11-28T17:41:49.329 INFO:teuthology.orchestra.run.smithi016.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:49.329 INFO:teuthology.orchestra.run.smithi016.stderr: 124 | setegid(0); 2023-11-28T17:41:49.329 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~ 2023-11-28T17:41:49.385 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] testx 2023-11-28T17:41:49.561 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] looptest 2023-11-28T17:41:49.810 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] locktest 2023-11-28T17:41:50.179 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] unwritten_mmap 2023-11-28T17:41:50.395 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bulkstat_unlink_test 2023-11-28T17:41:50.561 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test.c: In function 'main': 2023-11-28T17:41:50.561 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:50.561 INFO:teuthology.orchestra.run.smithi016.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-11-28T17:41:50.562 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:50.562 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:50.562 INFO:teuthology.orchestra.run.smithi016.stderr: 178 | system(fname); 2023-11-28T17:41:50.562 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~ 2023-11-28T17:41:50.653 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] deduperace 2023-11-28T17:41:50.910 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bulkstat_unlink_test_modified 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.077 INFO:teuthology.orchestra.run.smithi016.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.078 INFO:teuthology.orchestra.run.smithi016.stderr: 185 | system(fname); 2023-11-28T17:41:51.078 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~ 2023-11-28T17:41:51.164 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_dir_offset 2023-11-28T17:41:51.361 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_futimens 2023-11-28T17:41:51.549 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_immutable 2023-11-28T17:41:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c: In function 'create_test_area': 2023-11-28T17:41:51.734 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.735 INFO:teuthology.orchestra.run.smithi016.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T17:41:51.735 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.735 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.735 INFO:teuthology.orchestra.run.smithi016.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T17:41:51.735 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c: In function 'remove_test_area': 2023-11-28T17:41:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.736 INFO:teuthology.orchestra.run.smithi016.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T17:41:51.736 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.736 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.736 INFO:teuthology.orchestra.run.smithi016.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-28T17:41:51.737 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.739 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c: In function 'check_test_area': 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.740 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.741 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-28T17:41:51.742 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c: In function 'test_immutable': 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr: 408 | chown(path, 0, 0); 2023-11-28T17:41:51.748 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: 553 | chown(path, 0, 0); 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.749 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-11-28T17:41:51.750 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: 653 | chown(path, 0, 0); 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: 705 | chown(path, 0, 0); 2023-11-28T17:41:51.751 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c: In function 'test_append': 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: 1051 | chown(path, 0, 0); 2023-11-28T17:41:51.752 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: 1516 | chown(path, 0, 0); 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-11-28T17:41:51.753 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.754 INFO:teuthology.orchestra.run.smithi016.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-11-28T17:41:51.755 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.755 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.755 INFO:teuthology.orchestra.run.smithi016.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-11-28T17:41:51.755 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.755 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr: 1618 | chown(path, 0, 0); 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr: 1644 | chown(path, 0, 0); 2023-11-28T17:41:51.757 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.758 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.758 INFO:teuthology.orchestra.run.smithi016.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-28T17:41:51.758 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.758 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr: 1692 | chown(path, 0, 0); 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-28T17:41:51.759 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:52.333 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] stale_handle 2023-11-28T17:41:52.499 INFO:teuthology.orchestra.run.smithi016.stderr:stale_handle.c: In function 'main': 2023-11-28T17:41:52.500 INFO:teuthology.orchestra.run.smithi016.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:52.500 INFO:teuthology.orchestra.run.smithi016.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-11-28T17:41:52.500 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:52.559 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] pwrite_mmap_blocked 2023-11-28T17:41:52.763 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_dir_offset2 2023-11-28T17:41:53.011 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] seek_sanity_test 2023-11-28T17:41:53.186 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c: In function 'test18': 2023-11-28T17:41:53.186 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.186 INFO:teuthology.orchestra.run.smithi016.stderr: 460 | ftruncate(fd, 0); 2023-11-28T17:41:53.186 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.188 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-11-28T17:41:53.188 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr: 1207 | ftruncate(fd, 0); 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr: 1256 | ftruncate(fd, 0); 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-11-28T17:41:53.189 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: 88 | ftruncate(fd, 0); 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: 98 | ftruncate(fd, 0); 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-11-28T17:41:53.190 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.529 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] seek_copy_test 2023-11-28T17:41:53.761 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_readdir_1 2023-11-28T17:41:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:t_readdir_1.c: In function 'main': 2023-11-28T17:41:53.915 INFO:teuthology.orchestra.run.smithi016.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:53.915 INFO:teuthology.orchestra.run.smithi016.stderr: 30 | read(fd, buf, 100); 2023-11-28T17:41:53.916 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:53.959 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_readdir_2 2023-11-28T17:41:54.159 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fsync-tester 2023-11-28T17:41:54.315 INFO:teuthology.orchestra.run.smithi016.stderr:fsync-tester.c: In function 'main': 2023-11-28T17:41:54.315 INFO:teuthology.orchestra.run.smithi016.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr: 541 | system("reboot -fn"); 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-11-28T17:41:54.316 INFO:teuthology.orchestra.run.smithi016.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:54.317 INFO:teuthology.orchestra.run.smithi016.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-11-28T17:41:54.317 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:54.472 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] nsexec 2023-11-28T17:41:54.706 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] cloner 2023-11-28T17:41:54.938 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] renameat2 2023-11-28T17:41:55.158 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_getcwd 2023-11-28T17:41:55.313 INFO:teuthology.orchestra.run.smithi016.stderr:t_getcwd.c: In function 'test_getcwd': 2023-11-28T17:41:55.314 INFO:teuthology.orchestra.run.smithi016.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:55.314 INFO:teuthology.orchestra.run.smithi016.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-11-28T17:41:55.314 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:55.370 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] e4compact 2023-11-28T17:41:55.630 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] test-nextquota 2023-11-28T17:41:55.858 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] punch-alternating 2023-11-28T17:41:56.086 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-28T17:41:56.307 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] listxattr 2023-11-28T17:41:56.502 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dio-interleaved 2023-11-28T17:41:56.717 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_dir_type 2023-11-28T17:41:56.923 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] dio-invalidate-cache 2023-11-28T17:41:57.079 INFO:teuthology.orchestra.run.smithi016.stderr:dio-invalidate-cache.c: In function 'main': 2023-11-28T17:41:57.080 INFO:teuthology.orchestra.run.smithi016.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:41:57.080 INFO:teuthology.orchestra.run.smithi016.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-11-28T17:41:57.080 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:41:57.183 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] stat_test 2023-11-28T17:41:57.536 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_encrypted_d_revalidate 2023-11-28T17:41:57.753 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] attr_replace_test 2023-11-28T17:41:57.972 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] swapon 2023-11-28T17:41:58.191 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mkswap 2023-11-28T17:41:58.394 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_attr_corruption 2023-11-28T17:41:58.596 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_open_tmpfiles 2023-11-28T17:41:58.830 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fscrypt-crypt-util 2023-11-28T17:41:59.569 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] bulkstat_null_ocount 2023-11-28T17:41:59.779 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] splice-test 2023-11-28T17:42:00.016 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] chprojid_fail 2023-11-28T17:42:00.236 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] detached_mounts_propagation 2023-11-28T17:42:00.477 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] ext4_resize 2023-11-28T17:42:00.679 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_readdir_3 2023-11-28T17:42:00.929 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] splice2pipe 2023-11-28T17:42:01.084 INFO:teuthology.orchestra.run.smithi016.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-11-28T17:42:01.084 INFO:teuthology.orchestra.run.smithi016.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:42:01.084 INFO:teuthology.orchestra.run.smithi016.stderr: 57 | write(p[1], buffer, n); 2023-11-28T17:42:01.084 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:42:01.084 INFO:teuthology.orchestra.run.smithi016.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:42:01.085 INFO:teuthology.orchestra.run.smithi016.stderr: 65 | read(p[0], buffer, n); 2023-11-28T17:42:01.085 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:42:01.145 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] uuid_ioctl 2023-11-28T17:42:01.353 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fiemap-tester 2023-11-28T17:42:01.675 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_stripealign 2023-11-28T17:42:01.882 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] open_by_handle 2023-11-28T17:42:02.188 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] t_mmap_dio 2023-11-28T17:42:02.404 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] uring_read_fault 2023-11-28T17:42:02.645 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] xfsfind 2023-11-28T17:42:02.898 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] fssum 2023-11-28T17:42:03.402 INFO:teuthology.orchestra.run.smithi016.stdout:Building log-writes 2023-11-28T17:42:03.411 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] replay-log 2023-11-28T17:42:03.811 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-11-28T17:42:03.818 INFO:teuthology.orchestra.run.smithi016.stdout:Building aio-dio-regress 2023-11-28T17:42:03.828 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aiocp 2023-11-28T17:42:04.121 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-28T17:42:04.351 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-append-write-read-race 2023-11-28T17:42:04.387 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:42:04.392 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:42:04.590 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-cow-race 2023-11-28T17:42:04.804 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-cycle-write 2023-11-28T17:42:04.958 INFO:teuthology.orchestra.run.smithi016.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-11-28T17:42:04.958 INFO:teuthology.orchestra.run.smithi016.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:42:04.958 INFO:teuthology.orchestra.run.smithi016.stderr: 83 | ftruncate(fd, buf_size); 2023-11-28T17:42:04.959 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:42:05.052 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-eof-race 2023-11-28T17:42:05.296 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-extend-stat 2023-11-28T17:42:05.519 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-fcntl-race 2023-11-28T17:42:05.740 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-hole-filling-race 2023-11-28T17:42:05.948 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-invalidate-failure 2023-11-28T17:42:06.165 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-invalidate-readahead 2023-11-28T17:42:06.389 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aiodio_sparse2 2023-11-28T17:42:06.543 INFO:teuthology.orchestra.run.smithi016.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-11-28T17:42:06.543 INFO:teuthology.orchestra.run.smithi016.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:42:06.544 INFO:teuthology.orchestra.run.smithi016.stderr: 111 | ftruncate(fd, filesize); 2023-11-28T17:42:06.544 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T17:42:06.544 INFO:teuthology.orchestra.run.smithi016.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-11-28T17:42:06.544 INFO:teuthology.orchestra.run.smithi016.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T17:42:06.544 INFO:teuthology.orchestra.run.smithi016.stderr: 274 | ftruncate(fd, size); 2023-11-28T17:42:06.544 INFO:teuthology.orchestra.run.smithi016.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-11-28T17:42:06.673 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-subblock-eof-read 2023-11-28T17:42:06.875 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-dio-write-verify 2023-11-28T17:42:07.132 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-28T17:42:07.321 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-28T17:42:07.510 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] aio-last-ref-held-by-io 2023-11-28T17:42:07.749 INFO:teuthology.orchestra.run.smithi016.stdout:Building vfs 2023-11-28T17:42:07.758 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] vfstest 2023-11-28T17:42:12.293 INFO:teuthology.orchestra.run.smithi016.stdout: [CC] mount-idmapped 2023-11-28T17:42:12.811 INFO:teuthology.orchestra.run.smithi016.stdout:Building m4 2023-11-28T17:42:12.817 INFO:teuthology.orchestra.run.smithi016.stdout:Building common 2023-11-28T17:42:12.824 INFO:teuthology.orchestra.run.smithi016.stdout:Building tests 2023-11-28T17:42:12.833 INFO:teuthology.orchestra.run.smithi016.stdout:Building btrfs 2023-11-28T17:42:12.843 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/btrfs/group.list 2023-11-28T17:42:12.979 INFO:teuthology.orchestra.run.smithi016.stdout:Building ceph 2023-11-28T17:42:12.988 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ceph/group.list 2023-11-28T17:42:13.021 INFO:teuthology.orchestra.run.smithi016.stdout:Building cifs 2023-11-28T17:42:13.030 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/cifs/group.list 2023-11-28T17:42:13.059 INFO:teuthology.orchestra.run.smithi016.stdout:Building ext4 2023-11-28T17:42:13.068 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ext4/group.list 2023-11-28T17:42:13.155 INFO:teuthology.orchestra.run.smithi016.stdout:Building f2fs 2023-11-28T17:42:13.164 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/f2fs/group.list 2023-11-28T17:42:13.204 INFO:teuthology.orchestra.run.smithi016.stdout:Building generic 2023-11-28T17:42:13.215 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/generic/group.list 2023-11-28T17:42:13.438 INFO:teuthology.orchestra.run.smithi016.stdout:Building nfs 2023-11-28T17:42:13.447 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/nfs/group.list 2023-11-28T17:42:13.480 INFO:teuthology.orchestra.run.smithi016.stdout:Building ocfs2 2023-11-28T17:42:13.490 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ocfs2/group.list 2023-11-28T17:42:13.521 INFO:teuthology.orchestra.run.smithi016.stdout:Building overlay 2023-11-28T17:42:13.530 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/overlay/group.list 2023-11-28T17:42:13.624 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-11-28T17:42:13.633 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/perf/group.list 2023-11-28T17:42:13.659 INFO:teuthology.orchestra.run.smithi016.stdout:Building selftest 2023-11-28T17:42:13.668 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/selftest/group.list 2023-11-28T17:42:13.697 INFO:teuthology.orchestra.run.smithi016.stdout:Building shared 2023-11-28T17:42:13.706 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/shared/group.list 2023-11-28T17:42:13.746 INFO:teuthology.orchestra.run.smithi016.stdout:Building tmpfs 2023-11-28T17:42:13.755 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/tmpfs/group.list 2023-11-28T17:42:13.786 INFO:teuthology.orchestra.run.smithi016.stdout:Building udf 2023-11-28T17:42:13.795 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/udf/group.list 2023-11-28T17:42:13.821 INFO:teuthology.orchestra.run.smithi016.stdout:Building xfs 2023-11-28T17:42:13.832 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/xfs/group.list 2023-11-28T17:42:14.057 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo make install) 2023-11-28T17:42:14.101 INFO:teuthology.orchestra.run.smithi016.stdout:Building include 2023-11-28T17:42:14.108 INFO:teuthology.orchestra.run.smithi016.stdout:Building lib 2023-11-28T17:42:14.115 INFO:teuthology.orchestra.run.smithi016.stdout:Building ltp 2023-11-28T17:42:14.122 INFO:teuthology.orchestra.run.smithi016.stdout:Building src 2023-11-28T17:42:14.178 INFO:teuthology.orchestra.run.smithi016.stdout:Building log-writes 2023-11-28T17:42:14.185 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-11-28T17:42:14.192 INFO:teuthology.orchestra.run.smithi016.stdout:Building aio-dio-regress 2023-11-28T17:42:14.199 INFO:teuthology.orchestra.run.smithi016.stdout:Building vfs 2023-11-28T17:42:14.206 INFO:teuthology.orchestra.run.smithi016.stdout:Building m4 2023-11-28T17:42:14.213 INFO:teuthology.orchestra.run.smithi016.stdout:Building common 2023-11-28T17:42:14.219 INFO:teuthology.orchestra.run.smithi016.stdout:Building tests 2023-11-28T17:42:14.228 INFO:teuthology.orchestra.run.smithi016.stdout:Building btrfs 2023-11-28T17:42:14.238 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/btrfs/group.list 2023-11-28T17:42:14.373 INFO:teuthology.orchestra.run.smithi016.stdout:Building ceph 2023-11-28T17:42:14.382 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ceph/group.list 2023-11-28T17:42:14.416 INFO:teuthology.orchestra.run.smithi016.stdout:Building cifs 2023-11-28T17:42:14.425 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/cifs/group.list 2023-11-28T17:42:14.454 INFO:teuthology.orchestra.run.smithi016.stdout:Building ext4 2023-11-28T17:42:14.463 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ext4/group.list 2023-11-28T17:42:14.550 INFO:teuthology.orchestra.run.smithi016.stdout:Building f2fs 2023-11-28T17:42:14.558 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/f2fs/group.list 2023-11-28T17:42:14.599 INFO:teuthology.orchestra.run.smithi016.stdout:Building generic 2023-11-28T17:42:14.610 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/generic/group.list 2023-11-28T17:42:14.828 INFO:teuthology.orchestra.run.smithi016.stdout:Building nfs 2023-11-28T17:42:14.837 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/nfs/group.list 2023-11-28T17:42:14.870 INFO:teuthology.orchestra.run.smithi016.stdout:Building ocfs2 2023-11-28T17:42:14.879 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ocfs2/group.list 2023-11-28T17:42:14.910 INFO:teuthology.orchestra.run.smithi016.stdout:Building overlay 2023-11-28T17:42:14.919 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/overlay/group.list 2023-11-28T17:42:15.012 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-11-28T17:42:15.021 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/perf/group.list 2023-11-28T17:42:15.047 INFO:teuthology.orchestra.run.smithi016.stdout:Building selftest 2023-11-28T17:42:15.056 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/selftest/group.list 2023-11-28T17:42:15.086 INFO:teuthology.orchestra.run.smithi016.stdout:Building shared 2023-11-28T17:42:15.094 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/shared/group.list 2023-11-28T17:42:15.134 INFO:teuthology.orchestra.run.smithi016.stdout:Building tmpfs 2023-11-28T17:42:15.144 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/tmpfs/group.list 2023-11-28T17:42:15.174 INFO:teuthology.orchestra.run.smithi016.stdout:Building udf 2023-11-28T17:42:15.183 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/udf/group.list 2023-11-28T17:42:15.210 INFO:teuthology.orchestra.run.smithi016.stdout:Building xfs 2023-11-28T17:42:15.221 INFO:teuthology.orchestra.run.smithi016.stdout: [GROUP] /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/xfs/group.list 2023-11-28T17:42:15.438 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-28T17:42:15.443 INFO:teuthology.orchestra.run.smithi016.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T17:42:15.443 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-28T17:42:15.448 INFO:teuthology.orchestra.run.smithi016.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T17:42:15.448 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-28T17:42:15.452 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-28T17:42:15.474 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-28T17:42:15.639 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-28T17:42:15.660 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-28T17:42:15.690 INFO:teuthology.orchestra.run.smithi016.stdout:Building log-writes 2023-11-28T17:42:15.697 INFO:teuthology.orchestra.run.smithi016.stdout:Building perf 2023-11-28T17:42:15.703 INFO:teuthology.orchestra.run.smithi016.stdout:Building aio-dio-regress 2023-11-28T17:42:15.710 INFO:teuthology.orchestra.run.smithi016.stdout:Building vfs 2023-11-28T17:42:15.716 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C log-writes install 2023-11-28T17:42:15.720 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-28T17:42:15.740 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-28T17:42:15.762 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C perf install 2023-11-28T17:42:15.766 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-28T17:42:15.787 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-28T17:42:15.838 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-28T17:42:15.842 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-28T17:42:15.863 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-28T17:42:15.980 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake -C vfs install 2023-11-28T17:42:15.984 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-28T17:42:16.005 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-28T17:42:16.035 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-28T17:42:16.056 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind fssum /var/lib/xfstests/src 2023-11-28T17:42:18.946 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-28T17:42:19.175 INFO:teuthology.orchestra.run.smithi016.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-28T17:42:19.223 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-28T17:42:19.228 INFO:teuthology.orchestra.run.smithi016.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T17:42:19.228 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-28T17:42:19.232 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-28T17:42:19.253 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-28T17:42:19.548 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-28T17:42:19.552 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/btrfs/ install 2023-11-28T17:42:19.557 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-28T17:42:19.578 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-28T17:42:21.392 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-28T17:42:21.413 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-11-28T17:42:23.230 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ceph/ install 2023-11-28T17:42:23.234 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-28T17:42:23.255 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-28T17:42:23.300 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-28T17:42:23.321 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-28T17:42:23.366 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/cifs/ install 2023-11-28T17:42:23.371 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-28T17:42:23.392 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-28T17:42:23.413 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-28T17:42:23.434 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-28T17:42:23.456 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ext4/ install 2023-11-28T17:42:23.460 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-28T17:42:23.481 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-28T17:42:23.899 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-28T17:42:23.921 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-28T17:42:24.358 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/f2fs/ install 2023-11-28T17:42:24.362 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-28T17:42:24.383 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-28T17:42:24.410 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-28T17:42:24.432 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-28T17:42:24.460 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/generic/ install 2023-11-28T17:42:24.467 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-28T17:42:24.488 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-28T17:42:28.854 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-28T17:42:28.875 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-28T17:42:33.280 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/nfs/ install 2023-11-28T17:42:33.284 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-28T17:42:33.305 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-28T17:42:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-28T17:42:33.348 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-28T17:42:33.369 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/ocfs2/ install 2023-11-28T17:42:33.373 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-28T17:42:33.394 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-28T17:42:33.415 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-28T17:42:33.436 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-28T17:42:33.458 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/overlay/ install 2023-11-28T17:42:33.462 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-28T17:42:33.483 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-28T17:42:34.099 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-28T17:42:34.120 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-28T17:42:34.468 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:42:34.472 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:42:34.738 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/perf/ install 2023-11-28T17:42:34.742 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-28T17:42:34.763 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-28T17:42:34.785 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-28T17:42:34.806 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-28T17:42:34.829 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/selftest/ install 2023-11-28T17:42:34.831 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-28T17:42:34.852 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-28T17:42:34.903 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-28T17:42:34.924 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-28T17:42:34.976 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/shared/ install 2023-11-28T17:42:34.980 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-28T17:42:35.001 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-28T17:42:35.034 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-28T17:42:35.056 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-28T17:42:35.089 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/tmpfs/ install 2023-11-28T17:42:35.093 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-28T17:42:35.114 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-28T17:42:35.135 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-28T17:42:35.156 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-28T17:42:35.177 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/udf/ install 2023-11-28T17:42:35.181 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-28T17:42:35.202 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-28T17:42:35.223 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-28T17:42:35.244 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-28T17:42:35.266 INFO:teuthology.orchestra.run.smithi016.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.SqFPnd7Bgcxfstests-dev/tests/xfs/ install 2023-11-28T17:42:35.273 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-28T17:42:35.294 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-28T17:42:39.427 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-28T17:42:39.448 INFO:teuthology.orchestra.run.smithi016.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-28T17:42:43.656 INFO:teuthology.orchestra.run.smithi016.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-28T17:42:43.677 INFO:teuthology.orchestra.run.smithi016.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-28T17:42:43.698 INFO:teuthology.orchestra.run.smithi016.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-28T17:42:43.719 INFO:teuthology.orchestra.run.smithi016.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-28T17:42:43.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T17:42:43.743 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec ls tests/generic) 2023-11-28T17:42:43.754 INFO:teuthology.orchestra.run.smithi016.stdout:001 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:001.out 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:002 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:002.out 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:003 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:003.out 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:004 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:004.out 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:005 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:005.out 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:006 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:006.out 2023-11-28T17:42:43.755 INFO:teuthology.orchestra.run.smithi016.stdout:007 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:007.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:008 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:008.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:009 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:009.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:010 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:010.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:011 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:011.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:012 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:012.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:013 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:013.out 2023-11-28T17:42:43.756 INFO:teuthology.orchestra.run.smithi016.stdout:014 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:014.out 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:015 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:015.out 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:016 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:016.out 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:017 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:017.out 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:018 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:018.out 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:019 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:019.out 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:020 2023-11-28T17:42:43.757 INFO:teuthology.orchestra.run.smithi016.stdout:020.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:021 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:021.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:022 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:022.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:023 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:023.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:024 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:024.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:025 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:025.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:026 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:026.out 2023-11-28T17:42:43.758 INFO:teuthology.orchestra.run.smithi016.stdout:027 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:027.out 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:028 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:028.out 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:029 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:029.out 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:030 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:030.out 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:031 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:031.out 2023-11-28T17:42:43.759 INFO:teuthology.orchestra.run.smithi016.stdout:032 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:032.out 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:033 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:033.out 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:034 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:034.out 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:035 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:035.cfg 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:035.out.default 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:035.out.nfs 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:036 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:036.out 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:037 2023-11-28T17:42:43.760 INFO:teuthology.orchestra.run.smithi016.stdout:037.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:038 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:038.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:039 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:039.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:040 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:040.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:041 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:041.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:042 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:042.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:043 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:043.out 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:044 2023-11-28T17:42:43.761 INFO:teuthology.orchestra.run.smithi016.stdout:044.out 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:045 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:045.out 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:046 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:046.out 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:047 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:047.out 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:048 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:048.out 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:049 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:049.out 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:050 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:050.cfg 2023-11-28T17:42:43.762 INFO:teuthology.orchestra.run.smithi016.stdout:050.out.default 2023-11-28T17:42:43.763 INFO:teuthology.orchestra.run.smithi016.stdout:050.out.nojournal 2023-11-28T17:42:43.763 INFO:teuthology.orchestra.run.smithi016.stdout:050.out.xfsquota 2023-11-28T17:42:43.763 INFO:teuthology.orchestra.run.smithi016.stdout:051 2023-11-28T17:42:43.763 INFO:teuthology.orchestra.run.smithi016.stdout:051.out 2023-11-28T17:42:43.763 INFO:teuthology.orchestra.run.smithi016.stdout:052 2023-11-28T17:42:43.763 INFO:teuthology.orchestra.run.smithi016.stdout:052.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:053 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:053.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:054 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:054.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:055 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:055.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:056 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:056.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:057 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:057.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:058 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:058.out 2023-11-28T17:42:43.764 INFO:teuthology.orchestra.run.smithi016.stdout:059 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:059.out 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:060 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:060.out 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:061 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:061.out 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:062 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:062.out 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:063 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:063.out 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:064 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:064.out 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:065 2023-11-28T17:42:43.765 INFO:teuthology.orchestra.run.smithi016.stdout:065.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:066 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:066.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:067 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:067.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:068 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:068.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:069 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:069.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:070 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:070.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:071 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:071.out 2023-11-28T17:42:43.766 INFO:teuthology.orchestra.run.smithi016.stdout:072 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:072.out 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:073 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:073.out 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:074 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:074.out 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:075 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:075.out 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:076 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:076.out 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:077 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:077.out 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:078 2023-11-28T17:42:43.767 INFO:teuthology.orchestra.run.smithi016.stdout:078.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:079 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:079.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:080 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:080.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:081 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:081.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:082 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:082.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:083 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:083.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:084 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:084.out 2023-11-28T17:42:43.768 INFO:teuthology.orchestra.run.smithi016.stdout:085 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:085.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:086 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:086.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:087 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:087.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:088 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:088.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:089 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:089.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:090 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:090.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:091 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:091.out 2023-11-28T17:42:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:092 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:092.out 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:093 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:093.out 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:094 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:094.out 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:095 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:095.out 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:096 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:096.out 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:097 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:097.out 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:098 2023-11-28T17:42:43.770 INFO:teuthology.orchestra.run.smithi016.stdout:098.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:099 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:099.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:100 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:100.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:101 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:101.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:102 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:102.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:103 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:103.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:104 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:104.out 2023-11-28T17:42:43.771 INFO:teuthology.orchestra.run.smithi016.stdout:105 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:105.out 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:106 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:106.out 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:107 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:107.out 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:108 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:108.out 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:109 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:109.out 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:110 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:110.out 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:111 2023-11-28T17:42:43.772 INFO:teuthology.orchestra.run.smithi016.stdout:111.out 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:112 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:112.out 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:113 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:113.out 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:114 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:114.out 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:115 2023-11-28T17:42:43.773 INFO:teuthology.orchestra.run.smithi016.stdout:115.out 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:116 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:116.out 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:117 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:117.out 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:118 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:118.out 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:119 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:119.out 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:120 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:120.out 2023-11-28T17:42:43.774 INFO:teuthology.orchestra.run.smithi016.stdout:121 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:121.out 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:122 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:122.out 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:123 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:123.out 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:124 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:124.out 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:125 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:125.out 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:126 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:126.out 2023-11-28T17:42:43.775 INFO:teuthology.orchestra.run.smithi016.stdout:127 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:127.out 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:128 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:128.out 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:129 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:129.out 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:130 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:130.out 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:131 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:131.out 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:132 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:132.out 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:133 2023-11-28T17:42:43.776 INFO:teuthology.orchestra.run.smithi016.stdout:133.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:134 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:134.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:135 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:135.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:136 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:136.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:137 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:137.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:138 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:138.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:139 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:139.out 2023-11-28T17:42:43.777 INFO:teuthology.orchestra.run.smithi016.stdout:140 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:140.out 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:141 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:141.out 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:142 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:142.out 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:143 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:143.out 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:144 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:144.out 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:145 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:145.out 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:146 2023-11-28T17:42:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:146.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:147 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:147.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:148 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:148.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:149 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:149.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:150 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:150.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:151 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:151.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:152 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:152.out 2023-11-28T17:42:43.779 INFO:teuthology.orchestra.run.smithi016.stdout:153 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:153.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:154 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:154.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:155 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:155.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:156 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:156.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:157 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:157.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:158 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:158.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:159 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:159.out 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:160 2023-11-28T17:42:43.780 INFO:teuthology.orchestra.run.smithi016.stdout:160.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:161 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:161.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:162 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:162.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:163 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:163.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:164 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:164.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:165 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:165.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:166 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:166.out 2023-11-28T17:42:43.781 INFO:teuthology.orchestra.run.smithi016.stdout:167 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:167.out 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:168 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:168.out 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:169 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:169.out 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:170 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:170.out 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:171 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:171.out 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:172 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:172.out 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:173 2023-11-28T17:42:43.782 INFO:teuthology.orchestra.run.smithi016.stdout:173.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:174 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:174.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:175 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:175.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:176 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:176.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:177 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:177.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:178 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:178.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:179 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:179.out 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:180 2023-11-28T17:42:43.783 INFO:teuthology.orchestra.run.smithi016.stdout:180.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:181 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:181.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:182 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:182.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:183 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:183.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:184 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:184.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:185 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:185.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:186 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:186.out 2023-11-28T17:42:43.784 INFO:teuthology.orchestra.run.smithi016.stdout:187 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:187.out 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:188 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:188.out 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:189 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:189.out 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:190 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:190.out 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:191 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:191.out 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:192 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:192.out 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:193 2023-11-28T17:42:43.785 INFO:teuthology.orchestra.run.smithi016.stdout:193.out 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:194 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:194.out 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:195 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:195.out 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:196 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:196.out 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:197 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:197.out 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:198 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:198.out 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:199 2023-11-28T17:42:43.786 INFO:teuthology.orchestra.run.smithi016.stdout:199.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:200 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:200.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:201 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:201.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:202 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:202.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:203 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:203.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:204 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:204.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:205 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:205.out 2023-11-28T17:42:43.787 INFO:teuthology.orchestra.run.smithi016.stdout:206 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:206.out 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:207 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:207.out 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:208 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:208.out 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:209 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:209.out 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:210 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:210.out 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:211 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:211.out 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:212 2023-11-28T17:42:43.788 INFO:teuthology.orchestra.run.smithi016.stdout:212.out 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:213 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:213.out 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:214 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:214.out 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:215 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:215.out 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:216 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:216.out 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:217 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:217.out 2023-11-28T17:42:43.789 INFO:teuthology.orchestra.run.smithi016.stdout:218 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:218.out 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:219 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:219.out 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:220 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:220.out 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:221 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:221.out 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:222 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:222.out 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:223 2023-11-28T17:42:43.790 INFO:teuthology.orchestra.run.smithi016.stdout:223.out 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:224 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:224.out 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:225 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:225.out 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:226 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:226.out 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:227 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:227.out 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:228 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:228.out 2023-11-28T17:42:43.791 INFO:teuthology.orchestra.run.smithi016.stdout:229 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:229.out 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:230 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:230.out 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:231 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:231.out 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:232 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:232.out 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:233 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:233.out 2023-11-28T17:42:43.792 INFO:teuthology.orchestra.run.smithi016.stdout:234 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:234.out 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:235 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:235.out 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:236 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:236.out 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:237 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:237.out 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:238 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:238.out 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:239 2023-11-28T17:42:43.793 INFO:teuthology.orchestra.run.smithi016.stdout:239.out 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:240 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:240.out 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:241 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:241.out 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:242 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:242.out 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:243 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:243.out 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:244 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:244.out 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:245 2023-11-28T17:42:43.794 INFO:teuthology.orchestra.run.smithi016.stdout:245.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:246 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:246.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:247 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:247.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:248 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:248.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:249 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:249.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:250 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:250.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:251 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:251.out 2023-11-28T17:42:43.795 INFO:teuthology.orchestra.run.smithi016.stdout:252 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:252.out 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:253 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:253.out 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:254 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:254.out 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:255 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:255.out 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:256 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:256.out 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:257 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:257.out 2023-11-28T17:42:43.796 INFO:teuthology.orchestra.run.smithi016.stdout:258 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:258.out 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:259 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:259.out 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:260 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:260.out 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:261 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:261.out 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:262 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:262.out 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:263 2023-11-28T17:42:43.797 INFO:teuthology.orchestra.run.smithi016.stdout:263.out 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:264 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:264.out 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:265 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:265.out 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:266 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:266.out 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:267 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:267.out 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:268 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:268.out 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:269 2023-11-28T17:42:43.798 INFO:teuthology.orchestra.run.smithi016.stdout:269.out 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:270 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:270.out 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:271 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:271.out 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:272 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:272.out 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:273 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:273.out 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:274 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:274.out 2023-11-28T17:42:43.799 INFO:teuthology.orchestra.run.smithi016.stdout:275 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:275.out 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:276 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:276.out 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:277 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:277.out 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:278 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:278.out 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:279 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:279.out 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:280 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:280.out 2023-11-28T17:42:43.800 INFO:teuthology.orchestra.run.smithi016.stdout:281 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:281.out 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:282 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:282.out 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:283 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:283.out 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:284 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:284.out 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:285 2023-11-28T17:42:43.801 INFO:teuthology.orchestra.run.smithi016.stdout:285.out 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:286 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:286.out 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:287 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:287.out 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:288 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:288.out 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:289 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:289.out 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:290 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:290.out 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:291 2023-11-28T17:42:43.802 INFO:teuthology.orchestra.run.smithi016.stdout:291.out 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:292 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:292.out 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:293 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:293.out 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:294 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:294.out 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:295 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:295.out 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:296 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:296.out 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:297 2023-11-28T17:42:43.803 INFO:teuthology.orchestra.run.smithi016.stdout:297.out 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:298 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:298.out 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:299 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:299.out 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:300 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:300.out 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:301 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:301.out 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:302 2023-11-28T17:42:43.804 INFO:teuthology.orchestra.run.smithi016.stdout:302.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:303 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:303.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:304 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:304.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:305 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:305.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:306 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:306.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:307 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:307.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:308 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:308.out 2023-11-28T17:42:43.805 INFO:teuthology.orchestra.run.smithi016.stdout:309 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:309.out 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:310 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:310.out 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:311 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:311.out 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:312 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:312.out 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:313 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:313.out 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:314 2023-11-28T17:42:43.806 INFO:teuthology.orchestra.run.smithi016.stdout:314.out 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:315 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:315.out 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:316 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:316.out 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:317 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:317.out 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:318 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:318.out 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:319 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:319.out 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:320 2023-11-28T17:42:43.807 INFO:teuthology.orchestra.run.smithi016.stdout:320.out 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:321 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:321.out 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:322 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:322.out 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:323 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:323.out 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:324 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:324.out 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:325 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:325.out 2023-11-28T17:42:43.808 INFO:teuthology.orchestra.run.smithi016.stdout:326 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:326.out 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:327 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:327.out 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:328 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:328.out 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:329 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:329.out 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:330 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:330.out 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:331 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:331.out 2023-11-28T17:42:43.809 INFO:teuthology.orchestra.run.smithi016.stdout:332 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:332.out 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:333 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:333.out 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:334 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:334.out 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:335 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:335.out 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:336 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:336.out 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:337 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:337.out 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:338 2023-11-28T17:42:43.810 INFO:teuthology.orchestra.run.smithi016.stdout:338.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:339 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:339.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:340 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:340.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:341 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:341.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:342 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:342.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:343 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:343.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:344 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:344.out 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:345 2023-11-28T17:42:43.811 INFO:teuthology.orchestra.run.smithi016.stdout:345.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:346 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:346.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:347 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:347.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:348 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:348.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:349 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:349.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:350 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:350.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:351 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:351.out 2023-11-28T17:42:43.812 INFO:teuthology.orchestra.run.smithi016.stdout:352 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:352.out 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:353 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:353.out 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:354 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:354.out 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:355 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:355.out 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:356 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:356.out 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:357 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:357.out 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:358 2023-11-28T17:42:43.813 INFO:teuthology.orchestra.run.smithi016.stdout:358.out 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:359 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:359.out 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:360 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:360.out 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:361 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:361.out 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:362 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:362.out 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:363 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:363.out 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:364 2023-11-28T17:42:43.814 INFO:teuthology.orchestra.run.smithi016.stdout:364.out 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:365 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:365.out 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:366 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:366.out 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:367 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:367.out 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:368 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:368.out 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:369 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:369.out 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:370 2023-11-28T17:42:43.815 INFO:teuthology.orchestra.run.smithi016.stdout:370.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:371 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:371.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:372 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:372.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:373 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:373.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:374 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:374.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:375 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:375.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:376 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:376.out 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:377 2023-11-28T17:42:43.816 INFO:teuthology.orchestra.run.smithi016.stdout:377.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:378 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:378.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:379 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:379.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:380 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:380.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:381 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:381.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:382 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:382.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:383 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:383.out 2023-11-28T17:42:43.817 INFO:teuthology.orchestra.run.smithi016.stdout:384 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:384.out 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:385 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:385.out 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:386 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:386.out 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:387 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:387.out 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:388 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:388.out 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:389 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:389.out 2023-11-28T17:42:43.818 INFO:teuthology.orchestra.run.smithi016.stdout:390 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:390.out 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:391 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:391.out 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:392 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:392.out 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:393 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:393.out 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:394 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:394.out 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:395 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:395.out 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:396 2023-11-28T17:42:43.819 INFO:teuthology.orchestra.run.smithi016.stdout:396.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:397 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:397.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:398 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:398.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:399 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:399.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:400 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:400.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:401 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:401.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:402 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:402.out 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:403 2023-11-28T17:42:43.820 INFO:teuthology.orchestra.run.smithi016.stdout:403.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:404 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:404.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:405 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:405.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:406 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:406.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:407 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:407.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:408 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:408.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:409 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:409.out 2023-11-28T17:42:43.821 INFO:teuthology.orchestra.run.smithi016.stdout:410 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:410.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:411 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:411.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:412 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:412.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:413 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:413.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:414 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:414.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:415 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:415.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:416 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:416.out 2023-11-28T17:42:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:417 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:417.out 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:418 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:418.out 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:419 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:419.out 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:420 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:420.out 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:421 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:421.out 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:422 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:422.out 2023-11-28T17:42:43.823 INFO:teuthology.orchestra.run.smithi016.stdout:423 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:423.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:424 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:424.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:425 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:425.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:426 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:426.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:427 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:427.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:428 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:428.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:429 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:429.out 2023-11-28T17:42:43.824 INFO:teuthology.orchestra.run.smithi016.stdout:430 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:430.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:431 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:431.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:432 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:432.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:433 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:433.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:434 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:434.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:435 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:435.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:436 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:436.out 2023-11-28T17:42:43.825 INFO:teuthology.orchestra.run.smithi016.stdout:437 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:437.out 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:438 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:438.out 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:439 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:439.out 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:440 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:440.out 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:441 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:441.out 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:442 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:442.out 2023-11-28T17:42:43.826 INFO:teuthology.orchestra.run.smithi016.stdout:443 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:443.out 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:444 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:444.out 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:445 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:445.out 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:446 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:446.out 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:447 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:447.out 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:448 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:448.out 2023-11-28T17:42:43.827 INFO:teuthology.orchestra.run.smithi016.stdout:449 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:449.out 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:450 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:450.out 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:451 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:451.out 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:452 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:452.out 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:453 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:453.out 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:454 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:454.out 2023-11-28T17:42:43.828 INFO:teuthology.orchestra.run.smithi016.stdout:455 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:455.out 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:456 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:456.out 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:457 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:457.out 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:458 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:458.out 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:459 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:459.out 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:460 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:460.out 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:461 2023-11-28T17:42:43.829 INFO:teuthology.orchestra.run.smithi016.stdout:461.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:462 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:462.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:463 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:463.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:464 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:464.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:465 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:465.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:466 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:466.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:467 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:467.out 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:468 2023-11-28T17:42:43.830 INFO:teuthology.orchestra.run.smithi016.stdout:468.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:469 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:469.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:470 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:470.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:471 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:471.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:472 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:472.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:473 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:473.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:474 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:474.out 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:475 2023-11-28T17:42:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:475.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:476 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:476.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:477 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:477.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:478 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:478.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:479 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:479.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:480 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:480.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:481 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:481.out 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:482 2023-11-28T17:42:43.832 INFO:teuthology.orchestra.run.smithi016.stdout:482.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:483 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:483.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:484 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:484.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:485 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:485.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:486 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:486.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:487 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:487.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:488 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:488.out 2023-11-28T17:42:43.833 INFO:teuthology.orchestra.run.smithi016.stdout:489 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:489.out 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:490 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:490.out 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:491 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:491.out 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:492 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:492.out 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:493 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:493.out 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:494 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:494.out 2023-11-28T17:42:43.834 INFO:teuthology.orchestra.run.smithi016.stdout:495 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:495.out 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:496 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:496.out 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:497 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:497.out 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:498 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:498.out 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:499 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:499.out 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:500 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:500.out 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:501 2023-11-28T17:42:43.835 INFO:teuthology.orchestra.run.smithi016.stdout:501.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:502 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:502.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:503 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:503.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:504 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:504.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:505 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:505.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:506 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:506.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:507 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:507.out 2023-11-28T17:42:43.836 INFO:teuthology.orchestra.run.smithi016.stdout:508 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:508.out 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:509 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:509.out 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:510 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:510.out 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:511 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:511.out 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:512 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:512.out 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:513 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:513.out 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:514 2023-11-28T17:42:43.837 INFO:teuthology.orchestra.run.smithi016.stdout:514.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:515 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:515.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:516 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:516.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:517 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:517.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:518 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:518.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:519 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:519.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:520 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:520.out 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:521 2023-11-28T17:42:43.838 INFO:teuthology.orchestra.run.smithi016.stdout:521.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:522 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:522.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:523 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:523.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:524 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:524.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:525 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:525.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:526 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:526.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:527 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:527.out 2023-11-28T17:42:43.839 INFO:teuthology.orchestra.run.smithi016.stdout:528 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:528.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:529 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:529.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:530 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:530.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:531 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:531.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:532 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:532.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:533 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:533.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:534 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:534.out 2023-11-28T17:42:43.840 INFO:teuthology.orchestra.run.smithi016.stdout:535 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:535.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:536 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:536.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:537 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:537.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:538 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:538.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:539 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:539.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:540 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:540.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:541 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:541.out 2023-11-28T17:42:43.841 INFO:teuthology.orchestra.run.smithi016.stdout:542 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:542.out 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:543 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:543.out 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:544 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:544.out 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:545 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:545.out 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:546 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:546.out 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:547 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:547.out 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:548 2023-11-28T17:42:43.842 INFO:teuthology.orchestra.run.smithi016.stdout:548.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:549 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:549.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:550 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:550.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:551 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:551.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:552 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:552.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:553 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:553.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:554 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:554.out 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:555 2023-11-28T17:42:43.843 INFO:teuthology.orchestra.run.smithi016.stdout:555.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:556 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:556.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:557 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:557.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:558 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:558.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:559 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:559.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:560 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:560.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:561 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:561.out 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:562 2023-11-28T17:42:43.844 INFO:teuthology.orchestra.run.smithi016.stdout:562.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:563 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:563.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:564 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:564.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:565 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:565.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:566 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:566.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:567 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:567.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:568 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:568.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:569 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:569.out 2023-11-28T17:42:43.845 INFO:teuthology.orchestra.run.smithi016.stdout:570 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:570.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:571 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:571.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:572 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:572.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:573 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:573.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:574 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:574.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:575 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:575.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:576 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:576.out 2023-11-28T17:42:43.846 INFO:teuthology.orchestra.run.smithi016.stdout:577 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:577.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:578 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:578.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:579 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:579.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:580 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:580.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:581 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:581.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:582 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:582.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:583 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:583.out 2023-11-28T17:42:43.847 INFO:teuthology.orchestra.run.smithi016.stdout:584 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:584.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:585 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:585.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:586 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:586.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:587 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:587.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:588 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:588.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:589 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:589.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:590 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:590.out 2023-11-28T17:42:43.848 INFO:teuthology.orchestra.run.smithi016.stdout:591 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:591.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:592 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:592.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:593 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:593.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:594 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:594.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:595 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:595.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:596 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:596.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:597 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:597.out 2023-11-28T17:42:43.849 INFO:teuthology.orchestra.run.smithi016.stdout:598 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:598.out 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:599 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:599.out 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:600 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:600.out 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:601 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:601.out 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:602 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:602.out 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:603 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:603.out 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:604 2023-11-28T17:42:43.850 INFO:teuthology.orchestra.run.smithi016.stdout:604.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:605 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:605.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:606 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:606.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:607 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:607.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:608 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:608.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:609 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:609.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:610 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:610.out 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:611 2023-11-28T17:42:43.851 INFO:teuthology.orchestra.run.smithi016.stdout:611.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:612 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:612.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:613 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:613.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:614 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:614.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:615 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:615.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:616 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:616.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:617 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:617.out 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:618 2023-11-28T17:42:43.852 INFO:teuthology.orchestra.run.smithi016.stdout:618.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:619 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:619.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:620 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:620.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:621 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:621.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:622 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:622.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:623 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:623.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:624 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:624.out 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:625 2023-11-28T17:42:43.853 INFO:teuthology.orchestra.run.smithi016.stdout:625.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:626 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:626.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:627 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:627.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:628 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:628.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:629 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:629.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:630 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:630.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:631 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:631.out 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:632 2023-11-28T17:42:43.854 INFO:teuthology.orchestra.run.smithi016.stdout:632.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:633 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:633.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:634 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:634.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:635 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:635.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:636 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:636.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:637 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:637.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:638 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:638.out 2023-11-28T17:42:43.855 INFO:teuthology.orchestra.run.smithi016.stdout:639 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:639.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:640 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:640.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:641 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:641.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:642 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:642.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:643 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:643.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:644 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:644.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:645 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:645.out 2023-11-28T17:42:43.856 INFO:teuthology.orchestra.run.smithi016.stdout:646 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:646.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:647 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:647.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:648 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:648.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:649 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:649.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:650 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:650.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:651 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:651.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:652 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:652.out 2023-11-28T17:42:43.857 INFO:teuthology.orchestra.run.smithi016.stdout:653 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:653.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:654 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:654.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:655 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:655.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:656 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:656.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:657 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:657.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:658 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:658.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:659 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:659.out 2023-11-28T17:42:43.858 INFO:teuthology.orchestra.run.smithi016.stdout:660 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:660.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:661 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:661.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:662 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:662.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:663 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:663.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:664 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:664.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:665 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:665.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:666 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:666.out 2023-11-28T17:42:43.859 INFO:teuthology.orchestra.run.smithi016.stdout:667 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:667.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:668 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:668.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:669 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:669.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:670 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:670.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:671 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:671.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:672 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:672.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:673 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:673.out 2023-11-28T17:42:43.860 INFO:teuthology.orchestra.run.smithi016.stdout:674 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:674.out 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:675 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:675.out 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:676 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:676.out 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:677 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:677.out 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:678 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:678.out 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:679 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:679.out 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:680 2023-11-28T17:42:43.861 INFO:teuthology.orchestra.run.smithi016.stdout:680.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:681 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:681.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:682 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:682.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:683 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:683.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:684 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:684.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:685 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:685.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:686 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:686.out 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:687 2023-11-28T17:42:43.862 INFO:teuthology.orchestra.run.smithi016.stdout:687.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:688 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:688.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:689 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:689.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:690 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:690.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:691 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:691.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:692 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:692.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:693 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:693.out 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:694 2023-11-28T17:42:43.863 INFO:teuthology.orchestra.run.smithi016.stdout:694.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:695 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:695.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:696 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:696.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:697 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:697.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:698 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:698.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:699 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:699.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:700 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:700.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:701 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:701.out 2023-11-28T17:42:43.864 INFO:teuthology.orchestra.run.smithi016.stdout:702 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:702.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:703 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:703.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:704 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:704.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:705 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:705.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:706 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:706.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:707 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:707.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:708 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:708.out 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:709 2023-11-28T17:42:43.865 INFO:teuthology.orchestra.run.smithi016.stdout:709.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:710 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:710.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:711 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:711.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:712 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:712.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:713 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:713.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:714 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:714.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:715 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:715.out 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:716 2023-11-28T17:42:43.866 INFO:teuthology.orchestra.run.smithi016.stdout:716.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:717 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:717.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:718 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:718.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:719 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:719.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:720 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:720.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:721 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:721.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:722 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:722.out 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:723 2023-11-28T17:42:43.867 INFO:teuthology.orchestra.run.smithi016.stdout:723.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:724 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:724.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:725 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:725.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:726 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:726.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:727 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:727.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:728 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:728.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:729 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:729.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:730 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:730.out 2023-11-28T17:42:43.868 INFO:teuthology.orchestra.run.smithi016.stdout:731 2023-11-28T17:42:43.869 INFO:teuthology.orchestra.run.smithi016.stdout:731.out 2023-11-28T17:42:43.869 INFO:teuthology.orchestra.run.smithi016.stdout:732 2023-11-28T17:42:43.869 INFO:teuthology.orchestra.run.smithi016.stdout:732.out 2023-11-28T17:42:43.869 INFO:teuthology.orchestra.run.smithi016.stdout:group.list 2023-11-28T17:42:43.869 INFO:teuthology.orchestra.run.smithi016.stdout:Makefile 2023-11-28T17:42:43.870 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-11-28T17:42:44.323 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:42:44.334 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:42:44.335 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:42:44.338 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:42:44.338 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:42:57.764 INFO:teuthology.orchestra.run.smithi016.stdout:generic/001 13s 2023-11-28T17:42:57.777 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/001 2023-11-28T17:42:57.777 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:42:57.783 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:42:58.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:42:58.126 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-11-28T17:42:58.505 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:42:58.516 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:42:58.517 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:42:58.519 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:42:58.520 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:42:59.517 INFO:teuthology.orchestra.run.smithi016.stdout:generic/002 1s 2023-11-28T17:42:59.530 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/002 2023-11-28T17:42:59.530 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:42:59.536 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:42:59.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:42:59.605 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-11-28T17:42:59.968 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:42:59.978 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:42:59.980 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:42:59.982 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:42:59.982 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:00.407 INFO:teuthology.orchestra.run.smithi016.stdout:generic/003 [not run] atime not maintained by ceph 2023-11-28T17:43:00.417 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/003 2023-11-28T17:43:00.417 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/003 2023-11-28T17:43:00.417 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:43:00.423 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:00.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:43:00.447 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-11-28T17:43:00.825 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:43:00.836 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:43:00.837 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:43:00.840 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:43:00.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:01.259 INFO:teuthology.orchestra.run.smithi016.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-28T17:43:01.268 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/004 2023-11-28T17:43:01.269 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/004 2023-11-28T17:43:01.269 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:43:01.275 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:01.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:43:01.298 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-11-28T17:43:01.678 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:43:01.688 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:43:01.689 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:43:01.692 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:43:01.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:02.989 INFO:teuthology.orchestra.run.smithi016.stdout:generic/005 1s 2023-11-28T17:43:03.002 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/005 2023-11-28T17:43:03.002 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:43:03.008 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:03.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:43:03.074 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-11-28T17:43:03.474 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:43:03.484 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:43:03.485 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:43:03.488 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:43:03.488 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:43:04.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:43:04.531 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:43:34.601 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:43:34.605 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:44:04.654 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:44:04.658 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:44:04.990 INFO:teuthology.orchestra.run.smithi016.stdout:generic/006 61s 2023-11-28T17:44:05.003 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/006 2023-11-28T17:44:05.004 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:44:05.010 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:44:05.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:44:05.107 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-11-28T17:44:05.514 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:44:05.526 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:44:05.526 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:44:05.528 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:44:05.529 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:44:34.707 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:44:34.712 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:45:05.576 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:45:05.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:45:35.632 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:45:35.636 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:46:05.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:46:05.687 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:46:35.743 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:46:35.750 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:46:41.791 INFO:teuthology.orchestra.run.smithi016.stdout:generic/007 156s 2023-11-28T17:46:41.804 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/007 2023-11-28T17:46:41.804 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:46:41.811 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:41.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:46:41.893 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-11-28T17:46:42.280 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:46:42.291 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:46:42.292 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:46:42.295 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:46:42.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:42.826 INFO:teuthology.orchestra.run.smithi016.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T17:46:42.835 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/008 2023-11-28T17:46:42.835 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/008 2023-11-28T17:46:42.835 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:46:42.842 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:42.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:46:42.872 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-11-28T17:46:43.276 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:46:43.286 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:46:43.287 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:46:43.290 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:46:43.290 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:43.822 INFO:teuthology.orchestra.run.smithi016.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T17:46:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/009 2023-11-28T17:46:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/009 2023-11-28T17:46:43.831 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:46:43.838 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:43.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:46:43.868 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-11-28T17:46:44.269 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:46:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:46:44.281 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:46:44.283 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:46:44.284 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:44.691 INFO:teuthology.orchestra.run.smithi016.stdout:generic/010 [not run] /tmp/tmp.SqFPnd7Bgcxfstests-dev/src/dbtest not built 2023-11-28T17:46:44.700 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/010 2023-11-28T17:46:44.700 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/010 2023-11-28T17:46:44.700 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:46:44.706 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:46:44.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:46:44.731 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-11-28T17:46:45.108 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:46:45.119 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:46:45.120 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:46:45.122 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:46:45.123 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:47:05.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:47:05.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:47:35.884 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:47:35.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:47:36.718 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T17:47:36.713+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43991) UID: 0 2023-11-28T17:47:36.718 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T17:47:36.713+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43991) UID: 0 2023-11-28T17:47:43.591 INFO:teuthology.orchestra.run.smithi016.stdout:generic/011 58s 2023-11-28T17:47:43.605 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/011 2023-11-28T17:47:43.605 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:47:43.610 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:47:43.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:47:43.700 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-11-28T17:47:44.116 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:47:44.126 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:47:44.128 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:47:44.130 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:47:44.130 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:47:44.721 INFO:teuthology.orchestra.run.smithi016.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:47:44.731 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/012 2023-11-28T17:47:44.731 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/012 2023-11-28T17:47:44.731 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:47:44.737 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:47:44.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:47:44.816 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-11-28T17:47:45.212 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:47:45.222 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:47:45.224 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:47:45.226 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:47:45.226 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:49:12.187 INFO:teuthology.orchestra.run.smithi016.stdout:generic/013 87s 2023-11-28T17:49:12.208 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/013 2023-11-28T17:49:12.208 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:49:12.220 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:49:12.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:49:12.274 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-11-28T17:49:12.860 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:49:12.878 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:49:12.879 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:49:12.882 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:49:12.882 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:51:19.784 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:51:19.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:51:49.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:51:49.859 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:52:19.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:52:19.922 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:52:50.006 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:52:50.011 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:53:20.103 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:53:20.107 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:53:51.095 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:53:51.105 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:54:21.175 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:54:21.180 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:54:24.044 INFO:teuthology.orchestra.run.smithi016.stdout:generic/014 311s 2023-11-28T17:54:24.066 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/014 2023-11-28T17:54:24.066 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:24.076 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:24.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:24.128 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-11-28T17:54:24.679 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:24.695 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:24.697 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:24.702 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:24.702 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:25.346 INFO:teuthology.orchestra.run.smithi016.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T17:54:25.359 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/015 2023-11-28T17:54:25.360 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/015 2023-11-28T17:54:25.360 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:25.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:25.406 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-11-28T17:54:25.987 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:26.003 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:26.004 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:26.008 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:26.008 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:26.880 INFO:teuthology.orchestra.run.smithi016.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:54:26.893 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/016 2023-11-28T17:54:26.893 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/016 2023-11-28T17:54:26.893 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:26.902 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:27.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:27.094 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-11-28T17:54:27.781 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:27.796 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:27.797 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:27.800 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:27.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:28.483 INFO:teuthology.orchestra.run.smithi016.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T17:54:28.501 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/017 2023-11-28T17:54:28.501 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/017 2023-11-28T17:54:28.501 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:28.507 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:28.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:28.548 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-11-28T17:54:29.099 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:29.112 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:29.114 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:29.117 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:29.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:29.881 INFO:teuthology.orchestra.run.smithi016.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-11-28T17:54:29.903 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/018 2023-11-28T17:54:29.904 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/018 2023-11-28T17:54:29.904 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:29.912 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:29.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:29.950 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-11-28T17:54:30.528 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:30.543 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:30.545 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:30.548 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:30.548 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:31.175 INFO:teuthology.orchestra.run.smithi016.stdout:generic/019 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:54:31.190 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/019 2023-11-28T17:54:31.190 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/019 2023-11-28T17:54:31.190 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:31.199 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:31.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:31.238 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-11-28T17:54:31.790 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:31.806 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:31.813 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:31.813 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:40.417 INFO:teuthology.orchestra.run.smithi016.stdout:generic/020 8s 2023-11-28T17:54:40.441 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/020 2023-11-28T17:54:40.441 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:40.450 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:40.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:40.650 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-11-28T17:54:41.311 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:41.326 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:41.328 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:41.332 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:41.332 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:42.236 INFO:teuthology.orchestra.run.smithi016.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:54:42.249 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/021 2023-11-28T17:54:42.249 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/021 2023-11-28T17:54:42.249 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:42.259 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:42.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:42.404 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-11-28T17:54:43.102 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:43.119 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:43.120 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:43.123 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:43.123 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:44.045 INFO:teuthology.orchestra.run.smithi016.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:54:44.060 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/022 2023-11-28T17:54:44.060 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/022 2023-11-28T17:54:44.060 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:44.071 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:44.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:44.181 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-11-28T17:54:44.925 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:44.944 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:44.944 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:44.948 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:44.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:48.426 INFO:teuthology.orchestra.run.smithi016.stdout:generic/023 3s 2023-11-28T17:54:48.444 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/023 2023-11-28T17:54:48.444 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:48.455 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:48.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:48.752 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-11-28T17:54:49.443 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:49.461 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:49.463 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:49.471 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:49.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:50.172 INFO:teuthology.orchestra.run.smithi016.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-28T17:54:50.185 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/024 2023-11-28T17:54:50.185 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/024 2023-11-28T17:54:50.185 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:50.194 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:50.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:50.360 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-11-28T17:54:51.041 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:51.055 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:51.058 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:51.062 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:51.062 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:51.257 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:54:51.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:54:51.767 INFO:teuthology.orchestra.run.smithi016.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-28T17:54:51.780 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/025 2023-11-28T17:54:51.781 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/025 2023-11-28T17:54:51.781 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:51.789 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:51.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:51.955 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-11-28T17:54:52.663 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:52.680 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:52.681 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:52.686 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:52.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:53.430 INFO:teuthology.orchestra.run.smithi016.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-11-28T17:54:53.443 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/026 2023-11-28T17:54:53.444 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/026 2023-11-28T17:54:53.444 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:53.452 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:53.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:53.509 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-11-28T17:54:54.078 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:54.096 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:54.098 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:54.102 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:54.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:54.706 INFO:teuthology.orchestra.run.smithi016.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T17:54:54.720 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/027 2023-11-28T17:54:54.720 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/027 2023-11-28T17:54:54.720 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:54:54.729 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:54:54.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:54:54.773 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-11-28T17:54:55.314 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:54:55.329 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:54:55.331 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:54:55.335 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:54:55.335 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:01.005 INFO:teuthology.orchestra.run.smithi016.stdout:generic/028 5s 2023-11-28T17:55:01.028 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/028 2023-11-28T17:55:01.029 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:01.038 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:01.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:01.080 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-11-28T17:55:01.662 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:01.677 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:01.679 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:01.682 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:01.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:06.045 INFO:teuthology.orchestra.run.smithi016.stdout:generic/029 5s 2023-11-28T17:55:06.059 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/029 2023-11-28T17:55:06.059 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:06.065 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:06.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:06.084 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-11-28T17:55:06.471 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:06.481 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:06.482 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:06.485 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:06.485 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:08.080 INFO:teuthology.orchestra.run.smithi016.stdout:generic/030 2s 2023-11-28T17:55:08.093 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/030 2023-11-28T17:55:08.093 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:08.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:08.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:08.119 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-11-28T17:55:08.500 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:08.510 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:08.513 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:08.514 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:08.514 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-28T17:55:09.063 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/031 2023-11-28T17:55:09.063 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/031 2023-11-28T17:55:09.063 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:09.070 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:09.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:09.102 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-11-28T17:55:09.479 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:09.489 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:09.491 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:09.494 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:09.494 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:09.937 INFO:teuthology.orchestra.run.smithi016.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:55:09.946 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/032 2023-11-28T17:55:09.946 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/032 2023-11-28T17:55:09.946 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:09.952 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:09.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:09.982 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-11-28T17:55:10.348 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:10.359 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:10.361 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:10.361 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:10.361 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:10.922 INFO:teuthology.orchestra.run.smithi016.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T17:55:10.931 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/033 2023-11-28T17:55:10.931 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/033 2023-11-28T17:55:10.931 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:10.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:10.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:10.971 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-11-28T17:55:11.346 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:11.357 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:11.358 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:11.360 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:11.361 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:11.802 INFO:teuthology.orchestra.run.smithi016.stdout:generic/034 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:11.811 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/034 2023-11-28T17:55:11.811 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/034 2023-11-28T17:55:11.811 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:11.817 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:11.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:11.847 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-11-28T17:55:12.251 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:12.261 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:12.262 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:12.264 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:12.264 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:12.791 INFO:teuthology.orchestra.run.smithi016.stdout:generic/035 0s 2023-11-28T17:55:12.804 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/035 2023-11-28T17:55:12.804 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:12.810 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:13.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:13.009 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-11-28T17:55:13.502 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:13.513 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:13.514 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:13.517 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:13.517 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:21.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:55:21.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:55:24.170 INFO:teuthology.orchestra.run.smithi016.stdout:generic/036 11s 2023-11-28T17:55:24.182 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/036 2023-11-28T17:55:24.183 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:24.189 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:24.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:24.431 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-11-28T17:55:24.931 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:24.942 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:24.943 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:24.945 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:24.946 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:32.205 INFO:teuthology.orchestra.run.smithi016.stdout:generic/037 7s 2023-11-28T17:55:32.218 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/037 2023-11-28T17:55:32.218 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:32.224 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:32.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:32.244 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-11-28T17:55:32.618 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:32.629 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:32.630 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:32.633 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:32.633 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:33.076 INFO:teuthology.orchestra.run.smithi016.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:55:33.085 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/038 2023-11-28T17:55:33.085 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/038 2023-11-28T17:55:33.085 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:33.091 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:33.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:33.120 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-11-28T17:55:33.486 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:33.497 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:33.498 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:33.500 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:33.500 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:33.961 INFO:teuthology.orchestra.run.smithi016.stdout:generic/039 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:33.969 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/039 2023-11-28T17:55:33.969 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/039 2023-11-28T17:55:33.969 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:33.975 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:34.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:34.000 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-11-28T17:55:34.383 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:34.393 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:34.394 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:34.397 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:34.397 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:34.859 INFO:teuthology.orchestra.run.smithi016.stdout:generic/040 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:34.868 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/040 2023-11-28T17:55:34.869 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/040 2023-11-28T17:55:34.869 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:34.874 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:34.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:34.900 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-11-28T17:55:35.283 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:35.293 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:35.294 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:35.297 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:35.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:35.755 INFO:teuthology.orchestra.run.smithi016.stdout:generic/041 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:35.764 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/041 2023-11-28T17:55:35.764 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/041 2023-11-28T17:55:35.764 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:35.771 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:35.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:35.795 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-11-28T17:55:36.179 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:36.190 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:36.191 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:36.194 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:36.194 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:36.727 INFO:teuthology.orchestra.run.smithi016.stdout:generic/042 [not run] ceph does not support shutdown 2023-11-28T17:55:36.744 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/042 2023-11-28T17:55:36.744 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/042 2023-11-28T17:55:36.744 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:36.750 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:36.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:36.774 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-11-28T17:55:37.150 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:37.161 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:37.162 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:37.164 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:37.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:37.694 INFO:teuthology.orchestra.run.smithi016.stdout:generic/043 [not run] ceph does not support shutdown 2023-11-28T17:55:37.709 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/043 2023-11-28T17:55:37.709 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/043 2023-11-28T17:55:37.709 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:37.715 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:37.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:37.739 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-11-28T17:55:38.114 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:38.125 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:38.125 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:38.128 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:38.128 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:38.652 INFO:teuthology.orchestra.run.smithi016.stdout:generic/044 [not run] ceph does not support shutdown 2023-11-28T17:55:38.665 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/044 2023-11-28T17:55:38.665 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/044 2023-11-28T17:55:38.665 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:38.671 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:38.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:38.695 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-11-28T17:55:39.071 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:39.081 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:39.083 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:39.085 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:39.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:39.606 INFO:teuthology.orchestra.run.smithi016.stdout:generic/045 [not run] ceph does not support shutdown 2023-11-28T17:55:39.620 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/045 2023-11-28T17:55:39.620 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/045 2023-11-28T17:55:39.620 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:39.626 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:39.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:39.649 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-11-28T17:55:40.023 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:40.034 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:40.035 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:40.038 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:40.038 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:40.595 INFO:teuthology.orchestra.run.smithi016.stdout:generic/046 [not run] ceph does not support shutdown 2023-11-28T17:55:40.609 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/046 2023-11-28T17:55:40.610 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/046 2023-11-28T17:55:40.610 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:40.616 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:40.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:40.640 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-11-28T17:55:41.039 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:41.050 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:41.051 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:41.054 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:41.054 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:41.598 INFO:teuthology.orchestra.run.smithi016.stdout:generic/047 [not run] ceph does not support shutdown 2023-11-28T17:55:41.612 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/047 2023-11-28T17:55:41.612 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/047 2023-11-28T17:55:41.612 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:41.618 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:41.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:41.641 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-11-28T17:55:42.022 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:42.033 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:42.034 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:42.037 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:42.037 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:42.595 INFO:teuthology.orchestra.run.smithi016.stdout:generic/048 [not run] ceph does not support shutdown 2023-11-28T17:55:42.608 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/048 2023-11-28T17:55:42.609 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/048 2023-11-28T17:55:42.609 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:42.615 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:42.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:42.639 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-11-28T17:55:43.023 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:43.033 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:43.034 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:43.037 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:43.038 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:43.599 INFO:teuthology.orchestra.run.smithi016.stdout:generic/049 [not run] ceph does not support shutdown 2023-11-28T17:55:43.612 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/049 2023-11-28T17:55:43.612 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/049 2023-11-28T17:55:43.612 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:43.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:43.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:43.697 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-11-28T17:55:44.094 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:44.105 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:44.106 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:44.112 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:44.112 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:generic/050 [not run] ceph does not support shutdown 2023-11-28T17:55:44.643 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/050 2023-11-28T17:55:44.643 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/050 2023-11-28T17:55:44.643 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:44.649 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:44.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:44.732 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-11-28T17:55:45.122 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:45.133 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:45.134 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:45.137 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:45.675 INFO:teuthology.orchestra.run.smithi016.stdout:generic/051 [not run] ceph does not support shutdown 2023-11-28T17:55:45.684 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/051 2023-11-28T17:55:45.684 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/051 2023-11-28T17:55:45.684 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:45.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:45.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:45.714 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-11-28T17:55:46.103 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:46.114 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:46.115 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:46.118 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:46.118 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:46.678 INFO:teuthology.orchestra.run.smithi016.stdout:generic/052 [not run] ceph does not support shutdown 2023-11-28T17:55:46.692 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/052 2023-11-28T17:55:46.692 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/052 2023-11-28T17:55:46.692 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:46.699 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:46.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:46.722 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-11-28T17:55:47.087 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:47.097 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:47.098 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:47.101 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:47.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:48.247 INFO:teuthology.orchestra.run.smithi016.stdout:generic/053 1s 2023-11-28T17:55:48.283 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/053 2023-11-28T17:55:48.284 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:48.294 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:48.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:48.333 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-11-28T17:55:48.738 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:48.750 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:48.751 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:48.753 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:48.753 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:49.321 INFO:teuthology.orchestra.run.smithi016.stdout:generic/054 [not run] ceph does not support shutdown 2023-11-28T17:55:49.335 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/054 2023-11-28T17:55:49.335 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/054 2023-11-28T17:55:49.335 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:49.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:49.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:49.365 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-11-28T17:55:49.760 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:49.771 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:49.772 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:49.775 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:49.775 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:50.322 INFO:teuthology.orchestra.run.smithi016.stdout:generic/055 [not run] ceph does not support shutdown 2023-11-28T17:55:50.334 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/055 2023-11-28T17:55:50.334 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/055 2023-11-28T17:55:50.335 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:50.341 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:50.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:50.364 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-11-28T17:55:50.746 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:50.757 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:50.758 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:50.760 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:50.760 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:51.280 INFO:teuthology.orchestra.run.smithi016.stdout:generic/056 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/056 2023-11-28T17:55:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/056 2023-11-28T17:55:51.289 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:51.295 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:51.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:51.321 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-11-28T17:55:51.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:55:51.382 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:55:51.706 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:51.717 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:51.718 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:51.720 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:51.720 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:52.204 INFO:teuthology.orchestra.run.smithi016.stdout:generic/057 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:52.213 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/057 2023-11-28T17:55:52.213 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/057 2023-11-28T17:55:52.213 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:52.219 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:52.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:52.245 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-11-28T17:55:52.623 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:52.634 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:52.635 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:52.637 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:52.637 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:53.224 INFO:teuthology.orchestra.run.smithi016.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:55:53.233 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/058 2023-11-28T17:55:53.233 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/058 2023-11-28T17:55:53.233 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:53.240 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:53.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:53.396 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-11-28T17:55:53.954 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:53.965 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:53.966 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:53.969 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:53.969 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:54.400 INFO:teuthology.orchestra.run.smithi016.stdout:generic/059 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:55:54.409 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/059 2023-11-28T17:55:54.409 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/059 2023-11-28T17:55:54.409 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:54.415 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:54.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:54.440 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-11-28T17:55:54.835 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:54.845 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:54.846 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:54.849 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:54.849 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:55.421 INFO:teuthology.orchestra.run.smithi016.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:55:55.430 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/060 2023-11-28T17:55:55.430 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/060 2023-11-28T17:55:55.430 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:55.436 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:55.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:55.597 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-11-28T17:55:56.151 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:56.162 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:56.163 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:56.166 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:56.166 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:56.737 INFO:teuthology.orchestra.run.smithi016.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:55:56.746 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/061 2023-11-28T17:55:56.746 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/061 2023-11-28T17:55:56.746 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:55:56.753 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:55:56.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:55:56.873 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-11-28T17:55:57.476 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:55:57.487 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:55:57.488 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:55:57.490 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:55:57.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:00.160 INFO:teuthology.orchestra.run.smithi016.stdout:generic/062 3s 2023-11-28T17:56:00.230 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/062 2023-11-28T17:56:00.231 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:00.245 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:00.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:00.293 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-11-28T17:56:00.679 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:00.690 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:00.691 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:00.693 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:00.693 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:01.357 INFO:teuthology.orchestra.run.smithi016.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:56:01.366 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/063 2023-11-28T17:56:01.366 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/063 2023-11-28T17:56:01.366 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:01.373 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:01.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:01.465 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-11-28T17:56:02.070 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:02.081 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:02.082 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:02.085 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:02.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:02.524 INFO:teuthology.orchestra.run.smithi016.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T17:56:02.533 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/064 2023-11-28T17:56:02.533 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/064 2023-11-28T17:56:02.533 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:02.539 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:02.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:02.568 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-11-28T17:56:02.964 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:02.975 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:02.976 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:02.979 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:02.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:03.444 INFO:teuthology.orchestra.run.smithi016.stdout:generic/065 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:56:03.453 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/065 2023-11-28T17:56:03.453 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/065 2023-11-28T17:56:03.453 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:03.459 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:03.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:03.485 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-11-28T17:56:03.867 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:03.878 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:03.879 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:03.881 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:03.881 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:04.340 INFO:teuthology.orchestra.run.smithi016.stdout:generic/066 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:56:04.350 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/066 2023-11-28T17:56:04.350 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/066 2023-11-28T17:56:04.350 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:04.356 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:04.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:04.382 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-11-28T17:56:04.746 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:04.757 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:04.758 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:04.761 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:04.761 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:05.229 INFO:teuthology.orchestra.run.smithi016.stdout:generic/067 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:56:05.238 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/067 2023-11-28T17:56:05.238 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/067 2023-11-28T17:56:05.238 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:05.244 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:05.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:05.272 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-11-28T17:56:05.675 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:05.685 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:05.686 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:05.689 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:05.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:06.134 INFO:teuthology.orchestra.run.smithi016.stdout:generic/068 [not run] ceph does not support freezing 2023-11-28T17:56:06.143 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/068 2023-11-28T17:56:06.143 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/068 2023-11-28T17:56:06.143 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:06.149 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:06.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:06.175 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-11-28T17:56:06.563 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:06.573 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:06.574 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:06.577 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:06.577 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:21.442 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:56:21.446 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:56:27.622 INFO:teuthology.orchestra.run.smithi016.stdout:generic/069 21s 2023-11-28T17:56:27.663 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/069 2023-11-28T17:56:27.664 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:27.678 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:27.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:27.709 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-11-28T17:56:28.096 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:28.107 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:28.108 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:28.111 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:28.111 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:51.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:56:51.521 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:56:58.243 INFO:teuthology.orchestra.run.smithi016.stdout:generic/070 30s 2023-11-28T17:56:58.261 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/070 2023-11-28T17:56:58.261 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:58.271 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:58.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:58.549 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-11-28T17:56:59.204 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:56:59.218 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:56:59.220 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:56:59.224 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:56:59.224 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:59.873 INFO:teuthology.orchestra.run.smithi016.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T17:56:59.887 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/071 2023-11-28T17:56:59.887 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/071 2023-11-28T17:56:59.888 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:56:59.900 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:56:59.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:56:59.949 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-11-28T17:57:00.558 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:57:00.573 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:57:00.575 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:57:00.579 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:57:00.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:01.399 INFO:teuthology.orchestra.run.smithi016.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-28T17:57:01.412 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/072 2023-11-28T17:57:01.413 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/072 2023-11-28T17:57:01.413 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:57:01.430 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:01.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:57:01.480 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-11-28T17:57:02.042 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:57:02.058 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:57:02.060 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:57:02.063 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:57:02.063 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:02.733 INFO:teuthology.orchestra.run.smithi016.stdout:generic/073 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:57:02.750 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/073 2023-11-28T17:57:02.751 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/073 2023-11-28T17:57:02.751 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:57:02.759 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:02.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:57:02.806 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-11-28T17:57:03.348 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:57:03.363 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:57:03.365 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:57:03.368 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:57:03.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:21.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:57:21.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:57:49.500 INFO:teuthology.orchestra.run.smithi016.stdout:generic/074 46s 2023-11-28T17:57:49.522 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/074 2023-11-28T17:57:49.522 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:57:49.534 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:50.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:57:50.515 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-11-28T17:57:51.211 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:57:51.227 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:57:51.229 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:57:51.232 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:57:51.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:57:51.754 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:57:51.759 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:58:21.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:58:21.826 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:58:23.947 INFO:teuthology.orchestra.run.smithi016.stdout:generic/075 32s 2023-11-28T17:58:23.969 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/075 2023-11-28T17:58:23.970 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:23.983 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:24.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:24.197 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-11-28T17:58:24.910 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:24.927 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:24.928 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:24.931 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:24.931 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:25.525 INFO:teuthology.orchestra.run.smithi016.stdout:generic/076 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-11-28T17:58:25.542 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/076 2023-11-28T17:58:25.544 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/076 2023-11-28T17:58:25.544 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:25.557 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:25.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:25.598 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-11-28T17:58:26.144 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:26.157 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:26.159 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:26.163 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:26.163 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:29.306 INFO:teuthology.orchestra.run.smithi016.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T17:58:29.320 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/077 2023-11-28T17:58:29.321 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/077 2023-11-28T17:58:29.321 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:29.331 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:29.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:29.543 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-11-28T17:58:30.243 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:30.259 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:30.261 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:30.265 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:30.265 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:30.968 INFO:teuthology.orchestra.run.smithi016.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-28T17:58:30.980 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/078 2023-11-28T17:58:30.980 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/078 2023-11-28T17:58:30.981 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:30.989 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:31.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:31.185 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-11-28T17:58:31.948 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:31.961 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:31.962 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:31.964 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:31.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:32.616 INFO:teuthology.orchestra.run.smithi016.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-28T17:58:32.631 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/079 2023-11-28T17:58:32.631 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/079 2023-11-28T17:58:32.631 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:32.641 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:32.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:32.686 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-11-28T17:58:33.231 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:33.247 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:33.248 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:33.252 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:33.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:35.988 INFO:teuthology.orchestra.run.smithi016.stdout:generic/080 2s 2023-11-28T17:58:36.009 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/080 2023-11-28T17:58:36.009 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:36.019 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:36.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:36.075 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-11-28T17:58:36.633 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:36.647 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:36.649 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:36.652 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:36.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:37.355 INFO:teuthology.orchestra.run.smithi016.stdout:generic/081 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:58:37.369 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/081 2023-11-28T17:58:37.369 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/081 2023-11-28T17:58:37.369 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:37.377 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:37.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:37.416 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-11-28T17:58:37.979 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:37.995 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:37.996 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:38.001 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:38.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:38.667 INFO:teuthology.orchestra.run.smithi016.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T17:58:38.678 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/082 2023-11-28T17:58:38.679 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/082 2023-11-28T17:58:38.679 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:38.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:38.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:38.718 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-11-28T17:58:39.261 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:39.275 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:39.277 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:39.279 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:39.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:39.927 INFO:teuthology.orchestra.run.smithi016.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T17:58:39.942 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/083 2023-11-28T17:58:39.942 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/083 2023-11-28T17:58:39.942 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:39.956 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:39.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:39.995 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-11-28T17:58:40.551 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:40.569 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:40.571 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:40.578 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:40.579 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:46.705 INFO:teuthology.orchestra.run.smithi016.stdout:generic/084 6s 2023-11-28T17:58:48.327 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/084 2023-11-28T17:58:48.327 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:48.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:48.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:48.327 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-11-28T17:58:48.893 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:48.905 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:48.907 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:48.910 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:48.910 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:49.614 INFO:teuthology.orchestra.run.smithi016.stdout:generic/085 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T17:58:49.627 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/085 2023-11-28T17:58:49.627 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/085 2023-11-28T17:58:49.628 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:49.637 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:49.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:49.671 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-11-28T17:58:50.243 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:50.257 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:50.258 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:50.261 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:50.261 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:50.914 INFO:teuthology.orchestra.run.smithi016.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T17:58:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/086 2023-11-28T17:58:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/086 2023-11-28T17:58:50.928 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:50.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:50.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:50.983 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-11-28T17:58:51.567 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:51.590 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:51.590 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:51.592 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:51.592 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:51.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:58:51.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:58:52.558 INFO:teuthology.orchestra.run.smithi016.stdout:generic/087 1s 2023-11-28T17:58:52.577 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/087 2023-11-28T17:58:52.577 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:52.585 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:52.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:52.779 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-11-28T17:58:53.529 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:53.547 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:53.549 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:53.553 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:53.553 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:54.261 INFO:teuthology.orchestra.run.smithi016.stdout:generic/088 1s 2023-11-28T17:58:54.282 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/088 2023-11-28T17:58:54.282 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T17:58:54.293 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:58:54.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T17:58:54.468 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-11-28T17:58:55.205 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T17:58:55.221 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T17:58:55.223 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T17:58:55.226 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T17:58:55.226 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T17:59:22.093 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:59:22.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:59:52.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T17:59:52.153 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:00:22.205 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:00:22.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:00:52.263 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:00:52.267 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:01:22.536 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:01:22.541 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:01:52.693 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:01:52.697 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:01:52.830 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T18:01:52.832+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44390) UID: 0 2023-11-28T18:01:52.831 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T18:01:52.832+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44390) UID: 0 2023-11-28T18:04:54.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:04:54.192 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:05:24.262 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:05:24.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:05:54.324 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:05:54.328 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:06:24.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:06:24.385 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:06:54.437 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:06:54.441 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:07:25.253 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:07:25.258 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:07:25.303 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T18:07:25.304+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44417) UID: 0 2023-11-28T18:07:25.304 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T18:07:25.304+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44417) UID: 0 2023-11-28T18:10:20.798 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:10:20.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:10:51.337 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:10:51.341 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:11:21.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:11:21.414 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:11:52.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:11:52.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:12:22.540 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:12:22.544 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:12:52.605 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:12:52.609 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:13:22.778 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:13:22.782 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:13:52.967 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:13:52.971 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:13:53.003 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T18:13:53.003+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44447) UID: 0 2023-11-28T18:13:53.004 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T18:13:53.003+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44447) UID: 0 2023-11-28T18:16:47.886 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:16:47.891 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:17:18.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:17:18.281 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:17:48.340 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:17:48.345 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:18:18.405 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:18:18.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:18:48.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:18:48.482 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:19:18.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:19:18.531 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:19:48.582 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:19:48.586 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:19:53.943 INFO:teuthology.orchestra.run.smithi016.stdout:generic/089 1258s 2023-11-28T18:19:53.956 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/089 2023-11-28T18:19:53.957 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:19:53.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:19:54.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:19:54.335 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-11-28T18:19:54.829 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:19:54.840 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:19:54.841 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:19:54.844 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:19:54.844 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:19:55.491 INFO:teuthology.orchestra.run.smithi016.stdout:generic/090 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T18:19:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/090 2023-11-28T18:19:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/090 2023-11-28T18:19:55.501 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:19:55.507 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:19:55.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:19:55.536 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-11-28T18:19:55.907 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:19:55.917 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:19:55.918 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:19:55.921 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:19:55.921 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:20:18.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:20:18.646 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:20:48.714 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:20:48.718 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:21:18.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:21:18.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:21:48.944 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:21:48.949 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:21:53.247 INFO:teuthology.orchestra.run.smithi016.stdout:generic/091 117s 2023-11-28T18:21:53.260 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/091 2023-11-28T18:21:53.260 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:21:53.266 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:53.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:21:53.467 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-11-28T18:21:54.010 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:21:54.020 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:21:54.021 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:21:54.024 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:21:54.024 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:54.475 INFO:teuthology.orchestra.run.smithi016.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T18:21:54.484 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/092 2023-11-28T18:21:54.484 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/092 2023-11-28T18:21:54.484 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:21:54.491 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:54.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:21:54.524 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-11-28T18:21:54.902 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:21:54.913 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:21:54.914 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:21:54.918 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:21:54.918 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:55.819 INFO:teuthology.orchestra.run.smithi016.stdout:generic/093 0s 2023-11-28T18:21:55.832 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/093 2023-11-28T18:21:55.832 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:21:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:56.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:21:56.022 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-11-28T18:21:56.570 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:21:56.580 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:21:56.582 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:21:56.584 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:21:56.584 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:57.102 INFO:teuthology.orchestra.run.smithi016.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T18:21:57.111 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/094 2023-11-28T18:21:57.111 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/094 2023-11-28T18:21:57.111 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:21:57.118 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:21:57.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:21:57.284 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-11-28T18:21:57.898 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:21:57.909 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:21:57.910 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:21:57.912 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:21:57.912 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:09.541 INFO:teuthology.orchestra.run.smithi016.stdout:generic/095 11s 2023-11-28T18:22:09.561 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/095 2023-11-28T18:22:09.561 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:09.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:09.590 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-11-28T18:22:09.970 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:09.981 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:09.982 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:09.985 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:09.986 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:10.596 INFO:teuthology.orchestra.run.smithi016.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T18:22:10.605 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/096 2023-11-28T18:22:10.605 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/096 2023-11-28T18:22:10.605 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:10.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:10.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:10.649 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-11-28T18:22:11.026 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:11.037 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:11.038 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:11.040 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:11.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:12.088 INFO:teuthology.orchestra.run.smithi016.stdout:generic/097 1s 2023-11-28T18:22:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/097 2023-11-28T18:22:12.101 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:12.108 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:12.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:12.142 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-11-28T18:22:12.518 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:12.529 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:12.530 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:12.532 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:12.533 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:15.029 INFO:teuthology.orchestra.run.smithi016.stdout:generic/098 3s 2023-11-28T18:22:15.043 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/098 2023-11-28T18:22:15.043 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:15.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:15.069 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-11-28T18:22:15.482 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:15.494 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:15.495 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:15.497 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:15.498 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:16.971 INFO:teuthology.orchestra.run.smithi016.stdout:generic/099 1s 2023-11-28T18:22:16.984 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/099 2023-11-28T18:22:16.984 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:16.991 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:17.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:17.173 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-11-28T18:22:17.758 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:17.769 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:17.770 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:17.772 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:19.008 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:22:19.011 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:22:49.095 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:22:49.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:22:50.549 INFO:teuthology.orchestra.run.smithi016.stdout:generic/100 33s 2023-11-28T18:22:50.562 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/100 2023-11-28T18:22:50.563 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:50.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:53.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:53.205 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-11-28T18:22:53.594 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:53.605 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:53.606 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:53.609 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:53.609 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:54.047 INFO:teuthology.orchestra.run.smithi016.stdout:generic/101 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T18:22:54.056 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/101 2023-11-28T18:22:54.056 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/101 2023-11-28T18:22:54.056 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:54.063 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:54.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:54.091 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-11-28T18:22:54.479 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:54.490 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:54.490 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:54.493 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:54.493 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:54.939 INFO:teuthology.orchestra.run.smithi016.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T18:22:54.948 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/102 2023-11-28T18:22:54.948 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/102 2023-11-28T18:22:54.949 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:54.955 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:54.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:54.983 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-11-28T18:22:55.361 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:55.372 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:55.373 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:55.376 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:55.376 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:55.866 INFO:teuthology.orchestra.run.smithi016.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T18:22:55.875 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/103 2023-11-28T18:22:55.875 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/103 2023-11-28T18:22:55.875 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:55.881 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:55.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:55.969 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-11-28T18:22:56.654 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:56.665 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:56.665 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:56.668 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:56.668 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:57.175 INFO:teuthology.orchestra.run.smithi016.stdout:generic/104 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T18:22:57.184 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/104 2023-11-28T18:22:57.185 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/104 2023-11-28T18:22:57.185 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:57.191 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:57.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:57.219 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-11-28T18:22:57.603 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:57.613 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:57.615 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:57.617 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:57.617 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:58.522 INFO:teuthology.orchestra.run.smithi016.stdout:generic/105 1s 2023-11-28T18:22:58.569 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/105 2023-11-28T18:22:58.569 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:58.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:58.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:58.642 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-11-28T18:22:59.074 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:22:59.084 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:22:59.085 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:22:59.088 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:22:59.088 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:59.584 INFO:teuthology.orchestra.run.smithi016.stdout:generic/106 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T18:22:59.593 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/106 2023-11-28T18:22:59.593 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/106 2023-11-28T18:22:59.593 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:22:59.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:22:59.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:22:59.628 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-11-28T18:22:59.999 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:23:00.011 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:23:00.012 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:23:00.014 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:23:00.014 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:23:00.492 INFO:teuthology.orchestra.run.smithi016.stdout:generic/107 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T18:23:00.502 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/107 2023-11-28T18:23:00.502 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/107 2023-11-28T18:23:00.502 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:23:00.508 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:23:00.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:23:00.537 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-11-28T18:23:00.914 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:23:00.925 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:23:00.926 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:23:00.929 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:23:00.929 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:23:01.640 INFO:teuthology.orchestra.run.smithi016.stdout:generic/108 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T18:23:01.649 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/108 2023-11-28T18:23:01.649 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/108 2023-11-28T18:23:01.649 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:23:01.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:23:01.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:23:01.684 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-11-28T18:23:02.082 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:23:02.093 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:23:02.094 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:23:02.096 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:23:02.096 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:23:19.152 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:23:19.158 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:23:19.187 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T18:23:19.181+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44516) UID: 0 2023-11-28T18:23:19.188 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T18:23:19.181+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44516) UID: 0 2023-11-28T18:23:45.800 INFO:teuthology.orchestra.run.smithi016.stdout:generic/109 43s 2023-11-28T18:23:45.816 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/109 2023-11-28T18:23:45.816 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:23:45.823 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:23:45.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:23:45.846 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-11-28T18:23:46.226 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:23:46.237 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:23:46.238 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:23:46.241 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:23:46.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:24:41.090 INFO:teuthology.orchestra.run.smithi016.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T18:24:41.099 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/110 2023-11-28T18:24:41.099 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/110 2023-11-28T18:24:41.100 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:24:41.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:24:41.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:24:41.360 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-11-28T18:24:41.862 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:24:41.873 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:24:41.874 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:24:41.876 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:24:41.876 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:24:42.381 INFO:teuthology.orchestra.run.smithi016.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T18:24:42.390 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/111 2023-11-28T18:24:42.391 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/111 2023-11-28T18:24:42.391 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:24:42.397 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:24:42.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:24:42.642 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-11-28T18:24:43.155 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:24:43.166 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:24:43.167 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:24:43.170 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:24:43.170 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:04.483 INFO:teuthology.orchestra.run.smithi016.stdout:generic/112 21s 2023-11-28T18:25:04.968 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/112 2023-11-28T18:25:04.968 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:04.975 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:05.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:05.168 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-11-28T18:25:05.814 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:05.825 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:05.826 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:05.828 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:05.828 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:25.338 INFO:teuthology.orchestra.run.smithi016.stdout:generic/113 20s 2023-11-28T18:25:25.390 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/113 2023-11-28T18:25:25.391 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:25.398 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:25.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:25.644 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-11-28T18:25:26.366 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:26.376 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:26.378 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:26.380 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:26.380 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:26.908 INFO:teuthology.orchestra.run.smithi016.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-28T18:25:26.917 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/114 2023-11-28T18:25:26.917 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/114 2023-11-28T18:25:26.917 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:26.923 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:26.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:26.954 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-11-28T18:25:27.322 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:27.333 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:27.334 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:27.336 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:27.336 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:27.830 INFO:teuthology.orchestra.run.smithi016.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T18:25:27.839 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/115 2023-11-28T18:25:27.839 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/115 2023-11-28T18:25:27.839 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:27.846 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:28.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:28.041 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-11-28T18:25:28.598 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:28.608 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:28.609 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:28.612 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:28.612 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:29.126 INFO:teuthology.orchestra.run.smithi016.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T18:25:29.135 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/116 2023-11-28T18:25:29.135 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/116 2023-11-28T18:25:29.136 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:29.142 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:29.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:29.291 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-11-28T18:25:29.835 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:29.845 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:29.846 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:29.849 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:29.849 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:41.253 INFO:teuthology.orchestra.run.smithi016.stdout:generic/117 12s 2023-11-28T18:25:41.276 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/117 2023-11-28T18:25:41.276 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:41.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:41.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:41.301 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-11-28T18:25:41.734 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:41.745 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:41.746 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:41.749 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:41.749 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:43.316 INFO:teuthology.orchestra.run.smithi016.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T18:25:47.752 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/118 2023-11-28T18:25:47.752 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/118 2023-11-28T18:25:47.752 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:47.753 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:47.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:47.753 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-11-28T18:25:48.154 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:48.166 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:48.166 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:48.169 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:48.169 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:48.670 INFO:teuthology.orchestra.run.smithi016.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T18:25:48.838 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/119 2023-11-28T18:25:48.838 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/119 2023-11-28T18:25:48.838 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:48.838 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:48.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:48.938 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-11-28T18:25:49.406 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:49.417 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:49.418 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:49.421 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:49.421 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:49.884 INFO:teuthology.orchestra.run.smithi016.stdout:generic/120 [not run] atime not maintained by ceph 2023-11-28T18:25:49.894 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/120 2023-11-28T18:25:49.894 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/120 2023-11-28T18:25:49.894 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:49.899 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:49.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:49.928 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-11-28T18:25:50.305 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:50.316 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:50.317 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:50.320 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:50.320 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:50.800 INFO:teuthology.orchestra.run.smithi016.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T18:25:50.809 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/121 2023-11-28T18:25:50.809 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/121 2023-11-28T18:25:50.809 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:50.815 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:50.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:50.980 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-11-28T18:25:51.576 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:51.587 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:51.588 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:51.590 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:51.590 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:52.100 INFO:teuthology.orchestra.run.smithi016.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T18:25:52.110 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/122 2023-11-28T18:25:52.110 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/122 2023-11-28T18:25:52.110 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:52.116 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:52.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:52.298 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-11-28T18:25:52.834 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:52.845 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:52.846 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:52.849 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:52.849 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:53.804 INFO:teuthology.orchestra.run.smithi016.stdout:generic/123 1s 2023-11-28T18:25:53.817 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/123 2023-11-28T18:25:53.817 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:25:53.824 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:25:54.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:25:54.015 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-11-28T18:25:54.582 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:25:54.593 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:25:54.594 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:25:54.596 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:25:54.597 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:26:01.505 INFO:teuthology.orchestra.run.smithi016.stdout:generic/124 7s 2023-11-28T18:26:01.530 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/124 2023-11-28T18:26:01.530 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:26:01.538 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:26:01.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:26:01.722 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-11-28T18:26:02.374 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:26:02.384 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:26:02.385 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:26:02.388 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:26:02.388 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:26:10.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:26:10.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:26:40.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:26:40.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:27:04.172 INFO:teuthology.orchestra.run.smithi016.stdout:generic/125 62s 2023-11-28T18:27:04.274 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/125 2023-11-28T18:27:04.274 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:27:04.282 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:27:04.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:27:04.442 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-11-28T18:27:05.010 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:27:05.020 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:27:05.021 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:27:05.024 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:27:05.024 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:27:06.001 INFO:teuthology.orchestra.run.smithi016.stdout:generic/126 0s 2023-11-28T18:27:06.014 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/126 2023-11-28T18:27:06.014 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:27:06.021 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:27:06.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:27:06.267 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-11-28T18:27:06.786 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:27:06.797 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:27:06.798 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:27:06.801 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:27:06.801 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:27:10.710 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:27:10.714 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:27:40.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:27:40.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:28:10.841 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:28:10.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:28:40.980 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:28:40.984 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:29:11.048 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:29:11.052 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:29:41.105 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:29:41.111 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:30:11.186 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:30:11.191 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:30:41.268 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:30:41.272 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:31:11.340 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:31:11.344 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:31:41.938 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:31:41.942 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:32:11.995 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:32:12.000 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:32:42.102 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:32:42.106 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:33:12.166 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:33:12.171 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:33:42.223 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:33:42.228 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:34:12.287 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:34:12.291 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:34:42.428 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:34:42.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:35:12.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:35:13.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:35:43.624 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:35:43.628 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:13.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:13.693 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:43.855 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:36:43.860 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:13.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:13.950 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:44.015 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:37:44.019 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:14.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:14.076 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:44.132 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:38:44.308 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:14.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:14.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:15.443 INFO:teuthology.orchestra.run.smithi016.stdout:generic/127 729s 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/127 2023-11-28T18:39:15.464 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:39:15.470 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:39:15.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:39:15.573 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-11-28T18:39:16.278 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:39:16.289 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:39:16.290 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:39:16.292 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:39:16.292 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:39:17.804 INFO:teuthology.orchestra.run.smithi016.stdout:generic/128 1s 2023-11-28T18:39:17.817 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/128 2023-11-28T18:39:17.818 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T18:39:17.824 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:39:17.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T18:39:17.844 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-11-28T18:39:18.229 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T18:39:18.240 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T18:39:18.241 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T18:39:18.243 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T18:39:18.243 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T18:39:44.429 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:39:44.433 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:14.500 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:14.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:45.661 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:40:45.666 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:15.769 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:15.785 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:45.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:41:45.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:16.937 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:16.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:47.051 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:47.062 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:42:47.125 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T18:42:47.122+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 174983) UID: 0 2023-11-28T18:42:47.126 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T18:42:47.122+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 174983) UID: 0 2023-11-28T18:42:47.126 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T18:42:47.122+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 174983) UID: 0 2023-11-28T18:42:47.131 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T18:42:47.122+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 174983) UID: 0 2023-11-28T18:46:46.639 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:46:46.648 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:46:46.773 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T18:46:46.767+0000 7fe89ebfa640 -1 received signal: Hangup from (PID: 45354) UID: 0 2023-11-28T18:46:46.773 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T18:46:46.771+0000 7f11f9fc7640 -1 received signal: Hangup from (PID: 45354) UID: 0 2023-11-28T18:46:46.775 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T18:46:46.771+0000 7f0a358c6640 -1 received signal: Hangup from (PID: 45354) UID: 0 2023-11-28T18:46:46.775 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T18:46:46.771+0000 7fc8c6345640 -1 received signal: Hangup from (PID: 45354) UID: 0 2023-11-28T18:52:21.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:21.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:52.512 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:52:52.518 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:22.717 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:22.721 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:53.350 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:53:53.371 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:54:23.474 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:54:23.493 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:54:53.637 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:54:53.645 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:55:23.802 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:55:23.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T18:55:23.922 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T18:55:23.920+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45388) UID: 0 2023-11-28T18:55:23.923 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T18:55:23.920+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45388) UID: 0 2023-11-28T18:55:23.923 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T18:55:23.920+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45388) UID: 0 2023-11-28T18:55:23.924 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T18:55:23.920+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45388) UID: 0 2023-11-28T19:00:24.634 INFO:teuthology.orchestra.run.smithi016.stdout:generic/129 1266s 2023-11-28T19:00:24.691 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/129 2023-11-28T19:00:24.692 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:00:24.710 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:24.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:00:24.781 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-11-28T19:00:25.203 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:00:25.214 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:00:25.215 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:00:25.218 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:00:25.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:38.458 INFO:teuthology.orchestra.run.smithi016.stdout:generic/130 13s 2023-11-28T19:00:38.515 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/130 2023-11-28T19:00:38.515 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:00:38.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:38.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:00:38.593 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-11-28T19:00:39.009 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:00:39.020 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:00:39.021 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:00:39.023 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:00:39.023 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:40.829 INFO:teuthology.orchestra.run.smithi016.stdout:generic/131 1s 2023-11-28T19:00:40.849 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/131 2023-11-28T19:00:40.850 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:00:40.858 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:41.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:00:41.044 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-11-28T19:00:41.746 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:00:41.762 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:00:41.764 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:00:41.768 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:00:41.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:55.413 INFO:teuthology.orchestra.run.smithi016.stdout:generic/132 14s 2023-11-28T19:00:55.426 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/132 2023-11-28T19:00:55.426 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:00:55.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:55.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:00:55.452 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-11-28T19:00:55.825 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:00:55.836 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:00:55.837 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:00:55.839 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:00:55.839 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:00:59.971 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:00:59.976 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:01:00.004 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T19:01:00.001+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177129) UID: 0 2023-11-28T19:01:00.005 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T19:01:00.001+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177129) UID: 0 2023-11-28T19:01:00.005 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T19:01:00.001+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177129) UID: 0 2023-11-28T19:01:00.005 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T19:01:00.001+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177129) UID: 0 2023-11-28T19:03:56.848 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:03:56.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:04:26.993 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:04:26.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:04:54.900 INFO:teuthology.orchestra.run.smithi016.stdout:generic/133 238s 2023-11-28T19:04:54.955 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/133 2023-11-28T19:04:54.955 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:04:54.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:55.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:04:55.105 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-11-28T19:04:56.204 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:04:56.215 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:04:56.216 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:04:56.218 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:04:56.219 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:56.810 INFO:teuthology.orchestra.run.smithi016.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:04:56.819 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/134 2023-11-28T19:04:56.819 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/134 2023-11-28T19:04:56.819 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:04:56.826 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:56.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:04:56.989 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-11-28T19:04:57.072 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:04:57.096 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:04:57.593 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:04:57.604 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:04:57.605 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:04:57.608 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:04:57.608 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:58.820 INFO:teuthology.orchestra.run.smithi016.stdout:generic/135 1s 2023-11-28T19:04:58.833 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/135 2023-11-28T19:04:58.833 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:04:58.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:58.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:04:58.859 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-11-28T19:04:59.245 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:04:59.258 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:04:59.258 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:04:59.260 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:04:59.260 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:59.748 INFO:teuthology.orchestra.run.smithi016.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:04:59.757 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/136 2023-11-28T19:04:59.757 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/136 2023-11-28T19:04:59.757 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:04:59.764 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:04:59.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:04:59.994 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-11-28T19:05:00.561 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:00.572 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:00.573 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:00.576 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:00.576 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:01.233 INFO:teuthology.orchestra.run.smithi016.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:01.242 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/137 2023-11-28T19:05:01.242 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/137 2023-11-28T19:05:01.242 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:01.249 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:01.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:01.412 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-11-28T19:05:01.990 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:02.001 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:02.002 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:02.004 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:02.004 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:02.537 INFO:teuthology.orchestra.run.smithi016.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:02.546 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/138 2023-11-28T19:05:02.546 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/138 2023-11-28T19:05:02.546 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:02.553 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:02.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:02.693 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-11-28T19:05:03.331 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:03.342 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:03.343 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:03.345 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:03.345 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:03.847 INFO:teuthology.orchestra.run.smithi016.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:03.857 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/139 2023-11-28T19:05:03.857 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/139 2023-11-28T19:05:03.857 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:03.863 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:04.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:04.044 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-11-28T19:05:04.622 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:04.633 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:04.634 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:04.636 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:04.636 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:05.142 INFO:teuthology.orchestra.run.smithi016.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:05.151 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/140 2023-11-28T19:05:05.151 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/140 2023-11-28T19:05:05.151 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:05.158 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:05.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:05.397 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-11-28T19:05:05.949 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:05.960 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:05.961 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:05.963 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:05.963 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:06.609 INFO:teuthology.orchestra.run.smithi016.stdout:generic/141 0s 2023-11-28T19:05:06.623 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/141 2023-11-28T19:05:06.623 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:06.628 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:06.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:06.648 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-11-28T19:05:07.030 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:07.041 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:07.042 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:07.044 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:07.044 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:07.570 INFO:teuthology.orchestra.run.smithi016.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:07.579 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/142 2023-11-28T19:05:07.579 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/142 2023-11-28T19:05:07.579 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:07.586 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:07.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:07.858 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-11-28T19:05:08.390 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:08.400 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:08.401 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:08.404 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:08.404 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:08.897 INFO:teuthology.orchestra.run.smithi016.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:08.906 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/143 2023-11-28T19:05:08.907 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/143 2023-11-28T19:05:08.907 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:08.917 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:09.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:09.141 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-11-28T19:05:09.718 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:09.729 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:09.730 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:09.733 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:09.733 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:10.234 INFO:teuthology.orchestra.run.smithi016.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:10.244 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/144 2023-11-28T19:05:10.244 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/144 2023-11-28T19:05:10.244 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:10.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:10.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:10.474 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-11-28T19:05:11.049 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:11.060 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:11.061 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:11.063 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:11.064 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:11.584 INFO:teuthology.orchestra.run.smithi016.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:11.593 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/145 2023-11-28T19:05:11.593 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/145 2023-11-28T19:05:11.593 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:11.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:11.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:17.798 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-11-28T19:05:18.204 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:18.215 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:18.216 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:18.219 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:18.219 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:18.732 INFO:teuthology.orchestra.run.smithi016.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:18.741 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/146 2023-11-28T19:05:18.741 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/146 2023-11-28T19:05:18.741 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:18.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:18.921 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-11-28T19:05:19.490 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:19.501 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:19.502 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:19.505 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:19.505 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:19.998 INFO:teuthology.orchestra.run.smithi016.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:20.008 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/147 2023-11-28T19:05:20.008 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/147 2023-11-28T19:05:20.008 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:20.015 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:20.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:20.218 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-11-28T19:05:20.785 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:20.796 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:20.797 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:20.800 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:20.800 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:21.310 INFO:teuthology.orchestra.run.smithi016.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:21.320 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/148 2023-11-28T19:05:21.320 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/148 2023-11-28T19:05:21.320 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:21.326 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:21.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:21.506 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-11-28T19:05:22.070 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:22.081 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:22.082 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:22.084 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:22.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:22.594 INFO:teuthology.orchestra.run.smithi016.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:22.603 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/149 2023-11-28T19:05:22.603 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/149 2023-11-28T19:05:22.603 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:22.609 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:22.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:22.794 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-11-28T19:05:23.397 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:23.408 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:23.409 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:23.411 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:23.412 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:23.911 INFO:teuthology.orchestra.run.smithi016.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:23.920 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/150 2023-11-28T19:05:23.920 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/150 2023-11-28T19:05:23.920 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:23.927 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:24.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:24.038 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-11-28T19:05:24.687 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:24.697 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:24.699 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:24.702 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:24.702 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:25.224 INFO:teuthology.orchestra.run.smithi016.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:25.233 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/151 2023-11-28T19:05:25.234 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/151 2023-11-28T19:05:25.234 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:25.240 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:25.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:25.469 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-11-28T19:05:26.042 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:26.053 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:26.054 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:26.057 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:26.057 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:26.553 INFO:teuthology.orchestra.run.smithi016.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:26.562 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/152 2023-11-28T19:05:26.562 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/152 2023-11-28T19:05:26.562 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:26.568 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:26.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:26.730 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-11-28T19:05:27.219 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:05:27.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:05:27.366 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:27.376 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:27.377 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:27.380 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:27.380 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:27.891 INFO:teuthology.orchestra.run.smithi016.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:27.900 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/153 2023-11-28T19:05:27.901 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/153 2023-11-28T19:05:27.901 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:27.907 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:28.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:28.066 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-11-28T19:05:28.685 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:28.696 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:28.697 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:28.700 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:28.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:29.231 INFO:teuthology.orchestra.run.smithi016.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:29.240 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/154 2023-11-28T19:05:29.240 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/154 2023-11-28T19:05:29.240 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:29.246 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:29.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:29.474 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-11-28T19:05:30.036 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:30.047 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:30.048 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:30.050 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:30.051 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:30.562 INFO:teuthology.orchestra.run.smithi016.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:30.571 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/155 2023-11-28T19:05:30.572 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/155 2023-11-28T19:05:30.572 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:30.578 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:30.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:30.822 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-11-28T19:05:31.382 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:31.392 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:31.393 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:31.396 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:31.396 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:31.931 INFO:teuthology.orchestra.run.smithi016.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:31.941 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/156 2023-11-28T19:05:31.941 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/156 2023-11-28T19:05:31.941 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:31.947 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:32.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:32.171 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-11-28T19:05:32.693 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:32.704 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:32.705 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:32.708 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:32.708 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:33.226 INFO:teuthology.orchestra.run.smithi016.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:05:33.234 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/157 2023-11-28T19:05:33.235 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/157 2023-11-28T19:05:33.235 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:33.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:33.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:33.408 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-11-28T19:05:33.985 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:33.996 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:33.997 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:34.000 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:34.000 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:34.486 INFO:teuthology.orchestra.run.smithi016.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/158 2023-11-28T19:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/158 2023-11-28T19:05:34.495 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:34.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:34.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:34.722 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-11-28T19:05:35.309 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:35.320 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:35.321 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:35.324 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:35.324 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:35.802 INFO:teuthology.orchestra.run.smithi016.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-28T19:05:35.811 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/159 2023-11-28T19:05:35.811 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/159 2023-11-28T19:05:35.811 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:35.818 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:35.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:35.852 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-11-28T19:05:36.237 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:36.248 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:36.249 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:36.251 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:36.252 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:36.721 INFO:teuthology.orchestra.run.smithi016.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-28T19:05:36.730 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/160 2023-11-28T19:05:36.730 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/160 2023-11-28T19:05:36.730 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:36.736 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:36.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:36.799 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-11-28T19:05:37.205 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:37.214 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:37.215 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:37.217 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:37.217 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:37.941 INFO:teuthology.orchestra.run.smithi016.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:37.975 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/161 2023-11-28T19:05:37.975 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/161 2023-11-28T19:05:37.975 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:37.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:38.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:38.327 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-11-28T19:05:38.714 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:38.724 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:38.725 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:38.728 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:39.350 INFO:teuthology.orchestra.run.smithi016.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T19:05:39.477 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/162 2023-11-28T19:05:39.477 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/162 2023-11-28T19:05:39.477 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:39.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:39.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:39.822 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-11-28T19:05:40.210 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:40.221 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:40.222 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:40.225 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:40.225 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:40.842 INFO:teuthology.orchestra.run.smithi016.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T19:05:40.977 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/163 2023-11-28T19:05:40.977 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/163 2023-11-28T19:05:40.977 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:41.025 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:41.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:41.368 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-11-28T19:05:41.738 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:41.748 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:41.749 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:41.752 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:41.752 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:42.506 INFO:teuthology.orchestra.run.smithi016.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:42.542 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/164 2023-11-28T19:05:42.542 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/164 2023-11-28T19:05:42.542 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:42.577 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:42.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:42.865 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-11-28T19:05:43.243 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:51.503 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/165 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/165 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:51.504 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:51.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:51.505 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-11-28T19:05:51.914 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:51.924 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:51.925 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:51.927 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:51.928 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:52.649 INFO:teuthology.orchestra.run.smithi016.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:52.703 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/166 2023-11-28T19:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/166 2023-11-28T19:05:52.704 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:52.742 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:53.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:53.002 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-11-28T19:05:53.405 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:53.416 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:53.417 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:53.419 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:53.419 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:54.208 INFO:teuthology.orchestra.run.smithi016.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:54.275 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/167 2023-11-28T19:05:54.275 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/167 2023-11-28T19:05:54.275 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:54.317 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:54.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:54.527 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-11-28T19:05:54.917 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:54.928 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:54.929 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:54.931 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:54.932 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:55.695 INFO:teuthology.orchestra.run.smithi016.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:55.777 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/168 2023-11-28T19:05:55.777 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/168 2023-11-28T19:05:55.777 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:55.819 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:56.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:56.020 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-11-28T19:05:56.398 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:56.408 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:56.409 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:56.412 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:56.412 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:57.202 INFO:teuthology.orchestra.run.smithi016.stdout:generic/169 1s 2023-11-28T19:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/169 2023-11-28T19:05:57.216 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:57.222 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:57.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:57.241 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-11-28T19:05:57.285 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:05:57.297 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:05:57.653 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:57.664 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:57.666 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:57.668 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:57.668 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:58.399 INFO:teuthology.orchestra.run.smithi016.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:58.459 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/170 2023-11-28T19:05:58.459 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/170 2023-11-28T19:05:58.459 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:58.479 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:58.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:05:58.731 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-11-28T19:05:59.102 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:05:59.112 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:05:59.113 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:05:59.115 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:05:59.116 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:05:59.856 INFO:teuthology.orchestra.run.smithi016.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:05:59.928 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/171 2023-11-28T19:05:59.928 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/171 2023-11-28T19:05:59.928 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:05:59.971 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:00.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:00.232 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-11-28T19:06:00.601 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:00.612 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:00.613 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:00.615 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:00.616 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:01.351 INFO:teuthology.orchestra.run.smithi016.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:01.409 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/172 2023-11-28T19:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/172 2023-11-28T19:06:01.410 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:01.446 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:01.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:01.702 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-11-28T19:06:02.079 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:02.089 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:02.090 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:02.093 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:02.839 INFO:teuthology.orchestra.run.smithi016.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:02.905 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/173 2023-11-28T19:06:02.906 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/173 2023-11-28T19:06:02.908 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:02.965 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:03.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:03.183 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-11-28T19:06:03.560 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:03.571 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:03.572 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:03.574 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:03.575 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:04.340 INFO:teuthology.orchestra.run.smithi016.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:04.385 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/174 2023-11-28T19:06:04.385 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/174 2023-11-28T19:06:04.385 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:04.409 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:04.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:04.676 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-11-28T19:06:05.079 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:05.090 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:05.090 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:05.092 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:05.092 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:05.811 INFO:teuthology.orchestra.run.smithi016.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:05.854 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/175 2023-11-28T19:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/175 2023-11-28T19:06:05.856 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:05.898 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:06.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:06.174 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-11-28T19:06:06.550 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:06.561 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:06.562 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:06.564 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:06.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:07.314 INFO:teuthology.orchestra.run.smithi016.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:07.362 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/176 2023-11-28T19:06:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/176 2023-11-28T19:06:07.368 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:07.434 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:07.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:07.647 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-11-28T19:06:08.029 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:08.041 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:08.042 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:08.045 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:08.045 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:08.753 INFO:teuthology.orchestra.run.smithi016.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T19:06:08.762 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/177 2023-11-28T19:06:08.762 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/177 2023-11-28T19:06:08.762 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:08.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:08.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:08.946 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-11-28T19:06:09.530 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:09.541 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:09.542 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:09.544 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:09.544 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:10.090 INFO:teuthology.orchestra.run.smithi016.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/178 2023-11-28T19:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/178 2023-11-28T19:06:10.099 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:10.105 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:10.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:10.267 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-11-28T19:06:10.865 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:10.876 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:10.877 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:10.880 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:10.880 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:11.382 INFO:teuthology.orchestra.run.smithi016.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:06:11.391 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/179 2023-11-28T19:06:11.391 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/179 2023-11-28T19:06:11.391 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:11.397 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:11.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:11.564 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-11-28T19:06:12.150 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:12.161 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:12.162 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:12.164 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:12.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:12.668 INFO:teuthology.orchestra.run.smithi016.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:06:12.677 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/180 2023-11-28T19:06:12.677 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/180 2023-11-28T19:06:12.677 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:12.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:12.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:12.888 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-11-28T19:06:13.446 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:13.457 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:13.458 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:13.460 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:13.460 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:13.970 INFO:teuthology.orchestra.run.smithi016.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:06:13.980 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/181 2023-11-28T19:06:13.980 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/181 2023-11-28T19:06:13.980 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:13.986 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:14.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:14.111 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-11-28T19:06:14.770 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:14.780 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:14.781 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:14.784 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:14.784 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:15.296 INFO:teuthology.orchestra.run.smithi016.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:06:15.305 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/182 2023-11-28T19:06:15.305 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/182 2023-11-28T19:06:15.305 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:15.312 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:15.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:15.515 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-11-28T19:06:16.138 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:16.149 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:16.150 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:16.152 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:16.153 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:16.865 INFO:teuthology.orchestra.run.smithi016.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:16.923 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/183 2023-11-28T19:06:16.923 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/183 2023-11-28T19:06:16.923 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:16.990 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:17.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:17.223 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-11-28T19:06:17.597 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:17.608 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:17.609 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:17.611 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:17.612 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:18.129 INFO:teuthology.orchestra.run.smithi016.stdout:generic/184 1s 2023-11-28T19:06:18.225 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/184 2023-11-28T19:06:18.225 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:18.225 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:18.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:18.225 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-11-28T19:06:18.615 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:18.625 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:18.626 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:18.629 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:18.629 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:19.345 INFO:teuthology.orchestra.run.smithi016.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/185 2023-11-28T19:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/185 2023-11-28T19:06:19.421 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:19.434 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:19.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:19.684 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-11-28T19:06:20.062 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:20.072 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:20.073 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:20.076 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:20.076 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:20.754 INFO:teuthology.orchestra.run.smithi016.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:20.813 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/186 2023-11-28T19:06:20.813 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/186 2023-11-28T19:06:20.813 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:20.857 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:21.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:21.169 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-11-28T19:06:21.562 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:21.573 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:21.576 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:21.576 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:22.319 INFO:teuthology.orchestra.run.smithi016.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:22.376 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/187 2023-11-28T19:06:22.377 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/187 2023-11-28T19:06:22.377 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:22.394 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:22.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:22.677 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-11-28T19:06:23.070 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:23.081 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:23.082 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:23.084 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:23.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:23.814 INFO:teuthology.orchestra.run.smithi016.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:23.868 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/188 2023-11-28T19:06:23.869 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/188 2023-11-28T19:06:23.869 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:23.938 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:24.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:24.180 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-11-28T19:06:24.590 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:24.601 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:24.602 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:24.604 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:24.605 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:25.288 INFO:teuthology.orchestra.run.smithi016.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:25.377 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/189 2023-11-28T19:06:25.377 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/189 2023-11-28T19:06:25.378 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:25.419 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:25.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:25.672 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-11-28T19:06:26.068 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:26.078 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:26.079 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:26.083 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:26.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:26.836 INFO:teuthology.orchestra.run.smithi016.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:26.878 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/190 2023-11-28T19:06:26.878 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/190 2023-11-28T19:06:26.878 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:26.917 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:27.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:27.195 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-11-28T19:06:27.534 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:06:27.537 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:06:27.580 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:27.591 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:27.592 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:27.594 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:27.595 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:28.288 INFO:teuthology.orchestra.run.smithi016.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:28.366 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/191 2023-11-28T19:06:28.367 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/191 2023-11-28T19:06:28.367 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:28.434 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:28.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:28.688 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-11-28T19:06:29.105 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:29.116 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:29.117 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:29.119 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:29.120 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:29.665 INFO:teuthology.orchestra.run.smithi016.stdout:generic/192 [not run] atime not maintained by ceph 2023-11-28T19:06:29.674 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/192 2023-11-28T19:06:29.675 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/192 2023-11-28T19:06:29.675 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:29.681 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:29.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:29.713 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-11-28T19:06:30.118 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:30.124 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:30.126 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:30.129 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:30.129 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:32.040 INFO:teuthology.orchestra.run.smithi016.stdout:generic/193 2s 2023-11-28T19:06:32.053 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/193 2023-11-28T19:06:32.053 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:32.059 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:32.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:32.198 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-11-28T19:06:32.830 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:32.841 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:32.842 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:32.845 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:32.845 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:33.567 INFO:teuthology.orchestra.run.smithi016.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:33.623 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/194 2023-11-28T19:06:33.623 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/194 2023-11-28T19:06:33.623 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:33.664 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:33.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:33.836 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-11-28T19:06:34.226 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:34.236 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:34.238 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:34.240 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:34.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:34.963 INFO:teuthology.orchestra.run.smithi016.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:35.007 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/195 2023-11-28T19:06:35.007 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/195 2023-11-28T19:06:35.014 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:35.073 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:35.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:35.203 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-11-28T19:06:35.646 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:35.656 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:35.658 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:35.661 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:35.661 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:36.388 INFO:teuthology.orchestra.run.smithi016.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:36.475 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/196 2023-11-28T19:06:36.475 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/196 2023-11-28T19:06:36.475 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:36.521 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:36.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:36.648 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-11-28T19:06:37.064 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:37.075 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:37.076 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:37.079 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:37.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:37.782 INFO:teuthology.orchestra.run.smithi016.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:37.844 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/197 2023-11-28T19:06:37.844 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/197 2023-11-28T19:06:37.844 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:37.858 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:38.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:38.059 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-11-28T19:06:38.494 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:38.504 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:38.505 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:38.508 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:38.508 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:39.823 INFO:teuthology.orchestra.run.smithi016.stdout:generic/198 1s 2023-11-28T19:06:39.836 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/198 2023-11-28T19:06:39.836 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:39.842 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:39.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:39.961 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-11-28T19:06:40.641 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:40.652 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:40.653 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:40.656 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:40.656 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:41.421 INFO:teuthology.orchestra.run.smithi016.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/199 2023-11-28T19:06:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/199 2023-11-28T19:06:41.488 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:41.525 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:41.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:41.694 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-11-28T19:06:42.064 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:42.074 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:42.075 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:42.078 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:42.078 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:42.843 INFO:teuthology.orchestra.run.smithi016.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:42.912 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/200 2023-11-28T19:06:42.912 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/200 2023-11-28T19:06:42.912 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:42.948 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:43.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:43.099 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-11-28T19:06:43.502 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:43.513 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:43.514 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:43.517 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:43.517 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:44.243 INFO:teuthology.orchestra.run.smithi016.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/201 2023-11-28T19:06:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/201 2023-11-28T19:06:44.279 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:44.313 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:44.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:44.546 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-11-28T19:06:44.937 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:44.948 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:44.949 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:44.951 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:44.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:45.719 INFO:teuthology.orchestra.run.smithi016.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:45.797 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/202 2023-11-28T19:06:45.798 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/202 2023-11-28T19:06:45.798 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:45.818 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:45.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:45.942 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-11-28T19:06:46.357 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:46.368 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:46.369 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:46.372 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:46.372 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:47.099 INFO:teuthology.orchestra.run.smithi016.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:47.190 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/203 2023-11-28T19:06:47.190 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/203 2023-11-28T19:06:47.190 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:47.257 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:47.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:47.390 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-11-28T19:06:47.789 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:47.800 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:47.801 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:47.803 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:47.804 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:49.653 INFO:teuthology.orchestra.run.smithi016.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:06:49.663 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/204 2023-11-28T19:06:49.664 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/204 2023-11-28T19:06:49.664 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:49.670 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:49.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:49.743 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-11-28T19:06:50.154 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:50.164 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:50.166 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:50.168 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:50.168 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:50.916 INFO:teuthology.orchestra.run.smithi016.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:50.998 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/205 2023-11-28T19:06:50.998 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/205 2023-11-28T19:06:50.998 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:51.021 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:51.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:51.149 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-11-28T19:06:51.546 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:51.556 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:51.558 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:51.560 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:51.561 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:52.275 INFO:teuthology.orchestra.run.smithi016.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:06:52.378 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/206 2023-11-28T19:06:52.378 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/206 2023-11-28T19:06:52.378 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:06:52.405 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:52.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:06:52.534 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-11-28T19:06:52.949 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:06:52.960 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:06:52.961 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:06:52.964 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:06:52.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:06:57.626 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:06:57.630 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:07:00.984 INFO:teuthology.orchestra.run.smithi016.stdout:generic/207 7s 2023-11-28T19:07:00.996 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/207 2023-11-28T19:07:00.996 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:07:01.003 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:07:01.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:07:01.235 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-11-28T19:07:01.797 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:07:01.808 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:07:01.809 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:07:01.812 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:07:01.812 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:07:27.689 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:07:27.696 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:07:57.756 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:07:57.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:08:27.819 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:08:27.825 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:08:57.871 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:08:57.879 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:09:27.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:09:27.972 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:09:58.022 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:09:58.027 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:10:22.493 INFO:teuthology.orchestra.run.smithi016.stdout:generic/208 201s 2023-11-28T19:10:22.506 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/208 2023-11-28T19:10:22.506 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:10:22.513 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:10:22.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:10:22.784 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-11-28T19:10:23.294 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:10:23.304 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:10:23.305 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:10:23.308 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:10:23.308 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:10:28.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:10:28.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:10:58.193 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:10:58.198 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:10:58.906 INFO:teuthology.orchestra.run.smithi016.stdout:generic/209 35s 2023-11-28T19:10:58.920 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/209 2023-11-28T19:10:58.920 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:10:58.926 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:10:59.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:10:59.045 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-11-28T19:10:59.667 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:10:59.677 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:10:59.678 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:10:59.681 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:10:59.681 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:00.470 INFO:teuthology.orchestra.run.smithi016.stdout:generic/210 1s 2023-11-28T19:11:00.484 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/210 2023-11-28T19:11:00.484 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:00.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:00.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:00.630 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-11-28T19:11:01.242 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:01.252 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:01.253 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:01.256 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:01.256 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:02.246 INFO:teuthology.orchestra.run.smithi016.stdout:generic/211 1s 2023-11-28T19:11:02.260 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/211 2023-11-28T19:11:02.260 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:02.266 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:02.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:02.301 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-11-28T19:11:02.702 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:02.713 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:02.714 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:02.717 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:02.718 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:03.339 INFO:teuthology.orchestra.run.smithi016.stdout:generic/212 1s 2023-11-28T19:11:03.352 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/212 2023-11-28T19:11:03.352 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:03.359 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:03.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:03.394 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-11-28T19:11:03.773 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:03.784 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:03.785 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:03.788 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:03.788 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:04.331 INFO:teuthology.orchestra.run.smithi016.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:11:04.340 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/213 2023-11-28T19:11:04.341 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/213 2023-11-28T19:11:04.341 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:04.347 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:04.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:04.381 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-11-28T19:11:04.765 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:04.776 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:04.777 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:04.780 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:04.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:05.227 INFO:teuthology.orchestra.run.smithi016.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:11:05.236 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/214 2023-11-28T19:11:05.236 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/214 2023-11-28T19:11:05.236 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:05.243 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:05.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:05.278 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-11-28T19:11:05.664 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:05.674 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:05.675 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:05.678 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:05.678 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:08.256 INFO:teuthology.orchestra.run.smithi016.stdout:generic/215 3s 2023-11-28T19:11:08.270 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/215 2023-11-28T19:11:08.270 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:08.277 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:08.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:08.329 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-11-28T19:11:08.734 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:08.744 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:08.745 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:08.748 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:08.748 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:09.461 INFO:teuthology.orchestra.run.smithi016.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:09.542 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/216 2023-11-28T19:11:09.542 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/216 2023-11-28T19:11:09.542 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:09.589 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:09.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:09.743 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-11-28T19:11:10.138 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:10.149 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:10.150 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:10.153 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:10.153 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:10.871 INFO:teuthology.orchestra.run.smithi016.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:10.936 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/217 2023-11-28T19:11:10.936 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/217 2023-11-28T19:11:10.936 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:10.953 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:11.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:11.131 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-11-28T19:11:11.522 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:11.533 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:11.534 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:11.536 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:11.537 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:12.287 INFO:teuthology.orchestra.run.smithi016.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:12.350 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/218 2023-11-28T19:11:12.350 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/218 2023-11-28T19:11:12.350 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:12.398 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:12.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:12.560 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-11-28T19:11:12.939 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:12.950 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:12.951 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:12.953 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:12.953 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:13.411 INFO:teuthology.orchestra.run.smithi016.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:13.420 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/219 2023-11-28T19:11:13.421 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/219 2023-11-28T19:11:13.421 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:13.427 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:13.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:13.456 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-11-28T19:11:13.834 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:13.844 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:13.846 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:13.848 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:13.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:14.577 INFO:teuthology.orchestra.run.smithi016.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:14.637 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/220 2023-11-28T19:11:14.637 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/220 2023-11-28T19:11:14.637 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:14.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:14.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:14.840 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-11-28T19:11:15.218 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:15.229 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:15.230 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:15.232 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:15.233 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:16.746 INFO:teuthology.orchestra.run.smithi016.stdout:generic/221 1s 2023-11-28T19:11:16.761 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/221 2023-11-28T19:11:16.761 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:16.767 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:16.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:16.805 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-11-28T19:11:17.202 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:17.213 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:17.214 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:17.216 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:17.217 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:17.910 INFO:teuthology.orchestra.run.smithi016.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:17.969 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/222 2023-11-28T19:11:17.970 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/222 2023-11-28T19:11:17.970 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:17.993 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:18.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:18.174 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-11-28T19:11:18.578 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:18.588 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:18.590 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:18.592 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:18.592 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:19.053 INFO:teuthology.orchestra.run.smithi016.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:11:19.062 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/223 2023-11-28T19:11:19.062 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/223 2023-11-28T19:11:19.062 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:19.068 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:19.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:19.101 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-11-28T19:11:19.482 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:19.493 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:19.494 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:19.496 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:19.497 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:19.956 INFO:teuthology.orchestra.run.smithi016.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:11:19.965 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/224 2023-11-28T19:11:19.966 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/224 2023-11-28T19:11:19.966 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:19.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:20.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:20.006 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-11-28T19:11:20.402 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:20.413 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:20.414 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:20.417 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:20.417 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:20.935 INFO:teuthology.orchestra.run.smithi016.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T19:11:20.944 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/225 2023-11-28T19:11:20.944 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/225 2023-11-28T19:11:20.945 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:20.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:21.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:21.079 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-11-28T19:11:21.689 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:21.700 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:21.701 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:21.704 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:21.704 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:22.185 INFO:teuthology.orchestra.run.smithi016.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:11:22.194 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/226 2023-11-28T19:11:22.195 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/226 2023-11-28T19:11:22.195 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:22.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:22.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:22.232 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-11-28T19:11:22.614 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:22.624 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:22.625 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:22.629 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:22.629 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:23.373 INFO:teuthology.orchestra.run.smithi016.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:23.417 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/227 2023-11-28T19:11:23.418 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/227 2023-11-28T19:11:23.418 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:23.457 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:23.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:23.615 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-11-28T19:11:23.993 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:24.004 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:24.005 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:24.007 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:24.007 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:24.507 INFO:teuthology.orchestra.run.smithi016.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:11:24.516 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/228 2023-11-28T19:11:24.516 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/228 2023-11-28T19:11:24.516 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:24.522 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:24.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:24.555 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-11-28T19:11:24.950 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:24.960 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:24.961 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:24.964 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:24.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:25.729 INFO:teuthology.orchestra.run.smithi016.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:25.782 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/229 2023-11-28T19:11:25.801 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/229 2023-11-28T19:11:25.801 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:25.826 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:25.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:25.975 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-11-28T19:11:26.358 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:26.368 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:26.369 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:26.372 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:26.372 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:26.808 INFO:teuthology.orchestra.run.smithi016.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:26.817 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/230 2023-11-28T19:11:26.818 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/230 2023-11-28T19:11:26.818 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:26.824 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:26.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:26.855 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-11-28T19:11:27.233 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:27.244 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:27.245 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:27.247 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:27.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:27.676 INFO:teuthology.orchestra.run.smithi016.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:27.685 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/231 2023-11-28T19:11:27.685 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/231 2023-11-28T19:11:27.685 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:27.691 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:27.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:27.719 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-11-28T19:11:28.114 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:28.125 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:28.126 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:28.129 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:28.129 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:28.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:11:28.254 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:11:28.585 INFO:teuthology.orchestra.run.smithi016.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:28.595 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/232 2023-11-28T19:11:28.595 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/232 2023-11-28T19:11:28.595 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:28.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:28.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:28.628 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-11-28T19:11:29.018 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:29.029 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:29.030 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:29.032 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:29.032 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:29.457 INFO:teuthology.orchestra.run.smithi016.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:29.466 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/233 2023-11-28T19:11:29.466 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/233 2023-11-28T19:11:29.467 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:29.473 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:29.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:29.501 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-11-28T19:11:29.889 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:29.900 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:29.901 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:29.903 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:29.904 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:30.341 INFO:teuthology.orchestra.run.smithi016.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:30.350 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/234 2023-11-28T19:11:30.350 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/234 2023-11-28T19:11:30.350 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:30.357 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:30.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:30.385 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-11-28T19:11:30.762 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:30.773 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:30.774 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:30.776 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:30.777 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:31.217 INFO:teuthology.orchestra.run.smithi016.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:11:31.226 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/235 2023-11-28T19:11:31.226 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/235 2023-11-28T19:11:31.226 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:31.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:31.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:31.261 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-11-28T19:11:31.669 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:31.680 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:31.681 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:31.684 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:31.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:33.299 INFO:teuthology.orchestra.run.smithi016.stdout:generic/236 2s 2023-11-28T19:11:33.313 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/236 2023-11-28T19:11:33.313 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:33.320 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:33.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:33.463 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-11-28T19:11:34.070 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:34.081 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:34.082 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:34.085 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:34.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:34.689 INFO:teuthology.orchestra.run.smithi016.stdout:generic/237 0s 2023-11-28T19:11:34.702 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/237 2023-11-28T19:11:34.702 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:34.709 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:34.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:34.856 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-11-28T19:11:35.454 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:35.465 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:35.466 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:35.469 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:35.469 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:36.160 INFO:teuthology.orchestra.run.smithi016.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:11:36.248 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/238 2023-11-28T19:11:36.248 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/238 2023-11-28T19:11:36.248 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:11:36.266 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:36.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:11:36.472 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-11-28T19:11:36.861 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:11:36.872 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:11:36.874 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:11:36.876 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:11:36.876 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:11:58.314 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:11:58.318 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:12:28.396 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:12:28.431 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:12:58.511 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:12:58.532 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:13:28.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:13:28.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:13:52.160 INFO:teuthology.orchestra.run.smithi016.stdout:generic/239 135s 2023-11-28T19:13:52.172 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/239 2023-11-28T19:13:52.173 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:13:52.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:13:52.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:13:52.389 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-11-28T19:13:52.930 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:13:52.941 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:13:52.942 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:13:52.944 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:13:52.945 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:13:54.294 INFO:teuthology.orchestra.run.smithi016.stdout:generic/240 0s 2023-11-28T19:13:54.308 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/240 2023-11-28T19:13:54.308 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:13:54.315 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:13:54.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:13:54.522 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-11-28T19:13:55.106 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:13:55.117 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:13:55.118 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:13:55.121 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:13:55.121 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:13:58.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:13:58.751 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:14:28.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:14:28.829 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:14:58.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:14:58.893 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:14:58.927 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T19:14:58.921+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45500) UID: 0 2023-11-28T19:14:58.928 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T19:14:58.921+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45500) UID: 0 2023-11-28T19:15:10.166 INFO:teuthology.orchestra.run.smithi016.stdout:generic/241 75s 2023-11-28T19:15:10.180 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/241 2023-11-28T19:15:10.180 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:10.186 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:12.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:12.051 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-11-28T19:15:12.618 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:12.825 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:12.825 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:12.825 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:12.825 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:14.107 INFO:teuthology.orchestra.run.smithi016.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:14.123 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/242 2023-11-28T19:15:14.123 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/242 2023-11-28T19:15:14.123 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:14.148 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:14.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:14.384 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-11-28T19:15:14.774 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:14.785 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:14.786 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:14.789 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:14.789 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:15.511 INFO:teuthology.orchestra.run.smithi016.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:15.566 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/243 2023-11-28T19:15:15.567 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/243 2023-11-28T19:15:15.567 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:15.585 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:15.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:15.726 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-11-28T19:15:16.166 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:16.177 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:16.178 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:16.180 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:16.181 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:16.613 INFO:teuthology.orchestra.run.smithi016.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:15:16.622 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/244 2023-11-28T19:15:16.622 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/244 2023-11-28T19:15:16.622 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:16.629 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:16.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:16.656 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-11-28T19:15:17.047 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:17.057 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:17.058 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:17.061 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:17.061 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:17.621 INFO:teuthology.orchestra.run.smithi016.stdout:generic/245 0s 2023-11-28T19:15:17.633 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/245 2023-11-28T19:15:17.633 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:17.640 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:17.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:17.855 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-11-28T19:15:18.386 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:18.397 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:18.398 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:18.401 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:18.401 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:19.070 INFO:teuthology.orchestra.run.smithi016.stdout:generic/246 0s 2023-11-28T19:15:19.083 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/246 2023-11-28T19:15:19.084 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:19.091 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:19.235 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:19.235 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-11-28T19:15:19.822 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:19.832 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:19.833 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:19.836 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:19.836 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:28.684 INFO:teuthology.orchestra.run.smithi016.stdout:generic/247 9s 2023-11-28T19:15:28.697 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/247 2023-11-28T19:15:28.697 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:28.703 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:28.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:28.723 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-11-28T19:15:29.110 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:29.120 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:29.121 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:29.124 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:29.124 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:29.644 INFO:teuthology.orchestra.run.smithi016.stdout:generic/248 0s 2023-11-28T19:15:29.657 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/248 2023-11-28T19:15:29.658 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:29.664 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:29.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:29.704 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-11-28T19:15:30.093 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:30.104 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:30.105 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:30.107 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:30.108 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:30.918 INFO:teuthology.orchestra.run.smithi016.stdout:generic/249 0s 2023-11-28T19:15:30.931 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/249 2023-11-28T19:15:30.931 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:30.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:31.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:31.074 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-11-28T19:15:31.682 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:generic/250 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/250 2023-11-28T19:15:36.283 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/250 2023-11-28T19:15:36.284 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:36.284 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:36.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:36.284 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-11-28T19:15:36.670 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:36.680 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:36.681 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:36.684 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:36.684 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:37.258 INFO:teuthology.orchestra.run.smithi016.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:37.273 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/251 2023-11-28T19:15:37.273 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/251 2023-11-28T19:15:37.274 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:37.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:37.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:37.305 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-11-28T19:15:37.702 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:37.712 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:37.714 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:37.716 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:37.717 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:38.177 INFO:teuthology.orchestra.run.smithi016.stdout:generic/252 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:15:38.186 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/252 2023-11-28T19:15:38.187 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/252 2023-11-28T19:15:38.187 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:38.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:38.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:38.220 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-11-28T19:15:38.608 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:38.619 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:38.620 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:38.622 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:38.623 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:39.332 INFO:teuthology.orchestra.run.smithi016.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:39.368 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/253 2023-11-28T19:15:39.368 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/253 2023-11-28T19:15:39.368 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:39.392 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:39.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:39.547 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-11-28T19:15:39.979 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:39.990 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:39.991 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:39.993 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:39.994 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:40.733 INFO:teuthology.orchestra.run.smithi016.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:40.834 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/254 2023-11-28T19:15:40.834 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/254 2023-11-28T19:15:40.834 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:40.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:41.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:41.012 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-11-28T19:15:41.401 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:41.412 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:41.413 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:41.416 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:41.416 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:42.070 INFO:teuthology.orchestra.run.smithi016.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:15:42.079 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/255 2023-11-28T19:15:42.079 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/255 2023-11-28T19:15:42.079 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:42.086 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:42.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:42.321 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-11-28T19:15:42.874 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:42.884 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:42.886 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:42.888 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:42.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:43.769 INFO:teuthology.orchestra.run.smithi016.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:15:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/256 2023-11-28T19:15:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/256 2023-11-28T19:15:43.778 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:43.785 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:43.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:43.820 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-11-28T19:15:44.218 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:44.229 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:44.230 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:44.232 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:44.233 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:47.692 INFO:teuthology.orchestra.run.smithi016.stdout:generic/257 3s 2023-11-28T19:15:47.705 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/257 2023-11-28T19:15:47.706 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:47.712 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:47.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:47.940 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-11-28T19:15:48.481 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:48.492 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:48.493 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:48.496 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:48.496 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:49.011 INFO:teuthology.orchestra.run.smithi016.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-11-28T19:15:49.020 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/258 2023-11-28T19:15:49.021 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/258 2023-11-28T19:15:49.021 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:49.027 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:49.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:49.069 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-11-28T19:15:49.482 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:49.492 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:49.493 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:49.496 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:49.496 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:50.271 INFO:teuthology.orchestra.run.smithi016.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:50.349 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/259 2023-11-28T19:15:50.350 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/259 2023-11-28T19:15:50.351 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:50.391 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:50.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:50.495 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-11-28T19:15:50.898 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:50.909 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:50.910 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:50.912 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:50.913 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:51.497 INFO:teuthology.orchestra.run.smithi016.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:51.512 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/260 2023-11-28T19:15:51.512 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/260 2023-11-28T19:15:51.512 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:51.519 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:51.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:51.547 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-11-28T19:15:51.954 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:51.965 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:51.966 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:51.969 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:51.969 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:52.666 INFO:teuthology.orchestra.run.smithi016.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:52.711 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/261 2023-11-28T19:15:52.712 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/261 2023-11-28T19:15:52.712 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:52.740 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:52.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:52.925 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-11-28T19:15:53.334 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:53.344 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:53.345 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:53.348 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:53.348 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:54.113 INFO:teuthology.orchestra.run.smithi016.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:15:54.156 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/262 2023-11-28T19:15:54.157 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/262 2023-11-28T19:15:54.163 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:15:54.188 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:15:54.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:15:54.346 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-11-28T19:15:54.739 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:15:54.750 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:15:54.751 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:15:54.753 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:15:54.754 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:48.096 INFO:teuthology.orchestra.run.smithi016.stdout:generic/263 54s 2023-11-28T19:16:48.109 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/263 2023-11-28T19:16:48.109 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:48.115 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:48.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:48.258 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-11-28T19:16:48.842 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:48.853 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:48.854 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:48.856 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:48.857 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:49.804 INFO:teuthology.orchestra.run.smithi016.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:16:49.886 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/264 2023-11-28T19:16:49.887 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/264 2023-11-28T19:16:49.887 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:49.904 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:50.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:50.074 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-11-28T19:16:50.454 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:50.464 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:50.465 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:50.468 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:50.468 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:51.244 INFO:teuthology.orchestra.run.smithi016.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:16:51.329 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/265 2023-11-28T19:16:51.329 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/265 2023-11-28T19:16:51.329 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:51.386 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:51.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:51.489 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-11-28T19:16:51.870 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:51.880 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:51.881 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:51.884 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:51.884 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:52.665 INFO:teuthology.orchestra.run.smithi016.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:16:52.683 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/266 2023-11-28T19:16:52.684 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/266 2023-11-28T19:16:52.684 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:52.743 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:52.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:52.939 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-11-28T19:16:53.334 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:53.345 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:53.346 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:53.348 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:53.349 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:54.119 INFO:teuthology.orchestra.run.smithi016.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:16:54.149 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/267 2023-11-28T19:16:54.149 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/267 2023-11-28T19:16:54.149 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:54.162 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:54.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:54.335 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-11-28T19:16:54.730 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:54.741 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:54.742 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:54.744 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:54.744 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:55.579 INFO:teuthology.orchestra.run.smithi016.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:16:55.617 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/268 2023-11-28T19:16:55.617 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/268 2023-11-28T19:16:55.617 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:55.632 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:55.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:55.780 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-11-28T19:16:56.173 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:56.184 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:56.185 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:56.188 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:56.188 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:56.628 INFO:teuthology.orchestra.run.smithi016.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:16:56.637 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/269 2023-11-28T19:16:56.637 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/269 2023-11-28T19:16:56.638 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:56.644 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:56.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:56.672 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-11-28T19:16:57.070 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:57.080 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:57.081 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:57.084 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:57.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:57.500 INFO:teuthology.orchestra.run.smithi016.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:16:57.509 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/270 2023-11-28T19:16:57.509 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/270 2023-11-28T19:16:57.509 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:57.515 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:57.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:57.595 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-11-28T19:16:58.006 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:58.017 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:58.018 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:58.021 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:58.021 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:58.768 INFO:teuthology.orchestra.run.smithi016.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:16:58.824 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/271 2023-11-28T19:16:58.824 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/271 2023-11-28T19:16:58.824 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:16:58.860 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:16:59.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:16:59.008 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-11-28T19:16:59.410 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:16:59.420 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:16:59.422 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:16:59.424 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:16:59.424 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:00.185 INFO:teuthology.orchestra.run.smithi016.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:00.222 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/272 2023-11-28T19:17:00.223 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/272 2023-11-28T19:17:00.223 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:00.260 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:00.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:00.475 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-11-28T19:17:00.839 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:00.850 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:00.851 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:00.854 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:00.854 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:01.326 INFO:teuthology.orchestra.run.smithi016.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:17:01.335 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/273 2023-11-28T19:17:01.335 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/273 2023-11-28T19:17:01.336 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:01.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:01.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:01.370 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-11-28T19:17:01.766 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:01.777 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:01.778 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:01.780 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:01.780 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:02.231 INFO:teuthology.orchestra.run.smithi016.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T19:17:02.241 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/274 2023-11-28T19:17:02.242 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/274 2023-11-28T19:17:02.242 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:02.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:02.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:02.279 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-11-28T19:17:02.674 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:02.685 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:02.686 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:02.688 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:02.689 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:03.128 INFO:teuthology.orchestra.run.smithi016.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:17:03.137 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/275 2023-11-28T19:17:03.137 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/275 2023-11-28T19:17:03.138 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:03.144 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:03.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:03.175 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-11-28T19:17:03.547 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:03.558 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:03.558 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:03.561 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:03.561 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:04.359 INFO:teuthology.orchestra.run.smithi016.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:04.400 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/276 2023-11-28T19:17:04.401 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/276 2023-11-28T19:17:04.401 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:04.426 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:04.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:04.565 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-11-28T19:17:04.966 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:04.976 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:04.978 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:04.980 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:04.981 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:05.465 INFO:teuthology.orchestra.run.smithi016.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-11-28T19:17:05.474 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/277 2023-11-28T19:17:05.474 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/277 2023-11-28T19:17:05.474 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:05.481 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:05.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:05.515 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-11-28T19:17:05.914 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:05.925 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:05.926 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:05.928 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:05.929 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:06.706 INFO:teuthology.orchestra.run.smithi016.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:06.729 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/278 2023-11-28T19:17:06.729 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/278 2023-11-28T19:17:06.729 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:06.752 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:06.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:06.938 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-11-28T19:17:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:07.344 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:07.345 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:07.348 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:07.349 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:08.129 INFO:teuthology.orchestra.run.smithi016.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:08.193 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/279 2023-11-28T19:17:08.194 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/279 2023-11-28T19:17:08.194 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:08.205 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:08.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:08.345 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-11-28T19:17:08.766 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:08.777 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:08.778 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:08.780 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:08.781 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:09.248 INFO:teuthology.orchestra.run.smithi016.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:17:09.257 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/280 2023-11-28T19:17:09.258 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/280 2023-11-28T19:17:09.258 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:09.264 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:09.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:09.294 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-11-28T19:17:09.674 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:09.685 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:09.686 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:09.688 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:09.688 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:10.450 INFO:teuthology.orchestra.run.smithi016.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:10.538 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/281 2023-11-28T19:17:10.539 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/281 2023-11-28T19:17:10.539 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:10.566 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:10.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:10.692 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-11-28T19:17:11.082 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:11.092 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:11.094 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:11.096 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:11.096 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:11.885 INFO:teuthology.orchestra.run.smithi016.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:11.950 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/282 2023-11-28T19:17:11.950 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/282 2023-11-28T19:17:11.950 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:11.984 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:12.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:12.078 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-11-28T19:17:12.503 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:12.513 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:12.514 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:12.517 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:12.517 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:13.297 INFO:teuthology.orchestra.run.smithi016.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:13.351 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/283 2023-11-28T19:17:13.352 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/283 2023-11-28T19:17:13.352 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:13.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:13.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:13.574 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-11-28T19:17:13.973 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:13.984 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:13.985 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:13.987 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:13.988 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:14.711 INFO:teuthology.orchestra.run.smithi016.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:14.831 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/284 2023-11-28T19:17:14.831 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/284 2023-11-28T19:17:14.832 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:14.878 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:15.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:15.013 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-11-28T19:17:15.405 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:15.415 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:15.417 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:15.419 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:15.419 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:17.345 INFO:teuthology.orchestra.run.smithi016.stdout:generic/285 2s 2023-11-28T19:17:17.357 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/285 2023-11-28T19:17:17.358 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:17.364 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:18.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:18.025 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-11-28T19:17:18.683 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:18.698 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:18.700 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:18.704 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:19.331 INFO:teuthology.orchestra.run.smithi016.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:17:19.343 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/286 2023-11-28T19:17:19.343 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/286 2023-11-28T19:17:19.343 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:19.354 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:19.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:19.401 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-11-28T19:17:19.968 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:19.982 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:19.984 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:19.986 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:19.987 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:20.994 INFO:teuthology.orchestra.run.smithi016.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:21.004 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/287 2023-11-28T19:17:21.004 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/287 2023-11-28T19:17:21.004 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:21.016 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:21.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:21.246 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-11-28T19:17:21.783 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:21.800 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:21.801 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:21.805 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:21.805 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:22.611 INFO:teuthology.orchestra.run.smithi016.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:22.637 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/288 2023-11-28T19:17:22.637 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/288 2023-11-28T19:17:22.637 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:22.645 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:22.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:22.691 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-11-28T19:17:23.218 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:23.228 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:23.229 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:23.232 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:23.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:23.935 INFO:teuthology.orchestra.run.smithi016.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:23.978 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/289 2023-11-28T19:17:23.978 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/289 2023-11-28T19:17:23.978 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:24.026 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:24.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:24.197 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-11-28T19:17:24.618 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:24.629 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:24.630 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:24.632 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:24.633 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:25.316 INFO:teuthology.orchestra.run.smithi016.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:25.333 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/290 2023-11-28T19:17:25.334 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/290 2023-11-28T19:17:25.334 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:25.370 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:25.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:25.622 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-11-28T19:17:26.046 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:26.056 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:26.058 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:26.060 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:26.061 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:26.768 INFO:teuthology.orchestra.run.smithi016.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:26.822 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/291 2023-11-28T19:17:26.822 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/291 2023-11-28T19:17:26.822 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:26.865 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:27.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:27.029 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-11-28T19:17:27.449 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:27.460 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:27.461 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:27.464 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:27.464 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:28.254 INFO:teuthology.orchestra.run.smithi016.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:28.293 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/292 2023-11-28T19:17:28.293 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/292 2023-11-28T19:17:28.293 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:28.306 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:28.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:28.478 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-11-28T19:17:28.894 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:28.905 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:28.906 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:28.909 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:28.909 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:29.685 INFO:teuthology.orchestra.run.smithi016.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:29.745 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/293 2023-11-28T19:17:29.746 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/293 2023-11-28T19:17:29.747 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:29.806 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:29.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:29.934 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-11-28T19:17:30.342 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:30.352 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:30.354 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:30.356 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:30.356 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:31.367 INFO:teuthology.orchestra.run.smithi016.stdout:generic/294 1s 2023-11-28T19:17:31.418 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/294 2023-11-28T19:17:31.421 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:31.447 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:31.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:31.490 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-11-28T19:17:31.906 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:31.916 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:31.917 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:31.920 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:31.920 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:32.696 INFO:teuthology.orchestra.run.smithi016.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:32.755 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/295 2023-11-28T19:17:32.755 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/295 2023-11-28T19:17:32.755 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:32.787 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:32.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:32.925 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-11-28T19:17:33.317 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:33.327 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:33.329 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:33.331 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:33.331 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:34.112 INFO:teuthology.orchestra.run.smithi016.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/296 2023-11-28T19:17:34.160 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/296 2023-11-28T19:17:34.160 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:34.204 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:34.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:34.332 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-11-28T19:17:34.718 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:34.728 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:34.730 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:34.732 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:34.732 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:35.496 INFO:teuthology.orchestra.run.smithi016.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:35.511 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/297 2023-11-28T19:17:35.511 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/297 2023-11-28T19:17:35.511 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:35.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:35.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:35.725 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-11-28T19:17:36.157 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:36.168 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:36.169 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:36.172 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:36.172 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:36.920 INFO:teuthology.orchestra.run.smithi016.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:36.987 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/298 2023-11-28T19:17:36.987 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/298 2023-11-28T19:17:36.987 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:37.053 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:37.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:37.190 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-11-28T19:17:37.583 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:37.594 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:37.595 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:37.597 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:37.598 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:38.202 INFO:teuthology.orchestra.run.smithi016.stdout:generic/299 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:17:38.211 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/299 2023-11-28T19:17:38.211 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/299 2023-11-28T19:17:38.211 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:38.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:38.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:38.251 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-11-28T19:17:38.658 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:38.669 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:38.670 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:38.673 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:38.673 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:39.206 INFO:teuthology.orchestra.run.smithi016.stdout:generic/300 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:17:39.215 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/300 2023-11-28T19:17:39.216 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/300 2023-11-28T19:17:39.216 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:39.222 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:39.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:39.256 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-11-28T19:17:39.658 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:39.669 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:39.670 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:39.672 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:39.672 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:40.367 INFO:teuthology.orchestra.run.smithi016.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:40.450 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/301 2023-11-28T19:17:40.450 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/301 2023-11-28T19:17:40.450 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:40.492 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:40.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:40.655 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-11-28T19:17:41.083 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:41.094 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:41.095 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:41.098 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:41.098 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:41.931 INFO:teuthology.orchestra.run.smithi016.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:41.956 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/302 2023-11-28T19:17:41.956 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/302 2023-11-28T19:17:41.956 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:42.017 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:42.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:42.209 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-11-28T19:17:42.604 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:42.614 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:42.616 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:42.619 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:42.619 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:43.168 INFO:teuthology.orchestra.run.smithi016.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:17:43.177 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/303 2023-11-28T19:17:43.177 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/303 2023-11-28T19:17:43.177 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:43.183 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:43.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:43.407 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-11-28T19:17:43.985 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:49.388 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/304 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/304 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:49.389 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:49.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:49.402 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-11-28T19:17:49.794 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:49.805 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:49.806 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:49.809 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:49.809 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:50.553 INFO:teuthology.orchestra.run.smithi016.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:17:50.622 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/305 2023-11-28T19:17:50.625 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/305 2023-11-28T19:17:50.625 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:50.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:50.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:50.766 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-11-28T19:17:51.190 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:51.200 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:51.201 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:51.204 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:51.204 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:52.329 INFO:teuthology.orchestra.run.smithi016.stdout:generic/306 1s 2023-11-28T19:17:52.366 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/306 2023-11-28T19:17:52.367 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:52.384 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:52.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:52.588 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-11-28T19:17:53.158 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:53.168 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:53.170 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:53.172 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:53.173 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:55.033 INFO:teuthology.orchestra.run.smithi016.stdout:generic/307 2s 2023-11-28T19:17:55.046 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/307 2023-11-28T19:17:55.046 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:55.053 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:55.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:55.072 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-11-28T19:17:55.466 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:55.477 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:55.478 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:55.480 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:55.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:55.995 INFO:teuthology.orchestra.run.smithi016.stdout:generic/308 0s 2023-11-28T19:17:56.008 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/308 2023-11-28T19:17:56.009 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:56.015 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:56.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:56.049 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-11-28T19:17:56.438 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:56.449 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:56.450 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:56.453 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:56.453 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:58.013 INFO:teuthology.orchestra.run.smithi016.stdout:generic/309 2s 2023-11-28T19:17:58.026 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/309 2023-11-28T19:17:58.026 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:17:58.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:17:58.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:17:58.205 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-11-28T19:17:58.782 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:17:58.793 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:17:58.794 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:17:58.797 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:17:58.797 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:18:26.989 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:18:26.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:18:57.069 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:18:57.074 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:19:27.134 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:19:27.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:19:49.099 INFO:teuthology.orchestra.run.smithi016.stdout:generic/310 111s 2023-11-28T19:19:49.112 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/310 2023-11-28T19:19:49.112 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:19:49.119 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:49.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:19:49.468 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-11-28T19:19:49.918 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:19:49.929 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:19:49.930 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:19:49.932 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:19:49.932 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:50.499 INFO:teuthology.orchestra.run.smithi016.stdout:generic/311 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:19:50.509 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/311 2023-11-28T19:19:50.509 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/311 2023-11-28T19:19:50.509 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:19:50.515 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:50.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:19:50.549 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-11-28T19:19:50.942 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:19:50.953 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:19:50.954 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:19:50.957 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:19:50.957 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:51.392 INFO:teuthology.orchestra.run.smithi016.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:19:51.401 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/312 2023-11-28T19:19:51.402 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/312 2023-11-28T19:19:51.402 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:19:51.408 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:51.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:19:51.442 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-11-28T19:19:51.810 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:19:51.821 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:19:51.822 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:19:51.825 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:19:51.825 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:56.327 INFO:teuthology.orchestra.run.smithi016.stdout:generic/313 5s 2023-11-28T19:19:59.529 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:19:59.532 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/313 2023-11-28T19:19:59.532 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:19:59.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:19:59.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:19:59.533 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-11-28T19:19:59.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:19:59.962 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:19:59.972 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:19:59.974 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:19:59.976 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:19:59.977 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:00.796 INFO:teuthology.orchestra.run.smithi016.stdout:generic/314 0s 2023-11-28T19:20:00.809 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/314 2023-11-28T19:20:00.810 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:00.816 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:00.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:00.855 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-11-28T19:20:01.231 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:01.242 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:01.243 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:01.246 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:01.246 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:01.693 INFO:teuthology.orchestra.run.smithi016.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T19:20:01.702 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/315 2023-11-28T19:20:01.702 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/315 2023-11-28T19:20:01.702 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:01.708 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:01.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:01.744 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-11-28T19:20:02.125 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:02.136 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:02.137 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:02.140 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:02.140 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:02.788 INFO:teuthology.orchestra.run.smithi016.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T19:20:02.797 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/316 2023-11-28T19:20:02.798 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/316 2023-11-28T19:20:02.798 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:02.803 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:02.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:02.978 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-11-28T19:20:03.558 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:03.569 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:03.570 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:03.572 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:03.573 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:05.432 INFO:teuthology.orchestra.run.smithi016.stdout:generic/317 2s 2023-11-28T19:20:05.445 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/317 2023-11-28T19:20:05.446 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:05.452 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:05.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:05.471 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-11-28T19:20:05.859 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:05.869 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:05.870 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:05.873 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:05.873 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:07.020 INFO:teuthology.orchestra.run.smithi016.stdout:generic/318 1s 2023-11-28T19:20:07.034 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/318 2023-11-28T19:20:07.034 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:07.040 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:07.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:07.060 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-11-28T19:20:07.457 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:07.467 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:07.469 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:07.471 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:07.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:08.134 INFO:teuthology.orchestra.run.smithi016.stdout:generic/319 1s 2023-11-28T19:20:08.147 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/319 2023-11-28T19:20:08.148 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:08.154 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:08.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:08.175 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-11-28T19:20:08.581 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:08.592 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:08.593 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:08.596 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:08.596 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:09.054 INFO:teuthology.orchestra.run.smithi016.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:20:09.063 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/320 2023-11-28T19:20:09.063 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/320 2023-11-28T19:20:09.063 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:09.069 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:09.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:09.097 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-11-28T19:20:09.478 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:09.488 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:09.489 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:09.492 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:09.492 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:09.945 INFO:teuthology.orchestra.run.smithi016.stdout:generic/321 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:20:09.954 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/321 2023-11-28T19:20:09.955 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/321 2023-11-28T19:20:09.955 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:09.961 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:09.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:09.989 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-11-28T19:20:10.372 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:10.382 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:10.383 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:10.386 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:10.386 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:10.841 INFO:teuthology.orchestra.run.smithi016.stdout:generic/322 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:20:10.850 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/322 2023-11-28T19:20:10.850 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/322 2023-11-28T19:20:10.851 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:20:10.857 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:10.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:20:10.884 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-11-28T19:20:11.266 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:20:11.276 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:20:11.277 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:20:11.280 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:20:11.280 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:20:29.640 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:20:29.645 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:20:59.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:20:59.725 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:21:29.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:21:29.791 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:22:01.276 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:22:01.282 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:22:01.315 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T19:22:01.309+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45830) UID: 0 2023-11-28T19:22:01.315 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T19:22:01.309+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45830) UID: 0 2023-11-28T19:22:01.315 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T19:22:01.309+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45830) UID: 0 2023-11-28T19:22:01.316 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T19:22:01.309+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45830) UID: 0 2023-11-28T19:22:12.406 INFO:teuthology.orchestra.run.smithi016.stdout:generic/323 121s 2023-11-28T19:22:12.419 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/323 2023-11-28T19:22:12.419 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:12.425 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:12.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:12.626 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-11-28T19:22:13.198 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:13.209 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:13.210 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:13.213 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:13.213 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:13.666 INFO:teuthology.orchestra.run.smithi016.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-11-28T19:22:13.675 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/324 2023-11-28T19:22:13.675 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/324 2023-11-28T19:22:13.675 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:13.681 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:13.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:13.709 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-11-28T19:22:14.097 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:14.108 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:14.109 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:14.112 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:14.112 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:14.555 INFO:teuthology.orchestra.run.smithi016.stdout:generic/325 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:22:14.565 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/325 2023-11-28T19:22:14.565 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/325 2023-11-28T19:22:14.565 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:14.572 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:14.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:14.600 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-11-28T19:22:14.990 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:15.000 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:15.001 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:15.004 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:15.004 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:15.711 INFO:teuthology.orchestra.run.smithi016.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:15.756 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/326 2023-11-28T19:22:15.757 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/326 2023-11-28T19:22:15.757 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:15.771 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:16.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:16.024 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-11-28T19:22:16.421 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:16.432 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:16.433 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:16.435 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:16.436 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:17.143 INFO:teuthology.orchestra.run.smithi016.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:17.183 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/327 2023-11-28T19:22:17.183 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/327 2023-11-28T19:22:17.183 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:17.233 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:17.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:17.461 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-11-28T19:22:17.854 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:17.864 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:17.865 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:17.868 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:17.868 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:18.597 INFO:teuthology.orchestra.run.smithi016.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:18.660 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/328 2023-11-28T19:22:18.661 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/328 2023-11-28T19:22:18.661 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:18.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:18.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:18.904 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-11-28T19:22:19.305 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:19.317 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:19.317 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:19.320 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:19.320 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:20.117 INFO:teuthology.orchestra.run.smithi016.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:20.155 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/329 2023-11-28T19:22:20.155 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/329 2023-11-28T19:22:20.155 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:20.175 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:20.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:20.365 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-11-28T19:22:20.773 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:20.783 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:20.785 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:20.787 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:20.787 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:21.572 INFO:teuthology.orchestra.run.smithi016.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/330 2023-11-28T19:22:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/330 2023-11-28T19:22:21.638 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:21.706 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:21.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:21.826 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-11-28T19:22:22.226 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:22.236 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:22.237 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:22.240 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:22.240 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:23.074 INFO:teuthology.orchestra.run.smithi016.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:23.135 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/331 2023-11-28T19:22:23.136 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/331 2023-11-28T19:22:23.136 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:23.149 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:23.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:23.306 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-11-28T19:22:23.698 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:23.708 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:23.709 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:23.712 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:23.712 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:24.470 INFO:teuthology.orchestra.run.smithi016.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:24.549 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/332 2023-11-28T19:22:24.549 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/332 2023-11-28T19:22:24.549 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:24.615 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:24.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:24.747 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-11-28T19:22:25.125 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:25.136 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:25.137 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:25.139 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:25.139 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:25.930 INFO:teuthology.orchestra.run.smithi016.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:26.015 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/333 2023-11-28T19:22:26.015 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/333 2023-11-28T19:22:26.016 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:26.078 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:26.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:26.156 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-11-28T19:22:26.566 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:26.576 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:26.578 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:26.580 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:26.580 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:27.310 INFO:teuthology.orchestra.run.smithi016.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:22:27.363 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/334 2023-11-28T19:22:27.363 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/334 2023-11-28T19:22:27.363 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:27.417 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:27.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:27.598 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-11-28T19:22:27.997 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:28.008 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:28.009 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:28.012 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:28.012 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:28.483 INFO:teuthology.orchestra.run.smithi016.stdout:generic/335 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:22:28.492 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/335 2023-11-28T19:22:28.492 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/335 2023-11-28T19:22:28.492 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:28.499 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:28.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:28.531 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-11-28T19:22:28.927 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:28.938 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:28.939 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:28.941 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:28.942 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:29.467 INFO:teuthology.orchestra.run.smithi016.stdout:generic/336 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:22:29.476 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/336 2023-11-28T19:22:29.476 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/336 2023-11-28T19:22:29.476 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:29.482 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:29.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:29.512 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-11-28T19:22:29.906 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:29.916 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:29.917 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:29.920 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:29.920 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:30.671 INFO:teuthology.orchestra.run.smithi016.stdout:generic/337 0s 2023-11-28T19:22:30.685 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/337 2023-11-28T19:22:30.685 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:30.692 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:30.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:30.712 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-11-28T19:22:31.105 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:31.116 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:31.117 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:31.120 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:31.120 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:31.577 INFO:teuthology.orchestra.run.smithi016.stdout:generic/338 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:22:31.586 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/338 2023-11-28T19:22:31.586 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/338 2023-11-28T19:22:31.586 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:22:31.592 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:22:31.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:22:31.626 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-11-28T19:22:32.021 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:22:32.031 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:22:32.033 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:22:32.035 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:22:32.035 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:24:08.467 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:24:08.472 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:24:38.562 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:24:38.566 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:25:11.727 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:25:13.912 INFO:teuthology.orchestra.run.smithi016.stdout:generic/339 159s 2023-11-28T19:25:13.913 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/339 2023-11-28T19:25:13.913 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:13.913 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:13.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:13.913 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-11-28T19:25:13.959 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:25:14.357 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:14.368 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:14.369 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:14.371 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:14.372 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:20.029 INFO:teuthology.orchestra.run.smithi016.stdout:generic/340 5s 2023-11-28T19:25:20.061 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/340 2023-11-28T19:25:20.061 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:20.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:20.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:20.120 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-11-28T19:25:20.717 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:20.727 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:20.728 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:20.731 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:20.731 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:21.161 INFO:teuthology.orchestra.run.smithi016.stdout:generic/341 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:25:21.170 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/341 2023-11-28T19:25:21.170 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/341 2023-11-28T19:25:21.170 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:21.176 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:21.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:21.204 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-11-28T19:25:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:21.610 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:21.611 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:21.614 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:21.614 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:22.099 INFO:teuthology.orchestra.run.smithi016.stdout:generic/342 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:25:22.108 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/342 2023-11-28T19:25:22.108 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/342 2023-11-28T19:25:22.108 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:22.118 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:22.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:22.143 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-11-28T19:25:22.531 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:22.541 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:22.542 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:22.545 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:22.545 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:23.026 INFO:teuthology.orchestra.run.smithi016.stdout:generic/343 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:25:23.036 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/343 2023-11-28T19:25:23.036 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/343 2023-11-28T19:25:23.036 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:23.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:23.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:23.070 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-11-28T19:25:23.465 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:23.476 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:23.477 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:23.480 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:23.480 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:33.741 INFO:teuthology.orchestra.run.smithi016.stdout:generic/344 10s 2023-11-28T19:25:33.781 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/344 2023-11-28T19:25:33.781 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:33.816 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:33.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:33.871 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-11-28T19:25:34.407 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:34.427 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:34.428 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:34.433 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:34.433 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:45.954 INFO:teuthology.orchestra.run.smithi016.stdout:generic/345 11s 2023-11-28T19:25:45.998 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/345 2023-11-28T19:25:45.998 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:46.016 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:46.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:46.125 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-11-28T19:25:46.733 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:46.745 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:46.747 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:46.751 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:46.751 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:47.818 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:25:47.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:25:51.988 INFO:teuthology.orchestra.run.smithi016.stdout:generic/346 4s 2023-11-28T19:25:52.079 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/346 2023-11-28T19:25:52.079 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:52.102 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:52.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:52.139 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-11-28T19:25:52.727 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:52.748 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:52.749 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:52.752 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:52.752 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:53.266 INFO:teuthology.orchestra.run.smithi016.stdout:generic/347 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:25:53.275 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/347 2023-11-28T19:25:53.275 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/347 2023-11-28T19:25:53.275 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:53.281 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:53.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:53.309 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-11-28T19:25:53.699 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:53.708 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:53.710 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:53.712 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:53.712 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:54.203 INFO:teuthology.orchestra.run.smithi016.stdout:generic/348 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:25:54.213 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/348 2023-11-28T19:25:54.213 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/348 2023-11-28T19:25:54.213 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:54.219 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:54.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:54.252 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-11-28T19:25:54.651 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:54.662 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:54.663 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:54.666 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:54.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:55.268 INFO:teuthology.orchestra.run.smithi016.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T19:25:55.277 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/349 2023-11-28T19:25:55.278 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/349 2023-11-28T19:25:55.278 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:55.284 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:55.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:55.321 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-11-28T19:25:55.706 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:55.716 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:55.717 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:55.720 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:55.720 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:57.260 INFO:teuthology.orchestra.run.smithi016.stdout:generic/350 2s 2023-11-28T19:25:57.273 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/350 2023-11-28T19:25:57.273 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:57.279 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:57.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:57.299 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-11-28T19:25:57.675 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:57.686 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:57.687 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:57.689 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:57.690 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:58.152 INFO:teuthology.orchestra.run.smithi016.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:25:58.162 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/351 2023-11-28T19:25:58.162 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/351 2023-11-28T19:25:58.162 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:58.169 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:58.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:58.237 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-11-28T19:25:58.644 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:25:58.655 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:25:58.656 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:25:58.659 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:25:58.659 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:59.360 INFO:teuthology.orchestra.run.smithi016.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:25:59.420 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/352 2023-11-28T19:25:59.421 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/352 2023-11-28T19:25:59.421 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:25:59.439 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:25:59.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:25:59.638 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-11-28T19:26:00.063 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:00.073 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:00.074 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:00.077 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:00.077 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:00.808 INFO:teuthology.orchestra.run.smithi016.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:26:00.854 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/353 2023-11-28T19:26:00.854 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/353 2023-11-28T19:26:00.854 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:00.900 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:01.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:01.132 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-11-28T19:26:01.522 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:01.532 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:01.533 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:01.535 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:01.535 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:12.678 INFO:teuthology.orchestra.run.smithi016.stdout:generic/354 11s 2023-11-28T19:26:12.714 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/354 2023-11-28T19:26:12.715 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:12.725 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:12.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:12.764 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-11-28T19:26:13.228 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:13.247 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:13.249 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:13.253 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:13.253 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:14.446 INFO:teuthology.orchestra.run.smithi016.stdout:generic/355 1s 2023-11-28T19:26:14.459 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/355 2023-11-28T19:26:14.459 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:14.466 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:14.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:14.628 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-11-28T19:26:15.205 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:15.216 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:15.217 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:15.219 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:15.220 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:15.846 INFO:teuthology.orchestra.run.smithi016.stdout:generic/356 [not run] swapfiles are not supported 2023-11-28T19:26:15.854 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/356 2023-11-28T19:26:15.854 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/356 2023-11-28T19:26:15.854 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:15.861 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:15.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:15.891 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-11-28T19:26:16.279 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:16.290 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:16.291 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:16.294 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:16.294 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:16.931 INFO:teuthology.orchestra.run.smithi016.stdout:generic/357 [not run] swapfiles are not supported 2023-11-28T19:26:16.940 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/357 2023-11-28T19:26:16.940 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/357 2023-11-28T19:26:16.940 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:16.946 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:16.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:16.977 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-11-28T19:26:17.390 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:17.400 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:17.401 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:17.404 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:17.404 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:17.879 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:26:17.883 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:26:18.122 INFO:teuthology.orchestra.run.smithi016.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:26:18.146 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/358 2023-11-28T19:26:18.146 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/358 2023-11-28T19:26:18.146 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:18.163 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:18.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:18.416 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-11-28T19:26:18.807 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:18.818 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:18.819 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:18.822 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:19.554 INFO:teuthology.orchestra.run.smithi016.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:26:19.634 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/359 2023-11-28T19:26:19.635 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/359 2023-11-28T19:26:19.635 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:19.662 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:19.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:19.867 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-11-28T19:26:20.254 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:20.264 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:20.265 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:20.268 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:20.268 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:20.785 INFO:teuthology.orchestra.run.smithi016.stdout:generic/360 0s 2023-11-28T19:26:20.799 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/360 2023-11-28T19:26:20.799 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:20.805 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:20.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:20.889 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-11-28T19:26:21.286 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:21.296 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:21.298 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:21.300 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:21.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:21.774 INFO:teuthology.orchestra.run.smithi016.stdout:generic/361 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:26:21.781 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/361 2023-11-28T19:26:21.781 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/361 2023-11-28T19:26:21.781 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:21.788 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:21.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:21.816 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-11-28T19:26:22.182 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:22.192 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:22.193 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:22.196 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:22.196 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:22.611 INFO:teuthology.orchestra.run.smithi016.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:22.621 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/362 2023-11-28T19:26:22.621 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/362 2023-11-28T19:26:22.621 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:22.627 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:22.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:22.656 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-11-28T19:26:23.046 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:23.056 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:23.057 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:23.060 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:23.060 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:23.484 INFO:teuthology.orchestra.run.smithi016.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:30.324 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/363 2023-11-28T19:26:30.325 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/363 2023-11-28T19:26:30.325 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:30.325 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:30.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:30.325 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-11-28T19:26:30.730 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:30.741 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:30.742 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:30.744 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:30.744 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:31.157 INFO:teuthology.orchestra.run.smithi016.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:31.166 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/364 2023-11-28T19:26:31.166 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/364 2023-11-28T19:26:31.166 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:31.173 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:31.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:31.201 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-11-28T19:26:31.574 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:31.585 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:31.586 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:31.589 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:31.589 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:32.007 INFO:teuthology.orchestra.run.smithi016.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:32.016 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/365 2023-11-28T19:26:32.016 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/365 2023-11-28T19:26:32.016 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:32.022 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:32.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:32.051 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-11-28T19:26:32.437 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:32.448 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:32.449 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:32.452 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:32.452 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:32.867 INFO:teuthology.orchestra.run.smithi016.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:32.876 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/366 2023-11-28T19:26:32.876 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/366 2023-11-28T19:26:32.876 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:32.883 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:32.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:32.912 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-11-28T19:26:33.302 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:33.312 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:33.314 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:33.316 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:33.316 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:33.727 INFO:teuthology.orchestra.run.smithi016.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:33.736 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/367 2023-11-28T19:26:33.736 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/367 2023-11-28T19:26:33.736 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:33.743 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:33.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:33.773 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-11-28T19:26:34.153 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:34.164 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:34.165 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:34.168 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:34.168 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:34.583 INFO:teuthology.orchestra.run.smithi016.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:34.592 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/368 2023-11-28T19:26:34.593 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/368 2023-11-28T19:26:34.593 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:34.599 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:34.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:34.627 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-11-28T19:26:35.017 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:35.028 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:35.029 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:35.032 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:35.032 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:35.454 INFO:teuthology.orchestra.run.smithi016.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:35.463 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/369 2023-11-28T19:26:35.463 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/369 2023-11-28T19:26:35.463 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:35.470 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:35.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:35.498 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-11-28T19:26:35.878 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:35.889 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:35.890 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:35.892 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:35.892 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:36.309 INFO:teuthology.orchestra.run.smithi016.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T19:26:36.318 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/370 2023-11-28T19:26:36.318 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/370 2023-11-28T19:26:36.318 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:36.326 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:36.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:36.353 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-11-28T19:26:36.729 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:36.740 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:36.741 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:36.745 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:36.745 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:37.202 INFO:teuthology.orchestra.run.smithi016.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:26:37.212 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/371 2023-11-28T19:26:37.212 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/371 2023-11-28T19:26:37.212 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:37.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:37.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:37.252 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-11-28T19:26:37.623 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:37.634 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:37.635 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:37.638 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:37.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:38.391 INFO:teuthology.orchestra.run.smithi016.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:26:38.436 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/372 2023-11-28T19:26:38.436 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/372 2023-11-28T19:26:38.436 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:38.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:38.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:38.630 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-11-28T19:26:39.018 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:39.029 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:39.030 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:39.032 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:39.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:39.745 INFO:teuthology.orchestra.run.smithi016.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:26:39.799 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/373 2023-11-28T19:26:39.799 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/373 2023-11-28T19:26:39.799 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:39.826 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:40.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:40.011 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-11-28T19:26:40.407 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:40.418 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:40.421 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:40.422 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:40.422 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:41.044 INFO:teuthology.orchestra.run.smithi016.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T19:26:41.166 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/374 2023-11-28T19:26:41.166 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/374 2023-11-28T19:26:41.166 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:41.200 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:41.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:41.461 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-11-28T19:26:41.869 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:41.880 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:41.881 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:41.884 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:41.884 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:42.481 INFO:teuthology.orchestra.run.smithi016.stdout:generic/375 0s 2023-11-28T19:26:42.494 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/375 2023-11-28T19:26:42.494 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:42.500 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:42.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:42.658 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-11-28T19:26:43.253 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:43.263 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:43.265 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:43.268 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:43.268 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:43.743 INFO:teuthology.orchestra.run.smithi016.stdout:generic/376 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:26:43.752 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/376 2023-11-28T19:26:43.752 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/376 2023-11-28T19:26:43.752 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:43.758 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:43.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:43.787 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-11-28T19:26:44.162 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:44.172 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:44.173 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:44.176 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:44.176 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:44.843 INFO:teuthology.orchestra.run.smithi016.stdout:generic/377 0s 2023-11-28T19:26:44.856 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/377 2023-11-28T19:26:44.857 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:44.863 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:44.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:44.883 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-11-28T19:26:45.271 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:45.281 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:45.282 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:45.285 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:45.285 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:46.159 INFO:teuthology.orchestra.run.smithi016.stdout:generic/378 1s 2023-11-28T19:26:46.173 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/378 2023-11-28T19:26:46.173 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:46.179 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:46.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:46.337 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-11-28T19:26:46.913 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:46.923 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:46.925 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:46.927 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:46.928 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:47.384 INFO:teuthology.orchestra.run.smithi016.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:47.393 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/379 2023-11-28T19:26:47.393 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/379 2023-11-28T19:26:47.393 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:47.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:47.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:47.430 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-11-28T19:26:47.826 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:47.836 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:47.838 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:47.840 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:47.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:47.946 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:26:47.950 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:26:48.260 INFO:teuthology.orchestra.run.smithi016.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:48.269 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/380 2023-11-28T19:26:48.270 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/380 2023-11-28T19:26:48.270 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:48.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:48.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:48.305 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-11-28T19:26:48.686 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:48.697 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:48.698 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:48.700 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:48.700 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:49.149 INFO:teuthology.orchestra.run.smithi016.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:49.158 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/381 2023-11-28T19:26:49.158 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/381 2023-11-28T19:26:49.159 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:49.165 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:49.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:49.193 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-11-28T19:26:49.614 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:49.625 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:49.626 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:49.628 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:49.628 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:50.070 INFO:teuthology.orchestra.run.smithi016.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:50.079 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/382 2023-11-28T19:26:50.080 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/382 2023-11-28T19:26:50.080 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:50.085 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:50.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:50.115 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-11-28T19:26:50.506 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:50.517 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:50.518 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:50.521 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:50.521 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:50.963 INFO:teuthology.orchestra.run.smithi016.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:50.972 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/383 2023-11-28T19:26:50.973 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/383 2023-11-28T19:26:50.973 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:50.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:51.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:51.007 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-11-28T19:26:51.401 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:51.412 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:51.413 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:51.415 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:51.415 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:51.854 INFO:teuthology.orchestra.run.smithi016.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:51.863 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/384 2023-11-28T19:26:51.863 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/384 2023-11-28T19:26:51.864 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:51.869 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:51.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:51.899 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-11-28T19:26:52.318 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:52.328 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:52.330 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:52.332 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:52.413 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:52.753 INFO:teuthology.orchestra.run.smithi016.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:52.761 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/385 2023-11-28T19:26:52.762 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/385 2023-11-28T19:26:52.762 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:52.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:52.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:52.798 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-11-28T19:26:53.186 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:53.197 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:53.198 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:53.200 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:53.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:53.619 INFO:teuthology.orchestra.run.smithi016.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:26:53.629 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/386 2023-11-28T19:26:53.629 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/386 2023-11-28T19:26:53.629 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:53.635 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:53.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:53.664 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-11-28T19:26:54.050 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:54.061 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:54.062 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:54.064 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:54.064 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:54.767 INFO:teuthology.orchestra.run.smithi016.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:26:54.840 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/387 2023-11-28T19:26:54.840 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/387 2023-11-28T19:26:54.840 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:54.861 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:55.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:55.060 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-11-28T19:26:55.441 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:55.452 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:55.453 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:55.455 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:55.456 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:55.913 INFO:teuthology.orchestra.run.smithi016.stdout:generic/388 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-11-28T19:26:55.922 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/388 2023-11-28T19:26:55.923 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/388 2023-11-28T19:26:55.923 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:55.929 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:55.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:55.958 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-11-28T19:26:56.319 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:56.329 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:56.330 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:56.333 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:56.333 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:56.792 INFO:teuthology.orchestra.run.smithi016.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-28T19:26:56.801 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/389 2023-11-28T19:26:56.801 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/389 2023-11-28T19:26:56.801 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:56.807 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:56.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:56.837 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-11-28T19:26:57.229 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:57.239 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:57.241 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:57.243 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:57.243 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:57.704 INFO:teuthology.orchestra.run.smithi016.stdout:generic/390 [not run] ceph does not support freezing 2023-11-28T19:26:57.713 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/390 2023-11-28T19:26:57.714 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/390 2023-11-28T19:26:57.714 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:57.720 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:57.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:57.749 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-11-28T19:26:58.134 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:58.143 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:58.145 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:58.147 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:58.147 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:58.609 INFO:teuthology.orchestra.run.smithi016.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:26:58.618 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/391 2023-11-28T19:26:58.618 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/391 2023-11-28T19:26:58.618 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:58.624 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:58.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:58.701 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-11-28T19:26:59.105 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:26:59.116 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:26:59.117 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:26:59.120 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:26:59.120 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:59.680 INFO:teuthology.orchestra.run.smithi016.stdout:generic/392 [not run] ceph does not support shutdown 2023-11-28T19:26:59.696 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/392 2023-11-28T19:26:59.696 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/392 2023-11-28T19:26:59.696 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:26:59.702 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:26:59.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:26:59.785 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-11-28T19:27:00.177 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:00.188 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:00.189 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:00.192 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:00.192 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:01.299 INFO:teuthology.orchestra.run.smithi016.stdout:generic/393 1s 2023-11-28T19:27:01.312 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/393 2023-11-28T19:27:01.313 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:01.319 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:01.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:01.339 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-11-28T19:27:01.726 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:01.737 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:01.738 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:01.740 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:01.740 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:02.271 INFO:teuthology.orchestra.run.smithi016.stdout:generic/394 1s 2023-11-28T19:27:02.284 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/394 2023-11-28T19:27:02.284 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:02.291 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:02.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:02.463 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-11-28T19:27:03.010 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:03.020 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:03.022 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:03.024 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:03.024 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:05.116 INFO:teuthology.orchestra.run.smithi016.stdout:generic/395 2s 2023-11-28T19:27:05.184 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/395 2023-11-28T19:27:05.184 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:05.209 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:05.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:05.268 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-11-28T19:27:05.654 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:05.664 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:05.665 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:05.668 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:05.668 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:06.620 INFO:teuthology.orchestra.run.smithi016.stdout:generic/396 1s 2023-11-28T19:27:06.633 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/396 2023-11-28T19:27:06.634 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:06.640 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:06.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:06.659 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-11-28T19:27:07.058 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:07.069 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:07.070 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:07.072 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:07.073 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:09.000 INFO:teuthology.orchestra.run.smithi016.stdout:generic/397 1s 2023-11-28T19:27:09.013 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/397 2023-11-28T19:27:09.013 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:09.020 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:09.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:09.040 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-11-28T19:27:09.434 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:09.445 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:09.446 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:09.449 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:09.449 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:10.296 INFO:teuthology.orchestra.run.smithi016.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-11-28T19:27:10.305 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/398 2023-11-28T19:27:10.305 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/398 2023-11-28T19:27:10.306 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:10.312 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:10.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:10.431 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-11-28T19:27:11.046 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:11.057 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:11.058 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:11.061 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:11.061 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:11.807 INFO:teuthology.orchestra.run.smithi016.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-11-28T19:27:11.816 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/399 2023-11-28T19:27:11.816 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/399 2023-11-28T19:27:11.817 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:11.823 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:11.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:11.855 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-11-28T19:27:12.234 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:12.245 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:12.246 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:12.248 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:12.248 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:12.662 INFO:teuthology.orchestra.run.smithi016.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:27:12.671 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/400 2023-11-28T19:27:12.671 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/400 2023-11-28T19:27:12.671 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:12.678 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:12.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:12.754 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-11-28T19:27:13.141 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:13.152 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:13.153 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:13.157 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:13.158 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:14.130 INFO:teuthology.orchestra.run.smithi016.stdout:generic/401 1s 2023-11-28T19:27:14.200 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/401 2023-11-28T19:27:14.200 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:14.217 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:14.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:14.267 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-11-28T19:27:14.686 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:14.697 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:14.698 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:14.701 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:14.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:15.335 INFO:teuthology.orchestra.run.smithi016.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-11-28T19:27:15.351 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/402 2023-11-28T19:27:15.351 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/402 2023-11-28T19:27:15.351 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:15.357 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:15.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:15.383 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-11-28T19:27:15.782 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:15.793 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:15.794 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:15.797 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:15.797 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:16.860 INFO:teuthology.orchestra.run.smithi016.stdout:generic/403 1s 2023-11-28T19:27:16.874 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/403 2023-11-28T19:27:16.874 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:16.880 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:16.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:16.900 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-11-28T19:27:17.282 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:17.293 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:17.294 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:17.296 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:17.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:17.757 INFO:teuthology.orchestra.run.smithi016.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:27:17.766 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/404 2023-11-28T19:27:17.766 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/404 2023-11-28T19:27:17.766 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:17.773 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:17.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:17.839 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-11-28T19:27:18.020 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:27:18.023 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:27:18.234 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:18.245 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:18.246 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:18.249 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:18.249 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:18.719 INFO:teuthology.orchestra.run.smithi016.stdout:generic/405 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T19:27:18.728 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/405 2023-11-28T19:27:18.728 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/405 2023-11-28T19:27:18.728 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:18.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:18.763 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-11-28T19:27:19.154 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:19.165 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:19.166 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:19.168 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:19.168 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:21.162 INFO:teuthology.orchestra.run.smithi016.stdout:generic/406 2s 2023-11-28T19:27:21.175 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/406 2023-11-28T19:27:21.175 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:21.182 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:21.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:21.201 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-11-28T19:27:21.589 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:21.600 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:21.601 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:21.603 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:21.604 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:22.148 INFO:teuthology.orchestra.run.smithi016.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:27:22.163 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/407 2023-11-28T19:27:22.163 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/407 2023-11-28T19:27:22.164 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:22.174 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:22.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:22.421 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-11-28T19:27:22.958 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:22.969 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:22.970 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:22.972 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:22.973 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:23.493 INFO:teuthology.orchestra.run.smithi016.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:27:23.503 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/408 2023-11-28T19:27:23.503 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/408 2023-11-28T19:27:23.503 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:23.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:23.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:23.705 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-11-28T19:27:24.266 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:24.277 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:24.278 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:24.280 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:24.281 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:24.740 INFO:teuthology.orchestra.run.smithi016.stdout:generic/409 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-11-28T19:27:24.749 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/409 2023-11-28T19:27:24.749 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/409 2023-11-28T19:27:24.749 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:24.757 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:24.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:24.784 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-11-28T19:27:25.187 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:25.197 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:25.198 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:25.201 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:25.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:25.656 INFO:teuthology.orchestra.run.smithi016.stdout:generic/410 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-11-28T19:27:25.665 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/410 2023-11-28T19:27:25.665 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/410 2023-11-28T19:27:25.665 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:25.672 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:25.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:25.701 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-11-28T19:27:26.098 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:26.108 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:26.109 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:26.112 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:26.112 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:26.566 INFO:teuthology.orchestra.run.smithi016.stdout:generic/411 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-11-28T19:27:26.575 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/411 2023-11-28T19:27:26.575 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/411 2023-11-28T19:27:26.576 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:26.582 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:26.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:26.610 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-11-28T19:27:26.995 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:27.005 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:27.006 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:27.009 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:27.009 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:27.793 INFO:teuthology.orchestra.run.smithi016.stdout:generic/412 0s 2023-11-28T19:27:27.806 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/412 2023-11-28T19:27:27.807 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:27.813 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:27.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:27.834 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-11-28T19:27:28.228 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:28.239 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:28.240 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:28.243 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:28.243 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:28.824 INFO:teuthology.orchestra.run.smithi016.stdout:generic/413 [not run] mount 172.21.15.16:6789:/scratch with dax failed 2023-11-28T19:27:28.833 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/413 2023-11-28T19:27:28.834 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/413 2023-11-28T19:27:28.834 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:28.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:28.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:28.867 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-11-28T19:27:29.260 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:29.271 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:29.272 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:29.274 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:29.274 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:29.981 INFO:teuthology.orchestra.run.smithi016.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:27:30.014 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/414 2023-11-28T19:27:30.014 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/414 2023-11-28T19:27:30.014 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:30.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:30.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:30.230 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-11-28T19:27:30.637 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:30.648 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:30.649 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:30.651 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:30.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:31.353 INFO:teuthology.orchestra.run.smithi016.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T19:27:31.409 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/415 2023-11-28T19:27:31.409 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/415 2023-11-28T19:27:31.410 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:31.476 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:31.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:31.656 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-11-28T19:27:32.058 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:32.069 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:32.070 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:32.072 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:32.073 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:32.517 INFO:teuthology.orchestra.run.smithi016.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:27:32.526 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/416 2023-11-28T19:27:32.527 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/416 2023-11-28T19:27:32.527 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:32.533 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:32.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:32.561 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-11-28T19:27:32.939 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:32.949 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:32.953 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:32.953 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:32.954 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:33.508 INFO:teuthology.orchestra.run.smithi016.stdout:generic/417 [not run] ceph does not support shutdown 2023-11-28T19:27:33.523 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/417 2023-11-28T19:27:33.523 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/417 2023-11-28T19:27:33.523 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:33.530 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:33.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:33.556 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-11-28T19:27:33.945 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:33.956 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:33.957 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:33.960 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:33.960 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:34.455 INFO:teuthology.orchestra.run.smithi016.stdout:generic/418 [not run] require 172.21.15.16:6789:/test to be valid block disk 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/418 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/418 2023-11-28T19:27:34.465 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:34.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:34.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:34.504 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-11-28T19:27:34.873 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:34.884 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:34.885 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:34.887 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:34.887 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:35.657 INFO:teuthology.orchestra.run.smithi016.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-11-28T19:27:35.666 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/419 2023-11-28T19:27:35.666 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/419 2023-11-28T19:27:35.667 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:35.672 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:35.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:35.822 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-11-28T19:27:36.409 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:36.419 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:36.420 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:36.423 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:36.423 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:37.074 INFO:teuthology.orchestra.run.smithi016.stdout:generic/420 1s 2023-11-28T19:27:37.087 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/420 2023-11-28T19:27:37.087 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:37.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:37.232 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-11-28T19:27:37.854 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:37.865 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:37.866 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:37.868 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:37.868 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:44.459 INFO:teuthology.orchestra.run.smithi016.stdout:generic/421 6s 2023-11-28T19:27:44.506 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/421 2023-11-28T19:27:44.506 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:44.521 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:44.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:44.569 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-11-28T19:27:44.978 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:44.988 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:44.989 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:44.992 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:44.992 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:45.455 INFO:teuthology.orchestra.run.smithi016.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T19:27:45.464 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/422 2023-11-28T19:27:45.465 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/422 2023-11-28T19:27:45.465 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:45.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:45.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:45.504 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-11-28T19:27:45.873 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:45.884 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:45.885 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:45.888 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:45.888 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:46.583 INFO:teuthology.orchestra.run.smithi016.stdout:generic/423 0s 2023-11-28T19:27:46.596 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/423 2023-11-28T19:27:46.597 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:46.603 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:46.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:46.786 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-11-28T19:27:47.338 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:47.348 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:47.349 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:47.352 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:47.352 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:47.821 INFO:teuthology.orchestra.run.smithi016.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-11-28T19:27:47.831 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/424 2023-11-28T19:27:47.831 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/424 2023-11-28T19:27:47.831 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:47.838 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:47.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:47.870 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-11-28T19:27:48.275 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:48.286 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:48.287 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:48.290 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:48.290 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:48.466 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:27:48.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:27:48.805 INFO:teuthology.orchestra.run.smithi016.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-11-28T19:27:48.814 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/425 2023-11-28T19:27:48.814 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/425 2023-11-28T19:27:48.814 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:27:48.820 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:27:49.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:27:49.010 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-11-28T19:27:49.602 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:27:49.612 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:27:49.613 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:27:49.616 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:27:49.616 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:28:18.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:28:18.531 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:28:49.267 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:28:49.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:29:07.990 INFO:teuthology.orchestra.run.smithi016.stdout:generic/426 78s 2023-11-28T19:29:08.157 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/426 2023-11-28T19:29:08.157 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:08.163 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:08.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:08.430 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-11-28T19:29:09.988 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:09.999 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:10.000 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:10.003 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:10.003 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:10.714 INFO:teuthology.orchestra.run.smithi016.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:29:10.723 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/427 2023-11-28T19:29:10.723 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/427 2023-11-28T19:29:10.723 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:10.729 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:10.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:10.762 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-11-28T19:29:11.150 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:11.161 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:11.162 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:11.164 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:11.165 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:11.677 INFO:teuthology.orchestra.run.smithi016.stdout:generic/428 0s 2023-11-28T19:29:11.698 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/428 2023-11-28T19:29:11.699 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:11.705 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:11.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:11.740 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-11-28T19:29:12.157 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:12.169 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:12.169 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:12.172 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:12.172 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:20.020 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:29:20.025 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:29:23.824 INFO:teuthology.orchestra.run.smithi016.stdout:generic/429 11s 2023-11-28T19:29:23.837 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/429 2023-11-28T19:29:23.837 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:23.843 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:23.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:23.863 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-11-28T19:29:24.230 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:24.240 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:24.242 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:24.244 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:24.244 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:24.978 INFO:teuthology.orchestra.run.smithi016.stdout:generic/430 0s 2023-11-28T19:29:24.991 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/430 2023-11-28T19:29:24.991 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:24.997 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:25.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:25.211 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-11-28T19:29:25.781 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:25.792 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:25.793 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:25.796 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:25.796 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:26.455 INFO:teuthology.orchestra.run.smithi016.stdout:generic/431 1s 2023-11-28T19:29:26.468 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/431 2023-11-28T19:29:26.469 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:26.475 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:26.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:26.666 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-11-28T19:29:27.230 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:27.240 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:27.241 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:27.244 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:27.244 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:27.877 INFO:teuthology.orchestra.run.smithi016.stdout:generic/432 0s 2023-11-28T19:29:27.890 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/432 2023-11-28T19:29:27.890 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:27.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:28.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:28.010 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-11-28T19:29:28.668 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:28.679 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:28.680 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:28.682 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:28.682 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:29.291 INFO:teuthology.orchestra.run.smithi016.stdout:generic/433 1s 2023-11-28T19:29:29.304 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/433 2023-11-28T19:29:29.304 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:29.310 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:29.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:29.461 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-11-28T19:29:30.057 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:30.068 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:30.069 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:30.072 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:30.072 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:30.740 INFO:teuthology.orchestra.run.smithi016.stdout:generic/434 0s 2023-11-28T19:29:30.753 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/434 2023-11-28T19:29:30.753 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:29:30.759 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:30.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:29:30.909 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-11-28T19:29:31.510 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:29:31.521 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:29:31.522 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:29:31.524 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:29:31.524 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:29:50.138 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:29:50.143 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:29:50.176 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T19:29:50.172+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46211) UID: 0 2023-11-28T19:29:50.176 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T19:29:50.172+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46211) UID: 0 2023-11-28T19:29:50.176 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T19:29:50.172+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46211) UID: 0 2023-11-28T19:29:50.177 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T19:29:50.172+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46211) UID: 0 2023-11-28T19:32:52.783 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:52.788 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:52.820 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T19:32:52.816+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46220) UID: 0 2023-11-28T19:32:52.820 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T19:32:52.816+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46220) UID: 0 2023-11-28T19:35:07.534 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T19:35:07.526+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46230) UID: 0 2023-11-28T19:35:07.535 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T19:35:07.526+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46230) UID: 0 2023-11-28T19:35:07.535 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T19:35:07.530+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46230) UID: 0 2023-11-28T19:35:07.536 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T19:35:07.530+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46230) UID: 0 2023-11-28T19:38:07.850 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:07.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:37.936 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:43.723 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:13.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:13.828 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:43.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:43.899 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:14.901 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:14.906 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:44.965 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:44.970 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:15.033 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:15.037 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:45.082 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:45.086 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:15.155 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:15.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:45.367 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:45.371 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:15.426 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:15.430 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:45.499 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:45.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:45.534 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T19:43:45.532+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46273) UID: 0 2023-11-28T19:43:45.535 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T19:43:45.532+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46273) UID: 0 2023-11-28T19:46:44.831 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:44.835 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:44.878 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T19:46:44.873+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322844) UID: 0 2023-11-28T19:46:44.879 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T19:46:44.873+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322844) UID: 0 2023-11-28T19:46:44.879 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T19:46:44.873+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322844) UID: 0 2023-11-28T19:46:44.879 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T19:46:44.873+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322844) UID: 0 2023-11-28T19:49:56.064 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:56.069 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:26.135 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:26.139 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:56.191 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:56.196 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:26.248 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:26.253 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:58.194 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:59.884 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:52:29.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:52:29.947 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:52:29.976 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T19:52:29.969+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46310) UID: 0 2023-11-28T19:52:29.976 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T19:52:29.969+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46310) UID: 0 2023-11-28T19:55:23.212 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:23.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:53.334 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:53.341 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:23.465 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:23.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:53.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:53.574 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:23.667 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:23.672 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:23.703 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T19:57:23.699+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322897) UID: 0 2023-11-28T19:57:23.703 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T19:57:23.699+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322897) UID: 0 2023-11-28T19:57:23.704 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T19:57:23.699+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322897) UID: 0 2023-11-28T19:57:23.704 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T19:57:23.699+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 322897) UID: 0 2023-11-28T19:58:25.884 INFO:teuthology.orchestra.run.smithi016.stdout:generic/435 1734s 2023-11-28T19:58:25.898 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/435 2023-11-28T19:58:25.898 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:58:25.904 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:58:25.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:58:25.924 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-11-28T19:58:26.409 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:58:26.419 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:58:26.420 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:58:26.423 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:58:26.423 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:58:27.330 INFO:teuthology.orchestra.run.smithi016.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:58:27.341 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/436 2023-11-28T19:58:27.341 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/436 2023-11-28T19:58:27.342 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:58:27.346 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:58:27.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:58:27.543 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-11-28T19:58:28.120 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:58:28.131 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:58:28.132 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:58:28.135 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:58:28.135 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:58:29.366 INFO:teuthology.orchestra.run.smithi016.stdout:generic/437 1s 2023-11-28T19:58:29.380 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/437 2023-11-28T19:58:29.380 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:58:29.386 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:58:29.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:58:29.425 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-11-28T19:58:29.826 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:58:29.837 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:58:29.838 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:58:29.842 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:58:29.842 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:59:58.515 INFO:teuthology.orchestra.run.smithi016.stdout:generic/438 89s 2023-11-28T19:59:58.974 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/438 2023-11-28T19:59:58.974 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T19:59:58.981 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T19:59:59.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T19:59:59.021 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-11-28T19:59:59.425 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T19:59:59.436 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:59:59.437 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T19:59:59.439 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T19:59:59.440 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:00.791 INFO:teuthology.orchestra.run.smithi016.stdout:generic/439 1s 2023-11-28T20:00:00.805 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/439 2023-11-28T20:00:00.805 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:00.812 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:00.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:00.838 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-11-28T20:00:01.223 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:01.234 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:01.235 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:01.238 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:01.238 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:02.989 INFO:teuthology.orchestra.run.smithi016.stdout:generic/440 1s 2023-11-28T20:00:03.002 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/440 2023-11-28T20:00:03.002 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:03.009 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:03.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:03.028 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-11-28T20:00:03.415 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:03.427 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:03.428 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:03.431 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:03.431 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:04.410 INFO:teuthology.orchestra.run.smithi016.stdout:generic/441 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T20:00:04.421 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/441 2023-11-28T20:00:04.421 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/441 2023-11-28T20:00:04.421 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:04.429 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:04.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:04.465 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-11-28T20:00:04.861 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:04.871 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:04.872 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:04.875 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:04.875 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:05.319 INFO:teuthology.orchestra.run.smithi016.stdout:generic/442 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T20:00:05.328 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/442 2023-11-28T20:00:05.329 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/442 2023-11-28T20:00:05.329 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:05.335 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:05.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:05.365 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-11-28T20:00:05.758 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:05.768 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:05.769 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:05.772 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:05.772 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:06.281 INFO:teuthology.orchestra.run.smithi016.stdout:generic/443 1s 2023-11-28T20:00:06.294 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/443 2023-11-28T20:00:06.295 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:06.301 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:06.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:06.337 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-11-28T20:00:06.729 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:06.740 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:06.741 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:06.744 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:06.744 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:07.364 INFO:teuthology.orchestra.run.smithi016.stdout:generic/444 1s 2023-11-28T20:00:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/444 2023-11-28T20:00:07.378 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:07.384 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:07.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:07.427 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-11-28T20:00:07.813 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:07.824 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:07.825 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:07.829 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:07.830 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:08.753 INFO:teuthology.orchestra.run.smithi016.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:00:08.763 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/445 2023-11-28T20:00:08.763 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/445 2023-11-28T20:00:08.763 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:08.770 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:08.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:08.952 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-11-28T20:00:09.554 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:09.564 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:09.565 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:09.568 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:09.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:29.733 INFO:teuthology.orchestra.run.smithi016.stdout:generic/446 20s 2023-11-28T20:00:29.787 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/446 2023-11-28T20:00:29.789 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:29.824 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:29.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:29.886 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-11-28T20:00:30.314 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:30.325 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:30.326 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:30.329 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:30.329 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:31.121 INFO:teuthology.orchestra.run.smithi016.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:00:31.170 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/447 2023-11-28T20:00:31.170 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/447 2023-11-28T20:00:31.170 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:31.181 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:31.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:31.402 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-11-28T20:00:31.793 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:31.804 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:31.805 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:31.808 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:31.808 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:33.290 INFO:teuthology.orchestra.run.smithi016.stdout:generic/448 2s 2023-11-28T20:00:33.304 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/448 2023-11-28T20:00:33.304 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:33.310 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:33.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:33.496 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-11-28T20:00:34.129 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:34.140 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:34.142 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:34.145 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:34.145 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:34.725 INFO:teuthology.orchestra.run.smithi016.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T20:00:34.734 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/449 2023-11-28T20:00:34.734 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/449 2023-11-28T20:00:34.734 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:34.740 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:34.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:34.909 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-11-28T20:00:35.509 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:35.519 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:35.520 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:35.523 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:35.523 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:36.627 INFO:teuthology.orchestra.run.smithi016.stdout:generic/450 1s 2023-11-28T20:00:36.642 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/450 2023-11-28T20:00:36.643 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:00:36.649 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:00:36.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:00:36.893 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-11-28T20:00:37.431 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:00:37.442 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:00:37.443 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:00:37.446 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:00:37.446 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:08.138 INFO:teuthology.orchestra.run.smithi016.stdout:generic/451 31s 2023-11-28T20:01:08.152 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/451 2023-11-28T20:01:08.152 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:08.159 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:08.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:08.306 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-11-28T20:01:08.925 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:08.936 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:08.937 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:08.940 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:08.940 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:09.765 INFO:teuthology.orchestra.run.smithi016.stdout:generic/452 0s 2023-11-28T20:01:09.781 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/452 2023-11-28T20:01:09.781 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:09.785 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:09.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:09.804 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-11-28T20:01:10.186 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:10.197 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:10.198 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:10.200 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:10.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:10.657 INFO:teuthology.orchestra.run.smithi016.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-11-28T20:01:10.665 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/453 2023-11-28T20:01:10.666 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/453 2023-11-28T20:01:10.666 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:10.672 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:10.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:10.705 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-11-28T20:01:11.101 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:11.111 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:11.112 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:11.115 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:11.115 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:11.581 INFO:teuthology.orchestra.run.smithi016.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-11-28T20:01:11.592 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/454 2023-11-28T20:01:11.592 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/454 2023-11-28T20:01:11.592 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:11.596 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:11.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:11.639 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-11-28T20:01:12.045 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:12.054 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:12.055 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:12.058 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:12.058 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:12.631 INFO:teuthology.orchestra.run.smithi016.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-28T20:01:12.640 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/455 2023-11-28T20:01:12.641 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/455 2023-11-28T20:01:12.641 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:12.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:12.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:12.681 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-11-28T20:01:13.069 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:13.080 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:13.081 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:13.084 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:13.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:13.630 INFO:teuthology.orchestra.run.smithi016.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:01:13.639 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/456 2023-11-28T20:01:13.639 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/456 2023-11-28T20:01:13.639 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:13.646 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:13.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:13.681 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-11-28T20:01:14.087 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:14.098 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:14.099 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:14.101 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:14.101 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:15.016 INFO:teuthology.orchestra.run.smithi016.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:01:15.037 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/457 2023-11-28T20:01:15.037 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/457 2023-11-28T20:01:15.037 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:15.049 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:15.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:15.148 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-11-28T20:01:15.557 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:15.568 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:15.569 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:15.571 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:15.571 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:16.328 INFO:teuthology.orchestra.run.smithi016.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:01:16.427 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/458 2023-11-28T20:01:16.427 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/458 2023-11-28T20:01:16.427 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:16.461 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:16.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:16.606 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-11-28T20:01:17.065 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:17.076 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:17.077 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:17.079 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:17.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:18.183 INFO:teuthology.orchestra.run.smithi016.stdout:generic/459 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T20:01:18.191 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/459 2023-11-28T20:01:18.192 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/459 2023-11-28T20:01:18.192 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:18.198 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:18.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:18.269 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-11-28T20:01:18.649 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:18.660 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:18.661 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:18.664 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:18.664 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:21.733 INFO:teuthology.orchestra.run.smithi016.stdout:generic/460 3s 2023-11-28T20:01:21.748 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/460 2023-11-28T20:01:21.748 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:21.756 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:21.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:21.782 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-11-28T20:01:22.175 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:22.186 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:22.187 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:22.190 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:22.190 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:23.011 INFO:teuthology.orchestra.run.smithi016.stdout:generic/461 [not run] ceph does not support shutdown 2023-11-28T20:01:23.020 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/461 2023-11-28T20:01:23.020 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/461 2023-11-28T20:01:23.020 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:23.027 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:23.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:23.097 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-11-28T20:01:23.474 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:23.485 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:23.486 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:23.488 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:23.488 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:24.063 INFO:teuthology.orchestra.run.smithi016.stdout:generic/462 [not run] mount 172.21.15.16:6789:/scratch with dax failed 2023-11-28T20:01:24.072 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/462 2023-11-28T20:01:24.073 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/462 2023-11-28T20:01:24.073 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:24.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:24.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:24.109 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-11-28T20:01:24.491 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:24.502 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:24.503 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:24.506 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:24.506 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:25.095 INFO:teuthology.orchestra.run.smithi016.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:01:25.104 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/463 2023-11-28T20:01:25.104 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/463 2023-11-28T20:01:25.104 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:01:25.110 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:01:25.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:01:25.273 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-11-28T20:01:25.909 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:01:25.920 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:01:25.921 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:01:25.924 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:01:25.924 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:25.070 INFO:teuthology.orchestra.run.smithi016.stdout:generic/464 59s 2023-11-28T20:02:25.083 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/464 2023-11-28T20:02:25.083 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:25.090 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:25.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:25.110 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-11-28T20:02:25.507 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:25.517 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:25.519 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:25.521 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:25.522 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:31.340 INFO:teuthology.orchestra.run.smithi016.stdout:generic/465 4s 2023-11-28T20:02:31.410 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/465 2023-11-28T20:02:31.411 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:31.450 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:31.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:31.529 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-11-28T20:02:31.986 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:31.997 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:31.998 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:32.001 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:32.001 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:32.473 INFO:teuthology.orchestra.run.smithi016.stdout:generic/466 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T20:02:32.483 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/466 2023-11-28T20:02:32.483 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/466 2023-11-28T20:02:32.483 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:32.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:32.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:32.519 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-11-28T20:02:32.927 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:32.937 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:32.938 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:32.941 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:32.941 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:49.418 INFO:teuthology.orchestra.run.smithi016.stdout:generic/467 16s 2023-11-28T20:02:49.908 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/467 2023-11-28T20:02:49.988 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:50.138 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:50.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:50.443 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-11-28T20:02:55.309 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:55.320 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:55.321 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:55.324 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:55.324 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:56.138 INFO:teuthology.orchestra.run.smithi016.stdout:generic/468 [not run] ceph does not support shutdown 2023-11-28T20:02:56.154 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/468 2023-11-28T20:02:56.155 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/468 2023-11-28T20:02:56.155 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:56.161 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:56.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:56.188 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-11-28T20:02:56.637 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:56.648 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:56.649 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:56.652 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:56.652 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:57.118 INFO:teuthology.orchestra.run.smithi016.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:02:57.127 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/469 2023-11-28T20:02:57.128 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/469 2023-11-28T20:02:57.128 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:57.134 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:57.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:57.168 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-11-28T20:02:57.585 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:57.596 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:57.599 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:57.600 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:57.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:58.149 INFO:teuthology.orchestra.run.smithi016.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-28T20:02:58.158 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/470 2023-11-28T20:02:58.158 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/470 2023-11-28T20:02:58.159 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:02:58.165 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:02:58.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:02:58.194 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-11-28T20:02:58.577 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:02:58.588 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:02:58.589 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:02:58.592 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:02:58.592 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:03:27.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:27.279 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:57.359 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:57.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:27.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:27.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:57.564 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:57.568 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:57.730 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T20:04:57.727+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46653) UID: 0 2023-11-28T20:04:57.730 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T20:04:57.727+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46653) UID: 0 2023-11-28T20:05:41.645 INFO:teuthology.orchestra.run.smithi016.stdout:generic/471 163s 2023-11-28T20:05:41.660 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/471 2023-11-28T20:05:41.660 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:05:41.667 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:41.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:05:41.827 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-11-28T20:05:42.468 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:05:42.479 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:05:42.481 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:05:42.483 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:05:42.483 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:43.164 INFO:teuthology.orchestra.run.smithi016.stdout:generic/472 [not run] swapfiles are not supported 2023-11-28T20:05:43.174 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/472 2023-11-28T20:05:43.174 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/472 2023-11-28T20:05:43.174 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:05:43.180 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:43.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:05:43.211 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-11-28T20:05:43.610 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:05:43.620 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:05:43.621 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:05:43.623 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:05:43.624 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:44.154 INFO:teuthology.orchestra.run.smithi016.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T20:05:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/473 2023-11-28T20:05:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/473 2023-11-28T20:05:44.167 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:05:44.170 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:44.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:05:44.205 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-11-28T20:05:44.597 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:05:44.608 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:05:44.609 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:05:44.611 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:05:44.611 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:45.169 INFO:teuthology.orchestra.run.smithi016.stdout:generic/474 [not run] ceph does not support shutdown 2023-11-28T20:05:45.186 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/474 2023-11-28T20:05:45.186 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/474 2023-11-28T20:05:45.186 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:05:45.192 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:45.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:05:45.218 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-11-28T20:05:45.610 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:05:45.621 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:05:45.622 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:05:45.625 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:05:45.625 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:46.149 INFO:teuthology.orchestra.run.smithi016.stdout:generic/475 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T20:05:46.158 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/475 2023-11-28T20:05:46.158 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/475 2023-11-28T20:05:46.158 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T20:05:46.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:05:46.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T20:05:46.193 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-11-28T20:05:46.557 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T20:05:46.568 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T20:05:46.569 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T20:05:46.571 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T20:05:46.572 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T20:08:26.302 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T20:08:26.299+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46915) UID: 0 2023-11-28T20:08:26.303 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T20:08:26.299+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46915) UID: 0 2023-11-28T20:08:26.303 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T20:08:26.299+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46915) UID: 0 2023-11-28T20:08:26.303 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T20:08:26.299+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46915) UID: 0 2023-11-28T20:13:50.787 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:50.833 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:21.392 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:21.446 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:51.567 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:51.573 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:21.736 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:21.769 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:52.013 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:52.017 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:22.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:22.092 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:53.071 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:53.106 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:24.196 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:24.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:54.278 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:54.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:54.327 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T20:17:54.324+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47091) UID: 0 2023-11-28T20:17:54.327 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T20:17:54.324+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47091) UID: 0 2023-11-28T20:22:07.335 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:22:07.362 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:22:38.478 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:22:38.482 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:23:08.559 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:23:08.565 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:23:38.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:23:38.631 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:24:08.702 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:24:08.708 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:24:38.840 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:24:38.845 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:08.933 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:08.943 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:39.059 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:39.068 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:26:09.200 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:26:09.206 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:26:39.265 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:26:39.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:27:10.218 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:27:10.224 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:27:40.423 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:27:40.430 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:10.516 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:10.522 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:40.682 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:40.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:40.881 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T20:28:40.876+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47201) UID: 0 2023-11-28T20:28:40.881 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T20:28:40.876+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47201) UID: 0 2023-11-28T20:32:45.495 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:32:45.501 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:32:45.587 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T20:32:45.585+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440747) UID: 0 2023-11-28T20:32:45.587 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T20:32:45.585+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440747) UID: 0 2023-11-28T20:32:45.588 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T20:32:45.585+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440747) UID: 0 2023-11-28T20:32:45.588 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T20:32:45.585+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440747) UID: 0 2023-11-28T20:37:47.274 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:37:47.299 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:37:47.348 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T20:37:47.341+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47298) UID: 0 2023-11-28T20:37:47.348 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T20:37:47.341+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47298) UID: 0 2023-11-28T20:37:47.349 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T20:37:47.341+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47298) UID: 0 2023-11-28T20:37:47.350 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T20:37:47.341+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47298) UID: 0 2023-11-28T20:37:47.397 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T20:37:47.395+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440798) UID: 0 2023-11-28T20:37:47.398 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T20:37:47.395+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440798) UID: 0 2023-11-28T20:37:47.399 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T20:37:47.395+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440798) UID: 0 2023-11-28T20:37:47.399 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T20:37:47.395+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 440798) UID: 0 2023-11-28T20:42:51.767 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:51.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:51.835 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T20:42:51.831+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47364) UID: 0 2023-11-28T20:42:51.836 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T20:42:51.831+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47364) UID: 0 2023-11-28T20:49:41.090 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T20:49:41.083+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47416) UID: 0 2023-11-28T20:49:41.090 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T20:49:41.087+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47416) UID: 0 2023-11-28T20:49:41.091 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T20:49:41.083+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47416) UID: 0 2023-11-28T20:49:41.091 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T20:49:41.087+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47416) UID: 0 2023-11-28T20:54:58.070 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:58.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:58.699 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T20:54:58.693+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47525) UID: 0 2023-11-28T20:54:58.700 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T20:54:58.693+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47525) UID: 0 2023-11-28T20:59:51.484 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T20:59:51.471+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47592) UID: 0 2023-11-28T20:59:51.498 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T20:59:51.471+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47592) UID: 0 2023-11-28T20:59:51.498 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T20:59:51.475+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47592) UID: 0 2023-11-28T20:59:51.499 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T20:59:51.483+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47592) UID: 0 2023-11-28T21:10:12.140 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:12.146 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:12.336 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T21:10:12.332+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441003) UID: 0 2023-11-28T21:10:12.339 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T21:10:12.332+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441003) UID: 0 2023-11-28T21:10:12.339 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T21:10:12.332+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441003) UID: 0 2023-11-28T21:10:12.340 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T21:10:12.332+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441003) UID: 0 2023-11-28T21:10:12.449 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T21:10:12.443+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47682) UID: 0 2023-11-28T21:10:12.449 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T21:10:12.443+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47682) UID: 0 2023-11-28T21:20:11.899 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:11.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:12.307 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T21:20:12.303+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47796) UID: 0 2023-11-28T21:20:12.314 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T21:20:12.303+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47796) UID: 0 2023-11-28T21:20:12.389 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T21:20:12.374+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441075) UID: 0 2023-11-28T21:20:12.390 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T21:20:12.378+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441075) UID: 0 2023-11-28T21:20:12.390 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T21:20:12.378+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441075) UID: 0 2023-11-28T21:20:12.393 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T21:20:12.382+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441075) UID: 0 2023-11-28T21:24:57.643 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:57.651 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:57.708 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T21:24:57.701+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441107) UID: 0 2023-11-28T21:24:57.708 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T21:24:57.701+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441107) UID: 0 2023-11-28T21:24:57.708 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T21:24:57.701+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441107) UID: 0 2023-11-28T21:24:57.709 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T21:24:57.701+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441107) UID: 0 2023-11-28T21:25:17.268 INFO:teuthology.orchestra.run.smithi016.stdout:generic/476 4771s 2023-11-28T21:25:17.525 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/476 2023-11-28T21:25:17.525 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:25:17.615 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:25:17.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:25:17.714 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-11-28T21:25:26.587 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:25:26.598 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:25:26.599 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:25:26.602 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:25:26.602 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:28:43.178 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:43.206 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:16.351 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:16.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:46.432 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:46.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:46.488 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T21:29:46.484+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47843) UID: 0 2023-11-28T21:29:46.489 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T21:29:46.484+0000 7ff95a6b3640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47843) UID: 0 2023-11-28T21:32:38.693 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T21:32:38.685+0000 7fc8c6345640 -1 Fail to open '/proc/47852/cmdline' error = (2) No such file or directory 2023-11-28T21:32:38.694 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T21:32:38.685+0000 7fc8c6345640 -1 received signal: Hangup from (PID: 47852) UID: 0 2023-11-28T21:32:38.694 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T21:32:38.685+0000 7f11f9fc7640 -1 Fail to open '/proc/47852/cmdline' error = (2) No such file or directory 2023-11-28T21:32:38.694 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T21:32:38.685+0000 7f11f9fc7640 -1 received signal: Hangup from (PID: 47852) UID: 0 2023-11-28T21:32:38.695 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T21:32:38.685+0000 7fe89ebfa640 -1 Fail to open '/proc/47852/cmdline' error = (2) No such file or directory 2023-11-28T21:32:38.695 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T21:32:38.685+0000 7fe89ebfa640 -1 received signal: Hangup from (PID: 47852) UID: 0 2023-11-28T21:32:38.695 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T21:32:38.689+0000 7f0a358c6640 -1 Fail to open '/proc/47852/cmdline' error = (2) No such file or directory 2023-11-28T21:32:38.695 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T21:32:38.689+0000 7f0a358c6640 -1 received signal: Hangup from (PID: 47852) UID: 0 2023-11-28T21:40:44.401 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:44.408 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:45.335 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T21:40:45.332+0000 7fcdb541c640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47874) UID: 0 2023-11-28T21:40:45.336 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T21:40:45.332+0000 7ff95a6b3640 -1 Fail to read '/proc/47874/cmdline' error = (3) No such process 2023-11-28T21:40:45.336 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T21:40:45.332+0000 7ff95a6b3640 -1 received signal: Hangup from (PID: 47874) UID: 0 2023-11-28T21:41:37.873 INFO:teuthology.orchestra.run.smithi016.stdout:generic/477 27s 2023-11-28T21:41:38.087 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/477 2023-11-28T21:41:38.087 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:38.097 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:38.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:38.215 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-11-28T21:41:40.239 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:41:40.256 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:41:40.258 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:41:40.261 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:41:40.262 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:52.847 INFO:teuthology.orchestra.run.smithi016.stdout:generic/478 12s 2023-11-28T21:41:52.865 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/478 2023-11-28T21:41:52.866 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:52.873 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:52.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:52.930 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-11-28T21:41:53.470 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:41:53.484 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:41:53.485 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:41:53.490 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:41:53.490 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:54.349 INFO:teuthology.orchestra.run.smithi016.stdout:generic/479 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:41:54.364 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/479 2023-11-28T21:41:54.364 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/479 2023-11-28T21:41:54.364 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:54.371 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:54.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:54.426 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-11-28T21:41:55.003 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:41:55.018 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:41:55.019 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:41:55.022 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:41:55.022 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:55.726 INFO:teuthology.orchestra.run.smithi016.stdout:generic/480 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:41:55.737 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/480 2023-11-28T21:41:55.737 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/480 2023-11-28T21:41:55.737 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:55.746 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:55.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:55.792 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-11-28T21:41:56.352 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:41:56.364 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:41:56.366 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:41:56.369 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:41:56.369 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:57.016 INFO:teuthology.orchestra.run.smithi016.stdout:generic/481 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:41:57.030 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/481 2023-11-28T21:41:57.030 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/481 2023-11-28T21:41:57.031 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:57.039 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:57.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:57.083 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-11-28T21:41:57.654 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:41:57.670 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:41:57.671 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:41:57.674 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:41:57.674 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:58.560 INFO:teuthology.orchestra.run.smithi016.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-28T21:41:58.573 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/482 2023-11-28T21:41:58.573 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/482 2023-11-28T21:41:58.574 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:58.586 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:58.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:58.628 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-11-28T21:41:59.227 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:41:59.241 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:41:59.243 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:41:59.246 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:41:59.246 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:59.927 INFO:teuthology.orchestra.run.smithi016.stdout:generic/483 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:41:59.941 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/483 2023-11-28T21:41:59.941 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/483 2023-11-28T21:41:59.941 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:41:59.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:41:59.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:41:59.989 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-11-28T21:42:00.535 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:00.551 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:00.552 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:00.555 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:00.555 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:01.204 INFO:teuthology.orchestra.run.smithi016.stdout:generic/484 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:42:01.220 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/484 2023-11-28T21:42:01.220 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/484 2023-11-28T21:42:01.220 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:01.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:01.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:01.277 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-11-28T21:42:01.845 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:01.858 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:01.859 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:01.862 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:01.862 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:02.538 INFO:teuthology.orchestra.run.smithi016.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T21:42:02.548 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/485 2023-11-28T21:42:02.548 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/485 2023-11-28T21:42:02.549 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:02.556 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:02.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:02.650 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-11-28T21:42:03.233 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:03.244 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:03.245 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:03.247 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:03.247 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:04.882 INFO:teuthology.orchestra.run.smithi016.stdout:generic/486 1s 2023-11-28T21:42:04.899 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/486 2023-11-28T21:42:04.899 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:04.908 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:04.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:04.938 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-11-28T21:42:05.505 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:05.522 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:05.524 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:05.527 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:05.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:06.239 INFO:teuthology.orchestra.run.smithi016.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-11-28T21:42:06.251 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/487 2023-11-28T21:42:06.251 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/487 2023-11-28T21:42:06.251 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:06.260 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:06.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:06.355 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-11-28T21:42:06.890 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:06.905 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:06.906 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:06.909 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:06.909 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:07.564 INFO:teuthology.orchestra.run.smithi016.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T21:42:13.489 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/488 2023-11-28T21:42:13.490 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/488 2023-11-28T21:42:13.490 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:13.495 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:13.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:13.496 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-11-28T21:42:14.059 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:14.073 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:14.074 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:14.077 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:14.077 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:14.697 INFO:teuthology.orchestra.run.smithi016.stdout:generic/489 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:42:14.711 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/489 2023-11-28T21:42:14.711 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/489 2023-11-28T21:42:14.711 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:14.720 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:14.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:14.763 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-11-28T21:42:15.335 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:15.348 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:15.349 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:15.352 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:15.353 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:18.079 INFO:teuthology.orchestra.run.smithi016.stdout:generic/490 3s 2023-11-28T21:42:18.096 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/490 2023-11-28T21:42:18.096 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:18.104 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:18.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:18.385 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-11-28T21:42:19.089 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:19.106 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:19.109 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:19.111 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:19.111 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:19.812 INFO:teuthology.orchestra.run.smithi016.stdout:generic/491 [not run] ceph does not support freezing 2023-11-28T21:42:19.826 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/491 2023-11-28T21:42:19.827 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/491 2023-11-28T21:42:19.827 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:19.839 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:19.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:19.925 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-11-28T21:42:20.466 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:20.481 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:20.482 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:20.485 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:20.486 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:21.106 INFO:teuthology.orchestra.run.smithi016.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-11-28T21:42:21.120 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/492 2023-11-28T21:42:21.121 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/492 2023-11-28T21:42:21.121 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:21.132 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:21.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:21.210 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-11-28T21:42:21.747 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:21.761 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:21.762 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:21.768 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:21.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:22.773 INFO:teuthology.orchestra.run.smithi016.stdout:generic/493 [not run] swapfiles are not supported 2023-11-28T21:42:22.792 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/493 2023-11-28T21:42:22.792 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/493 2023-11-28T21:42:22.792 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:22.804 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:22.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:22.855 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-11-28T21:42:23.412 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:23.426 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:23.427 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:23.430 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:23.430 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:24.421 INFO:teuthology.orchestra.run.smithi016.stdout:generic/494 [not run] swapfiles are not supported 2023-11-28T21:42:24.435 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/494 2023-11-28T21:42:24.436 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/494 2023-11-28T21:42:24.436 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:24.445 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:24.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:24.505 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-11-28T21:42:25.041 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:25.054 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:25.055 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:25.058 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:25.059 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:26.030 INFO:teuthology.orchestra.run.smithi016.stdout:generic/495 [not run] swapfiles are not supported 2023-11-28T21:42:26.040 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/495 2023-11-28T21:42:26.040 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/495 2023-11-28T21:42:26.040 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:26.048 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:26.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:26.124 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-11-28T21:42:26.685 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:26.697 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:26.698 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:26.701 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:26.701 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:27.643 INFO:teuthology.orchestra.run.smithi016.stdout:generic/496 [not run] swapfiles are not supported 2023-11-28T21:42:27.657 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/496 2023-11-28T21:42:27.657 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/496 2023-11-28T21:42:27.657 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:27.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:27.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:27.750 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-11-28T21:42:28.330 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:28.345 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:28.346 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:28.351 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:28.351 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:29.263 INFO:teuthology.orchestra.run.smithi016.stdout:generic/497 [not run] swapfiles are not supported 2023-11-28T21:42:29.277 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/497 2023-11-28T21:42:29.277 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/497 2023-11-28T21:42:29.277 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:29.285 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:29.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:29.361 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-11-28T21:42:29.915 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:29.932 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:29.936 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:29.939 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:29.939 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:30.641 INFO:teuthology.orchestra.run.smithi016.stdout:generic/498 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:42:30.655 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/498 2023-11-28T21:42:30.655 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/498 2023-11-28T21:42:30.655 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:30.670 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:30.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:30.753 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-11-28T21:42:31.330 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:31.344 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:31.346 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:31.349 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:31.349 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:31.987 INFO:teuthology.orchestra.run.smithi016.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T21:42:32.001 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/499 2023-11-28T21:42:32.001 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/499 2023-11-28T21:42:32.001 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:32.012 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:32.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:32.065 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-11-28T21:42:32.643 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:32.655 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:32.658 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:32.662 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:32.662 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:33.377 INFO:teuthology.orchestra.run.smithi016.stdout:generic/500 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:42:33.388 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/500 2023-11-28T21:42:33.388 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/500 2023-11-28T21:42:33.388 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:33.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:33.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:33.444 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-11-28T21:42:34.017 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:34.031 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:34.032 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:34.035 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:34.036 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:35.101 INFO:teuthology.orchestra.run.smithi016.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T21:42:35.186 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/501 2023-11-28T21:42:35.186 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/501 2023-11-28T21:42:35.186 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:35.225 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:35.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:35.443 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-11-28T21:42:36.035 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:36.049 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:36.050 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:36.054 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:36.054 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:37.047 INFO:teuthology.orchestra.run.smithi016.stdout:generic/502 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:42:37.059 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/502 2023-11-28T21:42:37.059 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/502 2023-11-28T21:42:37.059 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:37.068 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:37.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:37.176 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-11-28T21:42:37.701 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:37.713 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:37.714 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:37.718 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:37.718 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:38.416 INFO:teuthology.orchestra.run.smithi016.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T21:42:38.430 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/503 2023-11-28T21:42:38.430 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/503 2023-11-28T21:42:38.430 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:38.441 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:38.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:38.535 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-11-28T21:42:39.088 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:39.106 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:39.107 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:39.110 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:39.111 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:39.862 INFO:teuthology.orchestra.run.smithi016.stdout:generic/504 0s 2023-11-28T21:42:39.890 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/504 2023-11-28T21:42:39.890 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:39.899 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:39.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:39.966 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-11-28T21:42:40.523 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:40.535 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:40.536 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:40.540 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:40.540 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:41.384 INFO:teuthology.orchestra.run.smithi016.stdout:generic/505 [not run] ceph does not support shutdown 2023-11-28T21:42:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/505 2023-11-28T21:42:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/505 2023-11-28T21:42:41.414 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:41.421 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:41.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:41.466 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-11-28T21:42:42.001 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:42.016 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:42.017 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:42.020 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:42.020 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:42.663 INFO:teuthology.orchestra.run.smithi016.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T21:42:42.681 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/506 2023-11-28T21:42:42.681 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/506 2023-11-28T21:42:42.681 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:42.697 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:42.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:42.748 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-11-28T21:42:43.333 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:43.347 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:43.349 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:43.353 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:43.353 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:44.056 INFO:teuthology.orchestra.run.smithi016.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-28T21:42:44.071 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/507 2023-11-28T21:42:44.071 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/507 2023-11-28T21:42:44.071 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:44.078 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:44.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:44.128 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-11-28T21:42:44.702 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:44.718 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:44.720 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:44.723 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:44.723 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:45.364 INFO:teuthology.orchestra.run.smithi016.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-11-28T21:42:45.378 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/508 2023-11-28T21:42:45.378 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/508 2023-11-28T21:42:45.378 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:45.390 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:45.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:45.441 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-11-28T21:42:45.986 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:46.003 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:46.005 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:46.008 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:46.008 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:46.683 INFO:teuthology.orchestra.run.smithi016.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-11-28T21:42:46.697 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/509 2023-11-28T21:42:46.698 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/509 2023-11-28T21:42:46.698 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:46.710 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:46.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:46.796 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-11-28T21:42:47.369 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:47.384 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:47.386 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:47.389 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:47.389 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:48.061 INFO:teuthology.orchestra.run.smithi016.stdout:generic/510 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:42:48.073 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/510 2023-11-28T21:42:48.073 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/510 2023-11-28T21:42:48.073 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:48.082 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:48.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:48.164 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-11-28T21:42:48.745 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:48.759 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:48.760 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:48.764 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:48.764 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:49.432 INFO:teuthology.orchestra.run.smithi016.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T21:42:49.444 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/511 2023-11-28T21:42:49.444 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/511 2023-11-28T21:42:49.444 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:49.456 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:49.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:49.564 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-11-28T21:42:50.129 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:50.149 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:50.151 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:50.159 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:50.159 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:50.879 INFO:teuthology.orchestra.run.smithi016.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T21:42:50.892 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/512 2023-11-28T21:42:50.892 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/512 2023-11-28T21:42:50.892 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:50.901 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:50.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:50.961 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-11-28T21:42:51.512 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:51.525 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:51.526 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:51.529 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:51.529 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:52.505 INFO:teuthology.orchestra.run.smithi016.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T21:42:52.559 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/513 2023-11-28T21:42:52.559 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/513 2023-11-28T21:42:52.559 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:52.602 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:52.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:52.960 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-11-28T21:42:53.512 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:53.526 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:53.528 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:53.534 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:53.534 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:54.787 INFO:teuthology.orchestra.run.smithi016.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T21:42:54.836 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/514 2023-11-28T21:42:54.836 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/514 2023-11-28T21:42:54.836 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:54.853 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:55.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:55.205 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-11-28T21:42:55.758 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:55.768 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:55.769 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:55.773 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:55.773 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:56.891 INFO:teuthology.orchestra.run.smithi016.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T21:42:56.940 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/515 2023-11-28T21:42:56.940 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/515 2023-11-28T21:42:56.940 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:56.974 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:57.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:57.298 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-11-28T21:42:57.844 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:57.857 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:57.859 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:57.866 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:57.866 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:58.643 INFO:teuthology.orchestra.run.smithi016.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T21:42:58.656 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/516 2023-11-28T21:42:58.657 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/516 2023-11-28T21:42:58.657 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:42:58.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:42:58.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:42:58.937 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-11-28T21:42:59.633 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:42:59.648 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:42:59.650 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:42:59.653 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:42:59.653 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:00.585 INFO:teuthology.orchestra.run.smithi016.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T21:43:00.698 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/517 2023-11-28T21:43:00.698 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/517 2023-11-28T21:43:00.698 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:43:00.771 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:01.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:43:01.160 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-11-28T21:43:01.704 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:43:01.719 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:43:01.720 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:43:01.724 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:43:01.725 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:02.815 INFO:teuthology.orchestra.run.smithi016.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T21:43:02.880 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/518 2023-11-28T21:43:02.880 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/518 2023-11-28T21:43:02.880 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:43:02.914 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:03.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:43:03.203 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-11-28T21:43:03.759 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:43:03.772 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:43:03.775 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:43:03.779 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:43:03.779 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:04.505 INFO:teuthology.orchestra.run.smithi016.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-11-28T21:43:04.523 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/519 2023-11-28T21:43:04.524 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/519 2023-11-28T21:43:04.524 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:43:04.531 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:04.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:43:04.707 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-11-28T21:43:05.513 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:43:05.529 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:43:05.530 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:43:05.533 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:43:05.533 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:06.196 INFO:teuthology.orchestra.run.smithi016.stdout:generic/520 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-28T21:43:06.208 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/520 2023-11-28T21:43:06.208 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/520 2023-11-28T21:43:06.208 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T21:43:06.215 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:43:06.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T21:43:06.264 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-11-28T21:43:06.789 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T21:43:06.805 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T21:43:06.807 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T21:43:06.810 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T21:43:06.810 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T21:44:27.266 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:27.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:57.410 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:57.416 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:27.489 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:27.495 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:57.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:57.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:27.655 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:27.661 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:57.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:57.727 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:27.786 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:27.791 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:58.527 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:58.533 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:28.613 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:28.618 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:58.681 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:58.691 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:28.774 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:28.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:58.843 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:58.849 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:28.910 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:31.406 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.493 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.499 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.579 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.648 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.720 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.729 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:01.791 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:01.797 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:31.858 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:31.864 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.047 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.121 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.185 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.190 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.259 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:03.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:03.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:03.550 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T21:56:03.547+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462096) UID: 0 2023-11-28T21:56:03.550 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T21:56:03.547+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462096) UID: 0 2023-11-28T21:56:03.550 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T21:56:03.547+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462096) UID: 0 2023-11-28T21:56:03.551 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T21:56:03.547+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462096) UID: 0 2023-11-28T21:59:29.674 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:29.679 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:59.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:59:59.755 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:29.822 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:29.831 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:59.895 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:59.899 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:30.073 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:30.078 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:00.149 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:00.155 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:30.255 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:30.260 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:00.328 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:00.334 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:00.380 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T22:03:00.374+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47987) UID: 0 2023-11-28T22:03:00.380 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T22:03:00.374+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47987) UID: 0 2023-11-28T22:03:00.380 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T22:03:00.374+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47987) UID: 0 2023-11-28T22:03:00.381 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T22:03:00.374+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47987) UID: 0 2023-11-28T22:06:29.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:29.450 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:59.633 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:59.642 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:29.780 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:29.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:29.832 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T22:07:29.829+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48007) UID: 0 2023-11-28T22:07:29.832 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T22:07:29.829+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48007) UID: 0 2023-11-28T22:07:29.833 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T22:07:29.829+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48007) UID: 0 2023-11-28T22:07:29.833 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T22:07:29.829+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48007) UID: 0 2023-11-28T22:10:58.805 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:58.812 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:58.849 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T22:10:58.848+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462156) UID: 0 2023-11-28T22:10:58.850 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T22:10:58.848+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462156) UID: 0 2023-11-28T22:10:58.850 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T22:10:58.848+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462156) UID: 0 2023-11-28T22:10:58.850 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T22:10:58.848+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462156) UID: 0 2023-11-28T22:14:50.117 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:53.377 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:23.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:23.680 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:53.865 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:53.871 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:23.935 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:23.940 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:54.000 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:54.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:24.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:24.091 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:55.041 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:55.047 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:55.086 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T22:17:55.084+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48066) UID: 0 2023-11-28T22:17:55.086 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T22:17:55.084+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48066) UID: 0 2023-11-28T22:17:55.086 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T22:17:55.084+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48066) UID: 0 2023-11-28T22:17:55.091 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T22:17:55.088+0000 7f11f9fc7640 -1 Fail to open '/proc/48066/cmdline' error = (2) No such file or directory 2023-11-28T22:17:55.091 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T22:17:55.088+0000 7f11f9fc7640 -1 received signal: Hangup from (PID: 48066) UID: 0 2023-11-28T22:17:55.108 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T22:17:55.102+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462189) UID: 0 2023-11-28T22:17:55.109 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T22:17:55.102+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462189) UID: 0 2023-11-28T22:17:55.111 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T22:17:55.106+0000 7f2fdaf14640 -1 received signal: Hangup from (PID: 462189) UID: 0 2023-11-28T22:17:55.111 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T22:17:55.106+0000 7f1c6507e640 -1 received signal: Hangup from (PID: 462189) UID: 0 2023-11-28T22:21:37.874 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:37.880 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:07.953 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:07.961 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:38.033 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:38.038 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:08.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:08.729 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:38.900 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:38.905 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:38.954 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T22:23:38.948+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462212) UID: 0 2023-11-28T22:23:38.954 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T22:23:38.948+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462212) UID: 0 2023-11-28T22:23:38.954 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T22:23:38.948+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462212) UID: 0 2023-11-28T22:23:38.955 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T22:23:38.948+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462212) UID: 0 2023-11-28T22:27:01.188 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:01.193 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:01.240 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T22:27:01.236+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462229) UID: 0 2023-11-28T22:27:01.241 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T22:27:01.236+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462229) UID: 0 2023-11-28T22:27:01.241 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T22:27:01.236+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462229) UID: 0 2023-11-28T22:27:01.243 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T22:27:01.240+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462229) UID: 0 2023-11-28T22:30:40.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:40.903 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:10.975 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:10.982 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:41.040 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:41.045 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:41.083 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T22:31:41.080+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48115) UID: 0 2023-11-28T22:31:41.084 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T22:31:41.080+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48115) UID: 0 2023-11-28T22:31:41.084 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T22:31:41.080+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48115) UID: 0 2023-11-28T22:31:41.084 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T22:31:41.080+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48115) UID: 0 2023-11-28T22:35:07.570 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:07.575 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:37.724 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:38.072 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:08.131 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:08.135 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:38.988 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:38.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:09.741 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:09.747 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:39.830 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:39.835 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:09.891 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:11.751 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:41.825 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:41.830 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:11.897 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:11.905 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:42.661 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:42.669 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:12.758 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:12.763 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:42.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:42.837 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:12.898 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:12.902 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:42.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:42.968 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:13.036 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:13.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:43.240 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:43.246 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:13.307 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:13.313 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:43.378 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:43.383 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:13.445 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:13.452 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:43.510 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:43.516 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:13.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:13.589 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:43.682 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:43.689 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:13.753 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:13.758 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:44.055 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:44.061 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:14.835 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:14.842 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:44.922 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:44.927 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:15.824 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:15.830 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:45.889 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:45.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:15.958 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:15.964 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:46.023 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:46.028 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:16.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:16.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:46.294 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:46.302 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:16.368 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:16.373 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:16.434 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T22:51:16.432+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462360) UID: 0 2023-11-28T22:51:16.435 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T22:51:16.432+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462360) UID: 0 2023-11-28T22:51:16.435 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T22:51:16.432+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462360) UID: 0 2023-11-28T22:51:16.435 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T22:51:16.432+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462360) UID: 0 2023-11-28T22:54:29.590 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:29.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:59.675 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:03.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:33.930 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:33.934 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:04.698 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:04.703 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:34.765 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:34.770 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:05.482 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:05.487 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:35.628 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:35.632 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:06.820 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:06.825 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:36.883 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:36.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:06.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:06.958 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:37.044 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:37.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:07.123 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:07.128 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:37.187 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:37.194 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:07.259 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:07.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:07.339 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T23:01:07.334+0000 7fcdb541c640 -1 Fail to open '/proc/48273/cmdline' error = (2) No such file or directory 2023-11-28T23:01:07.339 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-28T23:01:07.334+0000 7fcdb541c640 -1 received signal: Hangup from (PID: 48273) UID: 0 2023-11-28T23:01:07.339 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T23:01:07.334+0000 7ff95a6b3640 -1 Fail to open '/proc/48273/cmdline' error = (2) No such file or directory 2023-11-28T23:01:07.339 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-28T23:01:07.334+0000 7ff95a6b3640 -1 received signal: Hangup from (PID: 48273) UID: 0 2023-11-28T23:04:17.038 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:04:17.030+0000 7f11f9fc7640 -1 Fail to open '/proc/48279/cmdline' error = (2) No such file or directory 2023-11-28T23:04:17.053 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:04:17.030+0000 7f11f9fc7640 -1 received signal: Hangup from (PID: 48279) UID: 0 2023-11-28T23:04:17.054 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T23:04:17.030+0000 7fe89ebfa640 -1 Fail to open '/proc/48279/cmdline' error = (2) No such file or directory 2023-11-28T23:04:17.054 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T23:04:17.030+0000 7fe89ebfa640 -1 received signal: Hangup from (PID: 48279) UID: 0 2023-11-28T23:04:17.055 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T23:04:17.030+0000 7f0a358c6640 -1 Fail to open '/proc/48279/cmdline' error = (2) No such file or directory 2023-11-28T23:04:17.055 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T23:04:17.030+0000 7f0a358c6640 -1 received signal: Hangup from (PID: 48279) UID: 0 2023-11-28T23:04:17.055 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T23:04:17.030+0000 7fc8c6345640 -1 Fail to open '/proc/48279/cmdline' error = (2) No such file or directory 2023-11-28T23:04:17.056 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T23:04:17.030+0000 7fc8c6345640 -1 received signal: Hangup from (PID: 48279) UID: 0 2023-11-28T23:07:16.361 INFO:teuthology.orchestra.run.smithi064.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2023-11-28T23:07:19.065 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: stdin: file size changed while zipping 2023-11-28T23:07:51.342 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:51.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:51.393 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T23:07:51.388+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462427) UID: 0 2023-11-28T23:07:51.393 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T23:07:51.388+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462427) UID: 0 2023-11-28T23:07:51.393 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T23:07:51.388+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462427) UID: 0 2023-11-28T23:07:51.394 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T23:07:51.388+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462427) UID: 0 2023-11-28T23:08:58.944 INFO:teuthology.orchestra.run.smithi016.stdout:generic/521 5151s 2023-11-28T23:08:59.275 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/521 2023-11-28T23:08:59.276 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-28T23:08:59.298 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T23:08:59.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-28T23:08:59.595 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-11-28T23:09:03.476 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-28T23:09:03.495 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T23:09:03.497 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-28T23:09:03.502 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-28T23:09:03.502 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-28T23:11:51.677 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:51.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:51.731 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T23:11:51.725+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48304) UID: 0 2023-11-28T23:11:51.731 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T23:11:51.725+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48304) UID: 0 2023-11-28T23:11:51.732 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:11:51.725+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48304) UID: 0 2023-11-28T23:11:51.732 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T23:11:51.725+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48304) UID: 0 2023-11-28T23:15:32.108 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:32.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:02.177 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:02.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:32.242 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:32.249 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:02.321 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:02.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:32.408 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:32.412 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:32.465 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T23:17:32.459+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48331) UID: 0 2023-11-28T23:17:32.465 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T23:17:32.459+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48331) UID: 0 2023-11-28T23:17:32.466 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T23:17:32.463+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48331) UID: 0 2023-11-28T23:17:32.466 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:17:32.463+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48331) UID: 0 2023-11-28T23:21:05.844 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:05.851 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:05.908 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T23:21:05.903+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462924) UID: 0 2023-11-28T23:21:05.908 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T23:21:05.903+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462924) UID: 0 2023-11-28T23:21:05.909 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T23:21:05.903+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462924) UID: 0 2023-11-28T23:21:05.909 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T23:21:05.903+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462924) UID: 0 2023-11-28T23:24:40.707 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:40.713 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:40.819 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T23:24:40.816+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462957) UID: 0 2023-11-28T23:24:40.820 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T23:24:40.816+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462957) UID: 0 2023-11-28T23:24:40.820 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T23:24:40.816+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462957) UID: 0 2023-11-28T23:24:40.820 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T23:24:40.816+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462957) UID: 0 2023-11-28T23:31:03.353 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:03.363 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:03.427 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T23:31:03.423+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48369) UID: 0 2023-11-28T23:31:03.427 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T23:31:03.423+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48369) UID: 0 2023-11-28T23:31:03.427 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T23:31:03.423+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48369) UID: 0 2023-11-28T23:31:03.429 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:31:03.423+0000 7f11f9fc7640 -1 Fail to open '/proc/48369/cmdline' error = (2) No such file or directory 2023-11-28T23:31:03.429 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:31:03.423+0000 7f11f9fc7640 -1 received signal: Hangup from (PID: 48369) UID: 0 2023-11-28T23:34:40.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:40.376 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:10.531 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:10.540 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:40.596 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:40.602 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:10.672 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:10.678 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:40.752 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:40.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:11.375 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:11.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:41.458 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:41.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:11.522 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:11.529 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:42.273 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:42.278 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:12.369 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:12.373 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:42.441 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:42.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:12.507 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:12.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:42.598 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:42.603 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:12.687 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:12.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:42.768 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:42.773 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:12.842 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:12.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:42.907 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:42.915 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:12.987 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:12.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:43.054 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:43.060 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:13.118 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:13.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:43.183 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:43.188 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:13.252 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:13.257 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:43.320 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:43.324 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:13.406 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:13.412 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:43.777 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:43.782 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:13.853 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:13.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:43.916 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:43.921 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:14.052 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:14.057 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:44.116 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:44.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:14.856 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:14.862 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:14.921 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-28T23:49:14.914+0000 7fe89ebfa640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48466) UID: 0 2023-11-28T23:49:14.921 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-28T23:49:14.914+0000 7fc8c6345640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48466) UID: 0 2023-11-28T23:49:14.921 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-28T23:49:14.914+0000 7f0a358c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48466) UID: 0 2023-11-28T23:49:14.922 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-28T23:49:14.914+0000 7f11f9fc7640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48466) UID: 0 2023-11-28T23:52:46.506 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:46.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:16.583 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:16.593 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:46.665 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:46.669 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:16.738 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:16.744 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:46.815 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:46.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:16.885 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:16.891 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:46.952 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:46.958 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:17.057 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:17.063 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:47.130 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:47.135 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:47.194 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-28T23:56:47.193+0000 7fa0ee164640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463112) UID: 0 2023-11-28T23:56:47.195 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-28T23:56:47.193+0000 7f2fdaf14640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463112) UID: 0 2023-11-28T23:56:47.195 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-28T23:56:47.193+0000 7f1c6507e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463112) UID: 0 2023-11-28T23:56:47.195 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-28T23:56:47.193+0000 7f022fcce640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463112) UID: 0 2023-11-29T00:00:07.855 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-29T00:00:07.850+0000 7f1c6507e640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 463252) UID: 0 2023-11-29T00:00:07.856 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-29T00:00:07.846+0000 7fa0ee164640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 463252) UID: 0 2023-11-29T00:00:07.856 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-29T00:00:07.850+0000 7f022fcce640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 463252) UID: 0 2023-11-29T00:00:07.857 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-29T00:00:07.850+0000 7f2fdaf14640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 463252) UID: 0 2023-11-29T00:00:07.885 INFO:tasks.ceph.osd.0.smithi016.stderr:2023-11-29T00:00:07.878+0000 7fa0ee164640 -1 received signal: Hangup from pkill -1 -x ceph-mon|ceph-mgr|ceph-mds|ceph-osd|ceph-fuse|radosgw|rbd-mirror|cephfs-mirror (PID: 463253) UID: 0 2023-11-29T00:00:07.886 INFO:tasks.ceph.osd.1.smithi016.stderr:2023-11-29T00:00:07.878+0000 7f022fcce640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:07.886 INFO:tasks.ceph.osd.3.smithi016.stderr:2023-11-29T00:00:07.878+0000 7f1c6507e640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:07.886 INFO:tasks.ceph.osd.2.smithi016.stderr:2023-11-29T00:00:07.878+0000 7f2fdaf14640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:07.937 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-11-29T00:00:07.926+0000 7fd0a38aa640 -1 Fail to open '/proc/463252/cmdline' error = (2) No such file or directory 2023-11-29T00:00:07.955 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-11-29T00:00:07.930+0000 7fd0a38aa640 -1 received signal: Hangup from (PID: 463252) UID: 0 2023-11-29T00:00:07.974 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T00:00:07.966+0000 7fcd35955640 -1 Fail to open '/proc/463253/cmdline' error = (2) No such file or directory 2023-11-29T00:00:07.974 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T00:00:07.970+0000 7fcd35955640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:07.980 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T00:00:07.974+0000 7fcd35955640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-29T00:00:08.010 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T00:00:07.974+0000 7fcd35955640 -1 Fail to open '/proc/463253/cmdline' error = (2) No such file or directory 2023-11-29T00:00:08.010 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T00:00:07.974+0000 7fcd35955640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:08.010 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T00:00:07.974+0000 7fcd35955640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-29T00:00:08.010 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-11-29T00:00:07.990+0000 7fd0a38aa640 -1 Fail to open '/proc/463252/cmdline' error = (2) No such file or directory 2023-11-29T00:00:08.011 INFO:tasks.ceph.mds.a.smithi016.stderr:2023-11-29T00:00:07.990+0000 7fd0a38aa640 -1 received signal: Hangup from (PID: 463252) UID: 0 2023-11-29T00:00:08.011 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-11-29T00:00:07.982+0000 7f3269a0f640 -1 Fail to open '/proc/463253/cmdline' error = (2) No such file or directory 2023-11-29T00:00:08.011 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-11-29T00:00:07.994+0000 7f3269a0f640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:08.016 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-11-29T00:00:08.010+0000 7f3269a0f640 -1 Fail to open '/proc/463253/cmdline' error = (2) No such file or directory 2023-11-29T00:00:08.016 INFO:tasks.ceph.mds.c.smithi016.stderr:2023-11-29T00:00:08.010+0000 7f3269a0f640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:08.068 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-29T00:00:08.030+0000 7fe9add73640 -1 Fail to open '/proc/463253/cmdline' error = (2) No such file or directory 2023-11-29T00:00:08.068 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-29T00:00:08.062+0000 7fe9add73640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:08.068 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-29T00:00:08.062+0000 7fe9add73640 -1 Fail to open '/proc/463253/cmdline' error = (2) No such file or directory 2023-11-29T00:00:08.069 INFO:tasks.ceph.mgr.y.smithi016.stderr:2023-11-29T00:00:08.062+0000 7fe9add73640 -1 received signal: Hangup from (PID: 463253) UID: 0 2023-11-29T00:00:14.090 DEBUG:teuthology.orchestra.run.smithi016:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:14.096 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:14.128 INFO:teuthology.orchestra.run.smithi016.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:14.128 INFO:teuthology.orchestra.run.smithi016.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T00:00:14.131 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-11-29T00:00:14.180 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T00:00:36.080 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-29T00:00:36.077+0000 7f0a358c6640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 48577) UID: 0 2023-11-29T00:00:36.081 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-29T00:00:36.077+0000 7fe89ebfa640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 48577) UID: 0 2023-11-29T00:00:36.081 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-29T00:00:36.077+0000 7fc8c6345640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 48577) UID: 0 2023-11-29T00:00:36.082 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-29T00:00:36.077+0000 7f11f9fc7640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 48577) UID: 0 2023-11-29T00:00:36.111 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-29T00:00:36.109+0000 7ff95a6b3640 -1 Fail to open '/proc/48577/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.111 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-29T00:00:36.109+0000 7ff95a6b3640 -1 received signal: Hangup from (PID: 48577) UID: 0 2023-11-29T00:00:36.112 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-29T00:00:36.109+0000 7fcdb541c640 -1 Fail to open '/proc/48577/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.112 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-29T00:00:36.109+0000 7fcdb541c640 -1 received signal: Hangup from (PID: 48577) UID: 0 2023-11-29T00:00:36.122 INFO:tasks.ceph.mds.d.smithi064.stderr:2023-11-29T00:00:36.121+0000 7ff95a6b3640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.122 INFO:tasks.ceph.osd.4.smithi064.stderr:2023-11-29T00:00:36.121+0000 7f0a358c6640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.123 INFO:tasks.ceph.mds.b.smithi064.stderr:2023-11-29T00:00:36.121+0000 7fcdb541c640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.123 INFO:tasks.ceph.osd.6.smithi064.stderr:2023-11-29T00:00:36.121+0000 7f11f9fc7640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.123 INFO:tasks.ceph.osd.5.smithi064.stderr:2023-11-29T00:00:36.121+0000 7fe89ebfa640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.123 INFO:tasks.ceph.osd.7.smithi064.stderr:2023-11-29T00:00:36.121+0000 7fc8c6345640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.182 INFO:tasks.ceph.mon.c.smithi064.stderr:2023-11-29T00:00:36.177+0000 7f6738f7f640 -1 Fail to open '/proc/48578/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.183 INFO:tasks.ceph.mon.c.smithi064.stderr:2023-11-29T00:00:36.181+0000 7f6738f7f640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.236 INFO:tasks.ceph.mon.c.smithi064.stderr:2023-11-29T00:00:36.193+0000 7f6738f7f640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:36.236 INFO:tasks.ceph.mon.c.smithi064.stderr:2023-11-29T00:00:36.193+0000 7f6738f7f640 -1 Fail to open '/proc/48578/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.236 INFO:tasks.ceph.mon.c.smithi064.stderr:2023-11-29T00:00:36.193+0000 7f6738f7f640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.236 INFO:tasks.ceph.mon.c.smithi064.stderr:2023-11-29T00:00:36.193+0000 7f6738f7f640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:36.236 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-29T00:00:36.217+0000 7f4d16ddf640 -1 Fail to open '/proc/48578/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.236 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-29T00:00:36.217+0000 7f4d16ddf640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.237 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-29T00:00:36.217+0000 7f4d16ddf640 -1 Fail to open '/proc/48578/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.237 INFO:tasks.ceph.mgr.x.smithi064.stderr:2023-11-29T00:00:36.217+0000 7f4d16ddf640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.240 INFO:tasks.ceph.mon.b.smithi064.stderr:2023-11-29T00:00:36.229+0000 7f3806e8d640 -1 Fail to open '/proc/48578/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.241 INFO:tasks.ceph.mon.b.smithi064.stderr:2023-11-29T00:00:36.237+0000 7f3806e8d640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.241 INFO:tasks.ceph.mon.b.smithi064.stderr:2023-11-29T00:00:36.237+0000 7f3806e8d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:36.241 INFO:tasks.ceph.mon.b.smithi064.stderr:2023-11-29T00:00:36.237+0000 7f3806e8d640 -1 Fail to open '/proc/48578/cmdline' error = (2) No such file or directory 2023-11-29T00:00:36.241 INFO:tasks.ceph.mon.b.smithi064.stderr:2023-11-29T00:00:36.237+0000 7f3806e8d640 -1 received signal: Hangup from (PID: 48578) UID: 0 2023-11-29T00:00:36.242 INFO:tasks.ceph.mon.b.smithi064.stderr:2023-11-29T00:00:36.237+0000 7f3806e8d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:07:34.797 INFO:teuthology.orchestra.run.smithi016.stdout:generic/522 3511s 2023-11-29T00:07:34.913 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/522 2023-11-29T00:07:34.913 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:34.922 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:35.054 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:35.055 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-11-29T00:07:36.201 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:36.216 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:36.218 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:36.222 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:36.222 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:37.328 INFO:teuthology.orchestra.run.smithi016.stdout:generic/523 1s 2023-11-29T00:07:37.345 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/523 2023-11-29T00:07:37.345 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:37.353 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:37.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:37.383 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-11-29T00:07:37.959 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:37.975 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:37.977 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:37.981 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:37.981 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:45.426 INFO:teuthology.orchestra.run.smithi016.stdout:generic/524 7s 2023-11-29T00:07:45.446 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/524 2023-11-29T00:07:45.446 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:45.457 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:45.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:45.486 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-11-29T00:07:46.073 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:46.088 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:46.090 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:46.093 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:46.093 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:46.968 INFO:teuthology.orchestra.run.smithi016.stdout:generic/525 [not run] filesystem does not support huge file size 2023-11-29T00:07:46.997 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/525 2023-11-29T00:07:46.997 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/525 2023-11-29T00:07:46.998 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:47.008 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:47.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:47.052 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-11-29T00:07:47.644 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:47.662 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:47.664 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:47.668 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:47.668 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:48.503 INFO:teuthology.orchestra.run.smithi016.stdout:generic/526 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:07:48.514 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/526 2023-11-29T00:07:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/526 2023-11-29T00:07:48.515 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:48.525 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:48.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:48.572 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-11-29T00:07:49.137 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:49.152 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:49.154 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:49.157 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:49.157 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:50.362 INFO:teuthology.orchestra.run.smithi016.stdout:generic/527 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:07:50.373 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/527 2023-11-29T00:07:50.373 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/527 2023-11-29T00:07:50.373 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:50.383 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:50.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:50.431 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-11-29T00:07:50.996 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:51.008 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:51.011 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:51.014 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:51.014 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:51.907 INFO:teuthology.orchestra.run.smithi016.stdout:generic/528 0s 2023-11-29T00:07:51.927 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/528 2023-11-29T00:07:51.927 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:51.935 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:52.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:52.189 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-11-29T00:07:52.882 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:52.898 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:52.899 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:52.902 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:52.902 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:53.952 INFO:teuthology.orchestra.run.smithi016.stdout:generic/529 0s 2023-11-29T00:07:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/529 2023-11-29T00:07:53.971 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:53.980 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:54.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:54.017 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-11-29T00:07:54.584 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:54.596 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:54.597 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:54.601 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:54.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:55.455 INFO:teuthology.orchestra.run.smithi016.stdout:generic/530 [not run] ceph does not support shutdown 2023-11-29T00:07:55.490 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/530 2023-11-29T00:07:55.490 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/530 2023-11-29T00:07:55.490 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:55.499 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:55.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:55.537 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-11-29T00:07:56.103 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:56.118 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:56.120 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:56.124 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:56.124 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:56.766 INFO:teuthology.orchestra.run.smithi016.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-11-29T00:07:56.777 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/531 2023-11-29T00:07:56.778 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/531 2023-11-29T00:07:56.778 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:56.789 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:56.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:56.827 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-11-29T00:07:57.382 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:57.397 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:57.399 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:57.402 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:57.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:58.130 INFO:teuthology.orchestra.run.smithi016.stdout:generic/532 1s 2023-11-29T00:07:58.156 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/532 2023-11-29T00:07:58.156 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:07:58.168 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:07:58.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:07:58.226 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-11-29T00:07:58.776 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:07:58.789 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:07:58.791 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:07:58.794 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:07:58.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:00.493 INFO:teuthology.orchestra.run.smithi016.stdout:generic/533 1s 2023-11-29T00:08:00.511 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/533 2023-11-29T00:08:00.511 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:08:00.519 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:00.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:08:00.559 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-11-29T00:08:01.122 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:08:01.134 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:08:01.135 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:08:01.138 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:08:01.138 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:01.802 INFO:teuthology.orchestra.run.smithi016.stdout:generic/534 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:08:01.816 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/534 2023-11-29T00:08:01.816 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/534 2023-11-29T00:08:01.816 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:08:01.827 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:01.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:08:01.906 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-11-29T00:08:02.461 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:08:02.482 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:08:02.484 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:08:02.489 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:08:02.489 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:03.139 INFO:teuthology.orchestra.run.smithi016.stdout:generic/535 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:08:03.149 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/535 2023-11-29T00:08:03.149 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/535 2023-11-29T00:08:03.149 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:08:03.157 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:03.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:08:03.320 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-11-29T00:08:03.861 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:08:03.875 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:08:03.876 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:08:03.885 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:08:03.885 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:04.696 INFO:teuthology.orchestra.run.smithi016.stdout:generic/536 [not run] ceph does not support shutdown 2023-11-29T00:08:04.720 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/536 2023-11-29T00:08:04.721 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/536 2023-11-29T00:08:04.721 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:08:04.730 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:04.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:08:04.777 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-11-29T00:08:05.334 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:08:05.351 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:08:05.352 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:08:05.357 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:08:05.357 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:06.331 INFO:teuthology.orchestra.run.smithi016.stdout:generic/537 [not run] FSTRIM not supported 2023-11-29T00:08:06.357 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/537 2023-11-29T00:08:06.357 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/537 2023-11-29T00:08:06.358 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:08:06.366 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:08:06.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:08:06.406 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-11-29T00:08:06.907 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:08:06.921 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:08:06.923 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:08:06.925 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:08:06.925 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:20:50.711 INFO:teuthology.orchestra.run.smithi016.stdout:generic/538 763s 2023-11-29T00:20:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/538 2023-11-29T00:20:54.071 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:20:54.071 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:20:54.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:20:54.072 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-11-29T00:20:54.642 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:20:54.658 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:20:54.660 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:20:54.663 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:20:54.664 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:20:57.258 INFO:teuthology.orchestra.run.smithi016.stdout:generic/539 3s 2023-11-29T00:20:57.276 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/539 2023-11-29T00:20:57.276 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:20:57.285 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:20:57.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:20:57.444 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-11-29T00:20:58.220 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:20:58.236 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:20:58.237 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:20:58.241 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:20:58.241 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:20:59.343 INFO:teuthology.orchestra.run.smithi016.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:20:59.403 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/540 2023-11-29T00:20:59.403 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/540 2023-11-29T00:20:59.404 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:20:59.448 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:20:59.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:20:59.597 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-11-29T00:21:00.192 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:00.209 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:00.211 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:00.213 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:00.214 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:01.302 INFO:teuthology.orchestra.run.smithi016.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:21:01.359 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/541 2023-11-29T00:21:01.360 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/541 2023-11-29T00:21:01.360 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:01.414 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:01.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:01.591 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-11-29T00:21:02.157 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:02.173 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:02.174 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:02.177 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:02.177 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:03.226 INFO:teuthology.orchestra.run.smithi016.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:21:03.283 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/542 2023-11-29T00:21:03.283 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/542 2023-11-29T00:21:03.283 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:03.319 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:03.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:03.522 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-11-29T00:21:04.079 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:04.095 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:04.097 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:04.099 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:04.099 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:05.158 INFO:teuthology.orchestra.run.smithi016.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:21:05.256 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/543 2023-11-29T00:21:05.256 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/543 2023-11-29T00:21:05.256 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:05.293 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:05.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:05.488 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-11-29T00:21:06.053 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:06.068 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:06.070 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:06.075 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:06.075 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:07.133 INFO:teuthology.orchestra.run.smithi016.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:21:07.175 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/544 2023-11-29T00:21:07.175 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/544 2023-11-29T00:21:07.176 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:07.218 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:07.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:07.386 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-11-29T00:21:07.969 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:07.985 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:07.987 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:07.991 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:07.991 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:08.729 INFO:teuthology.orchestra.run.smithi016.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-11-29T00:21:08.741 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/545 2023-11-29T00:21:08.742 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/545 2023-11-29T00:21:08.742 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:08.751 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:08.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:08.805 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-11-29T00:21:09.376 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:09.389 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:09.391 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:09.395 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:09.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:10.072 INFO:teuthology.orchestra.run.smithi016.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T00:21:10.084 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/546 2023-11-29T00:21:10.084 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/546 2023-11-29T00:21:10.084 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:10.095 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:10.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:10.188 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-11-29T00:21:10.754 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:10.772 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:10.774 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:10.778 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:10.778 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:11.474 INFO:teuthology.orchestra.run.smithi016.stdout:generic/547 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:21:11.486 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/547 2023-11-29T00:21:11.486 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/547 2023-11-29T00:21:11.486 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:11.494 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:11.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:11.531 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-11-29T00:21:12.055 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:12.067 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:12.075 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:12.078 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:12.078 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:14.788 INFO:teuthology.orchestra.run.smithi016.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-29T00:21:14.798 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/548 2023-11-29T00:21:14.798 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/548 2023-11-29T00:21:14.798 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:14.806 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:14.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:14.914 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-11-29T00:21:15.466 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:15.479 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:15.481 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:15.484 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:15.485 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:17.232 INFO:teuthology.orchestra.run.smithi016.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-29T00:21:17.242 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/549 2023-11-29T00:21:17.242 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/549 2023-11-29T00:21:17.242 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:17.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:17.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:17.317 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-11-29T00:21:17.884 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:17.898 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:17.900 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:17.902 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:17.903 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:19.131 INFO:teuthology.orchestra.run.smithi016.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-11-29T00:21:19.176 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/550 2023-11-29T00:21:19.176 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/550 2023-11-29T00:21:19.177 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:21:19.187 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:21:19.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:21:19.227 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-11-29T00:21:19.794 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:21:19.809 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:21:19.810 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:21:19.814 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:21:19.814 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:05.131 INFO:teuthology.orchestra.run.smithi016.stdout:generic/551 1005s 2023-11-29T00:38:05.169 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/551 2023-11-29T00:38:05.169 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:05.176 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:05.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:05.195 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-11-29T00:38:05.962 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:05.973 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:05.974 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:05.977 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:05.977 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:06.534 INFO:teuthology.orchestra.run.smithi016.stdout:generic/552 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:38:06.543 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/552 2023-11-29T00:38:06.543 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/552 2023-11-29T00:38:06.543 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:06.549 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:06.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:06.586 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-11-29T00:38:07.008 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:07.019 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:07.020 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:07.022 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:07.023 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:07.598 INFO:teuthology.orchestra.run.smithi016.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-11-29T00:38:07.607 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/553 2023-11-29T00:38:07.607 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/553 2023-11-29T00:38:07.608 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:07.614 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:07.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:07.807 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-11-29T00:38:08.392 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:08.403 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:08.404 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:08.407 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:08.407 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:09.156 INFO:teuthology.orchestra.run.smithi016.stdout:generic/554 [not run] swapfiles are not supported 2023-11-29T00:38:09.165 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/554 2023-11-29T00:38:09.166 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/554 2023-11-29T00:38:09.166 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:09.173 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:09.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:09.356 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-11-29T00:38:09.962 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:09.973 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:09.974 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:09.976 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:09.976 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:10.493 INFO:teuthology.orchestra.run.smithi016.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-11-29T00:38:10.502 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/555 2023-11-29T00:38:10.502 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/555 2023-11-29T00:38:10.503 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:10.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:10.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:10.679 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-11-29T00:38:11.307 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:11.318 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:11.319 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:11.322 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:11.322 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:11.779 INFO:teuthology.orchestra.run.smithi016.stdout:generic/556 [not run] ceph does not support casefold feature 2023-11-29T00:38:11.788 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/556 2023-11-29T00:38:11.788 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/556 2023-11-29T00:38:11.788 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:11.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:11.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:11.884 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-11-29T00:38:12.267 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:12.277 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:12.279 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:12.281 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:12.281 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:12.748 INFO:teuthology.orchestra.run.smithi016.stdout:generic/557 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:38:12.757 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/557 2023-11-29T00:38:12.757 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/557 2023-11-29T00:38:12.757 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:12.763 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:12.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:12.792 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-11-29T00:38:13.183 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:13.194 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:13.195 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:13.197 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:13.198 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:13.671 INFO:teuthology.orchestra.run.smithi016.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-29T00:38:13.681 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/558 2023-11-29T00:38:13.681 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/558 2023-11-29T00:38:13.681 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:13.687 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:13.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:13.716 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-11-29T00:38:14.098 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:14.109 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:14.110 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:14.112 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:14.112 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:14.547 INFO:teuthology.orchestra.run.smithi016.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-11-29T00:38:14.556 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/559 2023-11-29T00:38:14.556 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/559 2023-11-29T00:38:14.556 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:14.562 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:14.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:14.591 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-11-29T00:38:14.966 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:14.977 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:14.978 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:14.981 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:14.981 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:15.420 INFO:teuthology.orchestra.run.smithi016.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-11-29T00:38:15.429 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/560 2023-11-29T00:38:15.429 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/560 2023-11-29T00:38:15.429 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:15.436 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:15.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:15.465 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-11-29T00:38:15.857 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:15.867 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:15.869 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:15.871 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:15.871 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:16.310 INFO:teuthology.orchestra.run.smithi016.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-11-29T00:38:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/561 2023-11-29T00:38:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/561 2023-11-29T00:38:16.320 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:16.326 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:16.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:16.358 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-11-29T00:38:16.746 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:16.757 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:16.758 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:16.761 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:16.761 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:17.488 INFO:teuthology.orchestra.run.smithi016.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:38:17.555 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/562 2023-11-29T00:38:17.556 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/562 2023-11-29T00:38:17.556 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:17.593 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:17.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:17.773 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-11-29T00:38:18.174 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:18.185 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:18.186 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:18.189 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:18.189 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:18.924 INFO:teuthology.orchestra.run.smithi016.stdout:generic/563 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:38:18.933 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/563 2023-11-29T00:38:18.933 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/563 2023-11-29T00:38:18.933 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:18.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:18.972 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-11-29T00:38:19.354 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:19.365 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:19.366 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:19.368 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:19.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:20.201 INFO:teuthology.orchestra.run.smithi016.stdout:generic/564 1s 2023-11-29T00:38:20.214 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/564 2023-11-29T00:38:20.214 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:20.221 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:20.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:20.450 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-11-29T00:38:21.019 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:21.030 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:21.031 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:21.034 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:21.034 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:21.791 INFO:teuthology.orchestra.run.smithi016.stdout:generic/565 0s 2023-11-29T00:38:21.805 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/565 2023-11-29T00:38:21.805 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:21.811 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:21.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:21.965 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-11-29T00:38:22.598 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:22.609 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:22.610 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:22.612 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:22.612 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:23.069 INFO:teuthology.orchestra.run.smithi016.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T00:38:23.078 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/566 2023-11-29T00:38:23.078 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/566 2023-11-29T00:38:23.078 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:23.084 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:23.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:23.114 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-11-29T00:38:23.520 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:23.531 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:23.532 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:23.534 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:23.535 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:24.463 INFO:teuthology.orchestra.run.smithi016.stdout:generic/567 1s 2023-11-29T00:38:24.477 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/567 2023-11-29T00:38:24.477 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:24.484 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:24.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:24.504 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-11-29T00:38:24.896 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:24.907 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:24.908 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:24.911 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:24.911 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:25.388 INFO:teuthology.orchestra.run.smithi016.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T00:38:25.397 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/568 2023-11-29T00:38:25.397 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/568 2023-11-29T00:38:25.397 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:25.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:25.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:25.441 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-11-29T00:38:25.823 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:25.834 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:25.835 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:25.838 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:25.838 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:26.314 INFO:teuthology.orchestra.run.smithi016.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T00:38:26.323 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/569 2023-11-29T00:38:26.323 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/569 2023-11-29T00:38:26.323 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:26.329 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:26.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:26.365 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-11-29T00:38:26.772 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:26.783 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:26.784 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:26.787 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:26.787 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:27.234 INFO:teuthology.orchestra.run.smithi016.stdout:generic/570 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:38:27.243 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/570 2023-11-29T00:38:27.243 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/570 2023-11-29T00:38:27.243 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:27.250 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:27.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:27.279 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-11-29T00:38:27.671 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:27.682 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:27.683 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:27.686 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:27.686 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:28.158 INFO:teuthology.orchestra.run.smithi016.stdout:generic/571 [not run] Require fcntl setlease support 2023-11-29T00:38:28.167 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/571 2023-11-29T00:38:28.167 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/571 2023-11-29T00:38:28.168 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:28.174 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:28.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:28.210 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-11-29T00:38:28.611 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:28.622 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:28.623 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:28.626 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:28.626 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:29.063 INFO:teuthology.orchestra.run.smithi016.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:29.072 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/572 2023-11-29T00:38:29.072 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/572 2023-11-29T00:38:29.072 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:29.079 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:29.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:29.108 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-11-29T00:38:29.512 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:29.522 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:29.523 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:29.526 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:29.527 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:29.962 INFO:teuthology.orchestra.run.smithi016.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:29.971 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/573 2023-11-29T00:38:29.971 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/573 2023-11-29T00:38:29.971 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:29.977 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:30.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:30.007 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-11-29T00:38:30.395 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:30.405 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:30.407 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:30.409 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:30.409 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:30.855 INFO:teuthology.orchestra.run.smithi016.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:30.864 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/574 2023-11-29T00:38:30.864 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/574 2023-11-29T00:38:30.864 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:30.870 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:30.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:30.900 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-11-29T00:38:31.296 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:31.307 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:31.309 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:31.311 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:31.311 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:31.761 INFO:teuthology.orchestra.run.smithi016.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:31.770 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/575 2023-11-29T00:38:31.771 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/575 2023-11-29T00:38:31.771 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:31.777 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:31.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:31.806 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-11-29T00:38:32.215 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:32.225 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:32.226 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:32.229 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:32.229 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:32.757 INFO:teuthology.orchestra.run.smithi016.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:32.766 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/576 2023-11-29T00:38:32.766 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/576 2023-11-29T00:38:32.766 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:32.773 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:32.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:32.801 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-11-29T00:38:33.178 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:33.189 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:33.190 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:33.193 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:33.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:33.631 INFO:teuthology.orchestra.run.smithi016.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:33.640 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/577 2023-11-29T00:38:33.640 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/577 2023-11-29T00:38:33.640 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:33.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:33.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:33.675 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-11-29T00:38:34.075 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:34.086 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:34.087 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:34.090 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:34.090 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:34.588 INFO:teuthology.orchestra.run.smithi016.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-29T00:38:34.597 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/578 2023-11-29T00:38:34.597 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/578 2023-11-29T00:38:34.597 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:34.604 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:34.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:34.639 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-11-29T00:38:35.027 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:35.038 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:35.039 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:35.042 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:35.042 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:35.493 INFO:teuthology.orchestra.run.smithi016.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-11-29T00:38:35.502 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/579 2023-11-29T00:38:35.502 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/579 2023-11-29T00:38:35.502 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:35.508 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:35.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:35.537 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-11-29T00:38:35.935 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:35.946 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:35.947 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:35.950 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:35.950 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:38.563 INFO:teuthology.orchestra.run.smithi016.stdout:generic/580 2s 2023-11-29T00:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/580 2023-11-29T00:38:38.576 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:38.583 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:38.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:38.602 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-11-29T00:38:39.012 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:39.022 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:39.023 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:39.026 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:39.026 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:43.528 INFO:teuthology.orchestra.run.smithi016.stdout:generic/581 4s 2023-11-29T00:38:43.542 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/581 2023-11-29T00:38:43.542 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:43.548 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:43.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:43.569 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-11-29T00:38:43.971 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:43.982 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:43.983 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:43.986 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:43.986 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:45.315 INFO:teuthology.orchestra.run.smithi016.stdout:generic/582 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-29T00:38:45.325 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/582 2023-11-29T00:38:45.326 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/582 2023-11-29T00:38:45.326 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:45.333 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:45.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:45.398 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-11-29T00:38:45.788 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:45.795 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:45.796 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:45.798 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:45.799 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:47.149 INFO:teuthology.orchestra.run.smithi016.stdout:generic/583 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-29T00:38:47.158 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/583 2023-11-29T00:38:47.158 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/583 2023-11-29T00:38:47.158 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:47.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:47.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:47.199 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-11-29T00:38:47.571 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:47.581 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:47.582 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:47.585 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:47.585 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:48.420 INFO:teuthology.orchestra.run.smithi016.stdout:generic/584 [not run] encryption policy '-c 9 -n 9 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-11-29T00:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/584 2023-11-29T00:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/584 2023-11-29T00:38:48.453 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:48.458 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:48.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:48.487 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-11-29T00:38:48.874 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:48.885 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:48.886 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:48.888 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:48.889 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:49.655 INFO:teuthology.orchestra.run.smithi016.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-11-29T00:38:49.664 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/585 2023-11-29T00:38:49.664 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/585 2023-11-29T00:38:49.664 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:49.671 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:49.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:49.835 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-11-29T00:38:50.491 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:50.501 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:50.503 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:50.505 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:50.505 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:51.144 INFO:teuthology.orchestra.run.smithi016.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T00:38:51.153 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/586 2023-11-29T00:38:51.153 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/586 2023-11-29T00:38:51.153 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:51.160 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:51.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:51.364 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-11-29T00:38:51.980 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:51.989 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:51.991 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:51.993 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:51.993 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:52.468 INFO:teuthology.orchestra.run.smithi016.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T00:38:52.478 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/587 2023-11-29T00:38:52.478 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/587 2023-11-29T00:38:52.478 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:52.484 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:52.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:52.513 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-11-29T00:38:52.894 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:52.905 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:52.906 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:52.909 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:53.712 INFO:teuthology.orchestra.run.smithi016.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:38:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/588 2023-11-29T00:38:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/588 2023-11-29T00:38:53.769 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:53.848 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:53.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:53.991 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-11-29T00:38:54.375 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:54.386 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:54.387 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:54.390 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:54.390 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:54.868 INFO:teuthology.orchestra.run.smithi016.stdout:generic/589 [not run] require 172.21.15.16:6789:/scratch to be local device 2023-11-29T00:38:54.878 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/589 2023-11-29T00:38:54.878 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/589 2023-11-29T00:38:54.878 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:54.884 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:54.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:54.917 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-11-29T00:38:55.311 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:55.321 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:55.322 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:55.325 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:55.325 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:55.763 INFO:teuthology.orchestra.run.smithi016.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T00:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/590 2023-11-29T00:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/590 2023-11-29T00:38:55.772 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:55.779 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:55.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:55.815 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-11-29T00:38:56.190 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:56.200 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:56.202 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:56.204 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:56.204 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:56.850 INFO:teuthology.orchestra.run.smithi016.stdout:generic/591 0s 2023-11-29T00:38:56.863 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/591 2023-11-29T00:38:56.863 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:56.870 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:57.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:57.059 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-11-29T00:38:57.659 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:57.669 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:57.671 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:57.673 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:57.673 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:58.649 INFO:teuthology.orchestra.run.smithi016.stdout:generic/592 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 8' 2023-11-29T00:38:58.666 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/592 2023-11-29T00:38:58.666 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/592 2023-11-29T00:38:58.666 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:38:58.673 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:38:58.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:38:58.742 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-11-29T00:38:59.131 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:38:59.142 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:38:59.142 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:38:59.145 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:38:59.145 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:01.839 INFO:teuthology.orchestra.run.smithi016.stdout:generic/593 2s 2023-11-29T00:39:01.853 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/593 2023-11-29T00:39:01.853 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:01.859 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:01.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:01.879 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-11-29T00:39:02.283 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:02.293 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:02.294 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:02.297 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:02.297 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:02.763 INFO:teuthology.orchestra.run.smithi016.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T00:39:02.772 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/594 2023-11-29T00:39:02.772 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/594 2023-11-29T00:39:02.773 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:02.779 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:02.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:02.808 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-11-29T00:39:03.207 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:03.218 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:03.220 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:03.222 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:03.222 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:09.148 INFO:teuthology.orchestra.run.smithi016.stdout:generic/595 6s 2023-11-29T00:39:09.231 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/595 2023-11-29T00:39:09.231 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:09.243 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:09.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:09.268 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-11-29T00:39:09.834 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:09.845 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:09.846 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:09.849 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:09.849 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:10.309 INFO:teuthology.orchestra.run.smithi016.stdout:generic/596 [not run] accton utility required, skipped this test 2023-11-29T00:39:10.318 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/596 2023-11-29T00:39:10.318 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/596 2023-11-29T00:39:10.319 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:10.325 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:10.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:10.354 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-11-29T00:39:10.746 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:10.757 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:10.758 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:10.761 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:12.223 INFO:teuthology.orchestra.run.smithi016.stdout:generic/597 2s 2023-11-29T00:39:12.236 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/597 2023-11-29T00:39:12.236 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:12.242 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:12.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:12.410 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-11-29T00:39:13.039 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:13.050 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:13.051 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:13.053 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:13.053 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:14.339 INFO:teuthology.orchestra.run.smithi016.stdout:generic/598 1s 2023-11-29T00:39:14.352 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/598 2023-11-29T00:39:14.352 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:14.359 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:14.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:14.495 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-11-29T00:39:15.138 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:15.149 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:15.150 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:15.153 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:15.153 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:15.816 INFO:teuthology.orchestra.run.smithi016.stdout:generic/599 [not run] ceph does not support shutdown 2023-11-29T00:39:15.834 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/599 2023-11-29T00:39:15.834 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/599 2023-11-29T00:39:15.834 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:15.840 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:15.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:15.915 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-11-29T00:39:16.315 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:16.326 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:16.327 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:16.330 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:16.330 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:16.778 INFO:teuthology.orchestra.run.smithi016.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T00:39:16.788 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/600 2023-11-29T00:39:16.788 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/600 2023-11-29T00:39:16.788 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:16.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:16.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:16.822 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-11-29T00:39:17.204 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:17.215 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:17.216 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:17.219 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:17.219 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:17.681 INFO:teuthology.orchestra.run.smithi016.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T00:39:17.691 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/601 2023-11-29T00:39:17.691 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/601 2023-11-29T00:39:17.691 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:17.698 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:17.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:17.727 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-11-29T00:39:18.124 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:18.135 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:18.136 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:18.139 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:18.139 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:19.092 INFO:teuthology.orchestra.run.smithi016.stdout:generic/602 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 16' 2023-11-29T00:39:19.111 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/602 2023-11-29T00:39:19.111 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/602 2023-11-29T00:39:19.111 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:19.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:19.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:19.144 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-11-29T00:39:19.531 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:19.542 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:19.543 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:19.546 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:19.546 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:20.003 INFO:teuthology.orchestra.run.smithi016.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T00:39:20.013 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/603 2023-11-29T00:39:20.013 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/603 2023-11-29T00:39:20.013 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:20.019 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:20.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:20.052 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-11-29T00:39:20.440 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:20.451 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:20.452 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:20.455 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:20.455 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:28.713 INFO:teuthology.orchestra.run.smithi016.stdout:generic/604 8s 2023-11-29T00:39:28.725 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/604 2023-11-29T00:39:28.725 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:28.731 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:28.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:28.751 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-11-29T00:39:29.148 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:29.158 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:29.159 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:29.162 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:29.162 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:33.793 INFO:teuthology.orchestra.run.smithi016.stdout:generic/605 [not run] mount 172.21.15.16:6789:/scratch with dax=always failed 2023-11-29T00:39:33.803 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/605 2023-11-29T00:39:33.803 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/605 2023-11-29T00:39:33.803 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:33.809 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:33.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:33.839 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-11-29T00:39:34.328 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:34.338 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:34.340 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:34.342 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:34.342 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:34.894 INFO:teuthology.orchestra.run.smithi016.stdout:generic/606 [not run] mount 172.21.15.16:6789:/scratch with dax=always failed 2023-11-29T00:39:34.903 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/606 2023-11-29T00:39:34.903 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/606 2023-11-29T00:39:34.903 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:34.909 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:34.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:34.938 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-11-29T00:39:35.348 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:35.359 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:35.360 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:35.363 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:35.363 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:35.857 INFO:teuthology.orchestra.run.smithi016.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-11-29T00:39:35.866 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/607 2023-11-29T00:39:35.866 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/607 2023-11-29T00:39:35.866 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:35.873 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:36.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:36.079 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-11-29T00:39:36.651 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:36.661 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:36.666 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:36.666 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:36.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:37.210 INFO:teuthology.orchestra.run.smithi016.stdout:generic/608 [not run] mount 172.21.15.16:6789:/scratch with dax=always failed 2023-11-29T00:39:37.219 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/608 2023-11-29T00:39:37.219 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/608 2023-11-29T00:39:37.219 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:37.226 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:37.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:37.254 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-11-29T00:39:37.630 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:37.641 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:37.642 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:37.645 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:37.645 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:38.362 INFO:teuthology.orchestra.run.smithi016.stdout:generic/609 1s 2023-11-29T00:39:38.376 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/609 2023-11-29T00:39:38.376 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:38.382 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:38.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:38.537 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-11-29T00:39:39.178 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:39.189 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:39.190 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:39.192 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:39.193 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:39.779 INFO:teuthology.orchestra.run.smithi016.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-29T00:39:39.788 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/610 2023-11-29T00:39:39.788 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/610 2023-11-29T00:39:39.788 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:39.794 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:39.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:39.888 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-11-29T00:39:40.270 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:40.281 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:40.282 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:40.285 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:40.285 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:41.105 INFO:teuthology.orchestra.run.smithi016.stdout:generic/611 1s 2023-11-29T00:39:41.119 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/611 2023-11-29T00:39:41.119 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:41.125 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:41.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:41.145 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-11-29T00:39:41.526 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:41.537 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:41.538 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:41.540 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:41.541 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:42.108 INFO:teuthology.orchestra.run.smithi016.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-11-29T00:39:42.117 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/612 2023-11-29T00:39:42.117 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/612 2023-11-29T00:39:42.117 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:42.123 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:42.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:42.346 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-11-29T00:39:42.964 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:42.973 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:42.978 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:42.978 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:42.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:44.012 INFO:teuthology.orchestra.run.smithi016.stdout:generic/613 [not run] _get_encryption_nonce() isn't implemented on ceph 2023-11-29T00:39:44.102 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/613 2023-11-29T00:39:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/613 2023-11-29T00:39:44.103 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:44.129 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:44.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:44.329 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-11-29T00:39:44.715 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:44.726 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:44.727 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:44.730 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:44.730 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:45.340 INFO:teuthology.orchestra.run.smithi016.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-11-29T00:39:45.366 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/614 2023-11-29T00:39:45.366 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/614 2023-11-29T00:39:45.367 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:39:45.373 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:39:45.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:39:45.407 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-11-29T00:39:45.815 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:39:45.826 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:39:45.827 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:39:45.830 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:39:45.830 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:40:31.099 INFO:teuthology.orchestra.run.smithi016.stdout:generic/615 46s 2023-11-29T00:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/615 2023-11-29T00:40:31.112 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:40:31.118 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:40:31.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:40:31.139 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-11-29T00:40:31.531 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:40:31.542 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:40:31.543 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:40:31.546 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:40:31.546 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:43:35.267 INFO:teuthology.orchestra.run.smithi016.stdout:generic/616 184s 2023-11-29T00:43:35.280 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/616 2023-11-29T00:43:35.280 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:43:35.286 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:43:35.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:43:35.325 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-11-29T00:43:35.706 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:43:35.717 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:43:35.718 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:43:35.721 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:43:35.721 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:30.944 INFO:teuthology.orchestra.run.smithi016.stdout:generic/617 55s 2023-11-29T00:44:30.957 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/617 2023-11-29T00:44:30.957 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:30.964 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:31.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:31.167 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-11-29T00:44:31.718 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:31.729 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:31.730 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:31.732 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:31.733 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:32.468 INFO:teuthology.orchestra.run.smithi016.stdout:generic/618 1s 2023-11-29T00:44:32.481 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/618 2023-11-29T00:44:32.481 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:32.487 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:32.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:32.507 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-11-29T00:44:32.907 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:32.918 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:32.919 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:32.922 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:32.922 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:33.385 INFO:teuthology.orchestra.run.smithi016.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T00:44:33.394 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/619 2023-11-29T00:44:33.394 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/619 2023-11-29T00:44:33.394 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:33.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:33.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:33.438 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-11-29T00:44:33.830 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:33.841 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:33.842 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:33.845 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:33.845 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:34.336 INFO:teuthology.orchestra.run.smithi016.stdout:generic/620 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:44:34.345 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/620 2023-11-29T00:44:34.345 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/620 2023-11-29T00:44:34.345 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:34.351 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:34.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:34.386 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-11-29T00:44:34.780 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:34.791 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:34.792 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:34.795 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:34.795 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:36.067 INFO:teuthology.orchestra.run.smithi016.stdout:generic/621 [not run] kernel doesn't support renameat2 syscall 2023-11-29T00:44:36.082 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/621 2023-11-29T00:44:36.082 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/621 2023-11-29T00:44:36.082 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:36.091 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:36.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:36.270 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-11-29T00:44:36.895 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:36.905 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:36.906 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:36.909 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:36.909 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:37.475 INFO:teuthology.orchestra.run.smithi016.stdout:generic/622 [not run] ceph does not support shutdown 2023-11-29T00:44:37.492 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/622 2023-11-29T00:44:37.492 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/622 2023-11-29T00:44:37.492 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:37.499 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:37.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:37.527 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-11-29T00:44:37.907 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:37.918 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:37.919 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:37.922 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:37.922 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:38.470 INFO:teuthology.orchestra.run.smithi016.stdout:generic/623 [not run] ceph does not support shutdown 2023-11-29T00:44:38.487 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/623 2023-11-29T00:44:38.487 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/623 2023-11-29T00:44:38.487 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:38.493 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:38.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:38.566 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-11-29T00:44:38.942 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:38.953 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:38.954 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:38.957 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:38.957 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:39.405 INFO:teuthology.orchestra.run.smithi016.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-11-29T00:44:39.414 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/624 2023-11-29T00:44:39.414 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/624 2023-11-29T00:44:39.414 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:39.420 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:39.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:39.489 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-11-29T00:44:39.882 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:39.892 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:39.894 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:39.896 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:39.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:40.331 INFO:teuthology.orchestra.run.smithi016.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-11-29T00:44:40.340 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/625 2023-11-29T00:44:40.340 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/625 2023-11-29T00:44:40.341 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:40.347 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:40.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:40.376 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-11-29T00:44:40.755 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:40.765 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:40.766 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:40.769 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:40.769 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:41.258 INFO:teuthology.orchestra.run.smithi016.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-11-29T00:44:41.268 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/626 2023-11-29T00:44:41.268 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/626 2023-11-29T00:44:41.268 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:41.274 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:41.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:41.434 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-11-29T00:44:42.051 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:42.061 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:42.063 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:42.065 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:42.066 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:42.631 INFO:teuthology.orchestra.run.smithi016.stdout:generic/627 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:44:42.640 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/627 2023-11-29T00:44:42.641 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/627 2023-11-29T00:44:42.641 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:42.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:42.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:42.728 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-11-29T00:44:43.127 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:43.138 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:43.139 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:43.142 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:43.142 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:43.967 INFO:teuthology.orchestra.run.smithi016.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T00:44:44.068 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/628 2023-11-29T00:44:44.068 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/628 2023-11-29T00:44:44.068 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:44.122 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:44.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:44.208 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-11-29T00:44:44.615 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:44.626 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:44.627 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:44.630 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:44.630 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:45.128 INFO:teuthology.orchestra.run.smithi016.stdout:generic/629 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:44:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/629 2023-11-29T00:44:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/629 2023-11-29T00:44:45.137 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:45.144 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:45.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:45.176 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-11-29T00:44:45.563 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:45.574 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:45.575 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:45.577 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:45.578 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:46.197 INFO:teuthology.orchestra.run.smithi016.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-29T00:44:46.363 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/630 2023-11-29T00:44:46.363 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/630 2023-11-29T00:44:46.363 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:44:46.420 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:44:46.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:44:46.640 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-11-29T00:44:47.038 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:44:47.049 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:44:47.050 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:44:47.053 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:44:47.053 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:18.673 INFO:teuthology.orchestra.run.smithi016.stdout:generic/631 - output mismatch (see /tmp/tmp.SqFPnd7Bgcxfstests-dev/results//generic/631.out.bad) 2023-11-29T00:45:18.700 INFO:teuthology.orchestra.run.smithi016.stdout: --- tests/generic/631.out 2023-11-28 17:40:40.394401759 +0000 2023-11-29T00:45:18.700 INFO:teuthology.orchestra.run.smithi016.stdout: +++ /tmp/tmp.SqFPnd7Bgcxfstests-dev/results//generic/631.out.bad 2023-11-29 00:45:18.634685141 +0000 2023-11-29T00:45:18.700 INFO:teuthology.orchestra.run.smithi016.stdout: @@ -1,2 +1,2672 @@ 2023-11-29T00:45:18.700 INFO:teuthology.orchestra.run.smithi016.stdout: QA output created by 631 2023-11-29T00:45:18.700 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.700 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.701 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.702 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.703 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.704 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.705 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.706 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.707 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.708 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.709 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.710 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.710 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.710 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.710 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.710 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.710 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.711 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.712 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.713 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.714 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.715 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.716 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.717 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.718 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.719 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.720 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.721 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.722 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.723 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directorymv: 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.724 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.725 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.726 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.727 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.728 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.729 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.730 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.731 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.732 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.733 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.734 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.735 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.736 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.737 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.741 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.741 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.741 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.742 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.743 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.744 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.745 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.746 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.747 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.748 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.749 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.750 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.751 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.752 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.753 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.754 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.755 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.756 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.757 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.758 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.759 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.760 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.761 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.762 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.763 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.764 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.765 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.766 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.767 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.768 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.769 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.770 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.771 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.772 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.773 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.774 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.775 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.776 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.777 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.778 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.779 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.780 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.781 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.782 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.783 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.784 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.785 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.786 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.787 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.788 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.789 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.790 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.791 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.792 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.793 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.794 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.795 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.796 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.797 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.798 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.799 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.800 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.801 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.802 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.803 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.804 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.805 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.806 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.807 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.808 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.809 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.810 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.811 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.812 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.813 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.814 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.815 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.816 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.817 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.818 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.819 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.820 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.821 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.822 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.823 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf'touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.824 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.825 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.826 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.827 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.828 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: mv: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.829 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.830 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: touch: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.831 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.832 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.833 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.834 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.835 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.836 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.837 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted./tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.838 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.839 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.840 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.841 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.842 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.843 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf' 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.844 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: umount: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf'/tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted.: No such file or directory 2023-11-29T00:45:18.845 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf' 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.846 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.847 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted./tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.848 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.849 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.850 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.851 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: umount: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf'/tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted.: No such file or directory 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.852 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf' 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.853 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.854 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.855 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.856 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.857 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.858 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.859 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.860 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.861 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.862 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted./tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.863 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.864 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.865 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.866 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf' 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.867 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.868 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.869 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.870 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.871 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.872 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.873 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.874 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.875 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.876 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.877 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.878 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.879 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.880 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.881 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.882 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.883 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.884 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.885 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.886 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.887 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf' 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.888 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.889 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.890 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.891 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.892 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.893 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.894 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.895 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directorymv: 2023-11-29T00:45:18.896 INFO:teuthology.orchestra.run.smithi016.stdout: +cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.897 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.898 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.899 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.900 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.901 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.902 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directorymv: 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.903 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.904 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.905 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.906 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.907 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.908 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.909 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.910 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.911 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mv: 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf'umount: : No such file or directory/tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.912 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.913 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.914 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.915 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.916 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.917 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf' 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.918 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: touch: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.919 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.920 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.921 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.922 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.923 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.924 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.925 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mv: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf' 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directorymount: 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +/tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.926 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.927 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.928 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.929 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.930 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.931 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted.touch: 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.932 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.933 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.934 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.935 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.936 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.937 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.938 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.939 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.940 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.941 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.942 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: mount: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf'/tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +: No such file or directory 2023-11-29T00:45:18.943 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.945 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged4/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged3/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged4: not mounted. 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged3: not mounted. 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.946 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged1/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged1: not mounted. 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +mount: mount: mount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.Vlt2oGtC1Iscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: + 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.947 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +mv: cannot stat '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged2/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged0/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +touch: cannot touch '/tmp/tmp.Vlt2oGtC1Iscratch/merged5/etc/access.conf': No such file or directory 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged2: not mounted. 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged0: not mounted. 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: +umount: /tmp/tmp.Vlt2oGtC1Iscratch/merged5: not mounted. 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: Silence is golden. 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:18.948 INFO:teuthology.orchestra.run.smithi016.stdout:HINT: You _MAY_ be missing kernel fix: 2023-11-29T00:45:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-11-29T00:45:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:18.949 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/631 2023-11-29T00:45:18.949 INFO:teuthology.orchestra.run.smithi016.stdout:Failures: generic/631 2023-11-29T00:45:18.949 INFO:teuthology.orchestra.run.smithi016.stdout:Failed 1 of 1 tests 2023-11-29T00:45:18.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:18.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T00:45:18.950 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-11-29T00:45:18.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-11-29T00:45:18.951 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-11-29T00:45:19.342 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:19.353 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:19.354 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:19.357 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:19.357 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:21.766 INFO:teuthology.orchestra.run.smithi016.stdout:generic/632 2s 2023-11-29T00:45:21.779 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/632 2023-11-29T00:45:21.779 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:21.785 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:21.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:21.823 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-11-29T00:45:22.201 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:22.211 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:22.213 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:22.215 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:22.215 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:26.510 INFO:teuthology.orchestra.run.smithi016.stdout:generic/633 4s 2023-11-29T00:45:26.523 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/633 2023-11-29T00:45:26.523 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:26.529 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:26.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:26.690 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-11-29T00:45:27.351 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:27.361 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:27.362 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:27.365 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:27.365 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:28.786 INFO:teuthology.orchestra.run.smithi016.stdout:generic/634 1s 2023-11-29T00:45:28.971 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/634 2023-11-29T00:45:28.972 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:28.978 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:28.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:28.998 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-11-29T00:45:29.379 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:29.390 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:29.391 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:29.393 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:29.393 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:30.040 INFO:teuthology.orchestra.run.smithi016.stdout:generic/635 [not run] ceph does not support shutdown 2023-11-29T00:45:30.057 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/635 2023-11-29T00:45:30.057 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/635 2023-11-29T00:45:30.057 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:30.064 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:30.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:30.092 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-11-29T00:45:30.471 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:30.482 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:30.483 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:30.486 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:30.486 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:31.115 INFO:teuthology.orchestra.run.smithi016.stdout:generic/636 [not run] swapfiles are not supported 2023-11-29T00:45:31.124 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/636 2023-11-29T00:45:31.124 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/636 2023-11-29T00:45:31.125 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:31.131 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:31.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:31.164 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-11-29T00:45:31.552 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:31.562 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:31.564 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:31.566 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:31.567 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:33.157 INFO:teuthology.orchestra.run.smithi016.stdout:generic/637 2s 2023-11-29T00:45:33.170 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/637 2023-11-29T00:45:33.171 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:33.177 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:33.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:33.452 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-11-29T00:45:34.022 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:34.033 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:34.034 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:34.037 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:34.037 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:34.746 INFO:teuthology.orchestra.run.smithi016.stdout:generic/638 0s 2023-11-29T00:45:34.758 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/638 2023-11-29T00:45:34.759 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:34.765 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:34.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:34.801 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-11-29T00:45:35.206 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:35.217 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:35.218 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:35.221 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:35.221 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:35.823 INFO:teuthology.orchestra.run.smithi016.stdout:generic/639 0s 2023-11-29T00:45:35.837 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/639 2023-11-29T00:45:35.837 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:35.843 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:35.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:35.881 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-11-29T00:45:36.271 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:36.281 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:36.282 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:36.285 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:36.285 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:36.745 INFO:teuthology.orchestra.run.smithi016.stdout:generic/640 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T00:45:36.755 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/640 2023-11-29T00:45:36.755 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/640 2023-11-29T00:45:36.755 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:36.761 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:36.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:36.790 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-11-29T00:45:37.187 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:37.198 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:37.199 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:37.202 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:37.202 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:37.834 INFO:teuthology.orchestra.run.smithi016.stdout:generic/641 [not run] swapfiles are not supported 2023-11-29T00:45:37.844 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/641 2023-11-29T00:45:37.844 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/641 2023-11-29T00:45:37.845 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:45:37.851 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:45:37.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:45:37.883 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-11-29T00:45:38.262 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:45:38.273 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:45:38.274 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:45:38.276 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:45:38.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:56:44.474 INFO:teuthology.orchestra.run.smithi016.stdout:generic/642 666s 2023-11-29T00:56:44.489 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/642 2023-11-29T00:56:44.489 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T00:56:44.496 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T00:56:44.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T00:56:44.520 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-11-29T00:56:46.591 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T00:56:46.603 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T00:56:46.604 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T00:56:46.607 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T00:56:46.607 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:01:06.822 INFO:teuthology.orchestra.run.smithi016.stdout:generic/643 [not run] swapfiles are not supported 2023-11-29T01:01:06.831 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/643 2023-11-29T01:01:06.831 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/643 2023-11-29T01:01:06.832 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:01:06.838 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:01:06.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:01:06.869 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-11-29T01:01:07.262 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:01:07.273 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:01:07.274 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:01:07.277 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:01:07.277 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:01:07.814 INFO:teuthology.orchestra.run.smithi016.stdout:generic/644 0s 2023-11-29T01:01:07.827 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/644 2023-11-29T01:01:07.828 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:01:07.834 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:01:08.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:01:08.026 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-11-29T01:01:08.630 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:01:08.641 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:01:08.642 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:01:08.644 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:01:08.645 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:12.097 INFO:teuthology.orchestra.run.smithi016.stdout:generic/645 304s 2023-11-29T01:06:12.110 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/645 2023-11-29T01:06:12.110 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:06:12.116 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:12.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:06:12.152 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-11-29T01:06:12.546 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:06:12.557 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:06:12.558 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:06:12.561 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:06:12.561 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:13.253 INFO:teuthology.orchestra.run.smithi016.stdout:generic/646 [not run] ceph does not support shutdown 2023-11-29T01:06:13.269 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/646 2023-11-29T01:06:13.270 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/646 2023-11-29T01:06:13.270 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:06:13.276 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:13.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:06:13.303 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-11-29T01:06:13.698 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:06:13.709 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:06:13.710 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:06:13.713 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:06:13.713 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:14.410 INFO:teuthology.orchestra.run.smithi016.stdout:generic/647 1s 2023-11-29T01:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/647 2023-11-29T01:06:14.423 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:06:14.430 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:14.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:06:14.597 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-11-29T01:06:15.186 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:06:15.197 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:06:15.198 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:06:15.201 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:15.974 INFO:teuthology.orchestra.run.smithi016.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T01:06:16.046 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/648 2023-11-29T01:06:16.047 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/648 2023-11-29T01:06:16.047 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:06:16.068 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:16.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:06:16.261 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-11-29T01:06:16.651 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:06:16.662 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:06:16.663 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:06:16.665 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:06:16.666 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:17.208 INFO:teuthology.orchestra.run.smithi016.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-11-29T01:06:17.217 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/649 2023-11-29T01:06:17.218 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/649 2023-11-29T01:06:17.218 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T01:06:17.224 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T01:06:17.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T01:06:17.465 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-11-29T01:06:18.014 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T01:06:18.025 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T01:06:18.026 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T01:06:18.029 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T01:06:18.029 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:08.667 INFO:teuthology.orchestra.run.smithi016.stdout:generic/650 3230s 2023-11-29T02:00:08.756 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/650 2023-11-29T02:00:08.757 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:08.787 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:08.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:08.891 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-11-29T02:00:11.750 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:11.765 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:11.768 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:11.771 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:11.771 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:13.895 INFO:teuthology.orchestra.run.smithi016.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/651 2023-11-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/651 2023-11-29T02:00:13.984 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:14.099 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:14.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:14.540 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-11-29T02:00:15.799 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:15.815 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:15.820 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:15.829 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:15.830 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:17.852 INFO:teuthology.orchestra.run.smithi016.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:17.926 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/652 2023-11-29T02:00:17.926 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/652 2023-11-29T02:00:17.926 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:17.977 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:18.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:18.489 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-11-29T02:00:19.675 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:19.723 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:19.728 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:19.740 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:19.740 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:22.032 INFO:teuthology.orchestra.run.smithi016.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:22.151 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/653 2023-11-29T02:00:22.159 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/653 2023-11-29T02:00:22.159 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:22.208 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:22.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:22.471 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-11-29T02:00:23.654 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:23.683 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:23.684 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:23.695 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:23.695 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:26.090 INFO:teuthology.orchestra.run.smithi016.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:29.655 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/654 2023-11-29T02:00:29.655 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/654 2023-11-29T02:00:29.655 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:29.655 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:29.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:29.656 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-11-29T02:00:30.822 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:30.839 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:30.845 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:30.849 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:30.849 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:33.088 INFO:teuthology.orchestra.run.smithi016.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:33.290 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/655 2023-11-29T02:00:33.290 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/655 2023-11-29T02:00:33.290 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:33.326 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:33.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:33.638 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-11-29T02:00:34.887 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:34.938 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:34.943 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:34.950 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:34.950 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:38.375 INFO:teuthology.orchestra.run.smithi016.stdout:generic/656 3s 2023-11-29T02:00:38.410 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/656 2023-11-29T02:00:38.410 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:38.440 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:38.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:38.546 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-11-29T02:00:39.740 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:39.770 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:39.776 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:39.788 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:42.232 INFO:teuthology.orchestra.run.smithi016.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:42.360 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/657 2023-11-29T02:00:42.360 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/657 2023-11-29T02:00:42.360 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:42.501 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:42.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:42.744 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-11-29T02:00:43.979 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:44.008 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:44.010 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:44.018 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:44.018 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:46.247 INFO:teuthology.orchestra.run.smithi016.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:46.373 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/658 2023-11-29T02:00:46.374 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/658 2023-11-29T02:00:46.374 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:46.407 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:46.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:46.794 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-11-29T02:00:47.982 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:48.026 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:48.027 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:48.036 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:48.036 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:50.118 INFO:teuthology.orchestra.run.smithi016.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:50.232 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/659 2023-11-29T02:00:50.232 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/659 2023-11-29T02:00:50.232 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:50.379 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:50.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:50.682 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-11-29T02:00:52.068 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:52.118 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:52.128 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:52.139 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:52.139 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:54.446 INFO:teuthology.orchestra.run.smithi016.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:54.494 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/660 2023-11-29T02:00:54.494 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/660 2023-11-29T02:00:54.494 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:54.523 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:54.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:54.724 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-11-29T02:00:56.135 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:00:57.832 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:00:57.832 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:00:57.832 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:00:57.832 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:58.340 INFO:teuthology.orchestra.run.smithi016.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:00:58.546 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/661 2023-11-29T02:00:58.546 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/661 2023-11-29T02:00:58.546 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:00:58.650 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:00:58.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:00:58.861 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-11-29T02:01:00.181 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:00.225 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:00.227 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:00.232 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:00.232 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:02.407 INFO:teuthology.orchestra.run.smithi016.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:02.430 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/662 2023-11-29T02:01:02.431 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/662 2023-11-29T02:01:02.431 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:02.468 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:02.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:02.996 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-11-29T02:01:04.196 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:04.217 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:04.218 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:04.221 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:04.222 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:06.594 INFO:teuthology.orchestra.run.smithi016.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:06.775 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/663 2023-11-29T02:01:06.775 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/663 2023-11-29T02:01:06.775 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:06.851 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:07.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:07.100 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-11-29T02:01:08.419 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:08.466 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:08.472 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:08.483 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:08.485 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:10.832 INFO:teuthology.orchestra.run.smithi016.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:10.866 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/664 2023-11-29T02:01:10.866 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/664 2023-11-29T02:01:10.866 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:10.934 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:11.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:11.096 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-11-29T02:01:12.548 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:12.599 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:12.606 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:12.615 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:12.615 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:15.000 INFO:teuthology.orchestra.run.smithi016.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:15.217 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/665 2023-11-29T02:01:15.217 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/665 2023-11-29T02:01:15.217 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:15.316 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:15.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:15.538 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-11-29T02:01:16.942 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:16.980 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:16.987 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:16.995 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:16.995 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:19.255 INFO:teuthology.orchestra.run.smithi016.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:19.344 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/666 2023-11-29T02:01:19.344 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/666 2023-11-29T02:01:19.344 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:19.386 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:19.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:19.714 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-11-29T02:01:20.934 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:20.957 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:20.964 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:20.975 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:20.975 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:23.332 INFO:teuthology.orchestra.run.smithi016.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:23.433 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/667 2023-11-29T02:01:23.433 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/667 2023-11-29T02:01:23.433 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:23.494 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:23.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:23.670 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-11-29T02:01:25.069 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:25.100 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:25.103 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:25.108 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:25.108 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:27.312 INFO:teuthology.orchestra.run.smithi016.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:27.404 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/668 2023-11-29T02:01:27.405 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/668 2023-11-29T02:01:27.406 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:27.517 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:27.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:27.921 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-11-29T02:01:29.149 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:29.166 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:29.172 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:29.184 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:29.184 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:31.515 INFO:teuthology.orchestra.run.smithi016.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:31.583 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/669 2023-11-29T02:01:31.584 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/669 2023-11-29T02:01:31.585 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:31.606 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:31.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:31.817 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-11-29T02:01:33.206 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:33.250 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:33.253 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:33.263 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:33.263 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:35.467 INFO:teuthology.orchestra.run.smithi016.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:35.521 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/670 2023-11-29T02:01:35.521 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/670 2023-11-29T02:01:35.521 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:35.547 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:35.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:35.864 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-11-29T02:01:37.124 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:37.144 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:37.148 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:37.153 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:37.154 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:40.112 INFO:teuthology.orchestra.run.smithi016.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:40.351 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/671 2023-11-29T02:01:40.351 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/671 2023-11-29T02:01:40.351 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:40.453 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:40.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:40.611 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-11-29T02:01:41.863 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:41.879 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:41.881 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:41.892 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:41.892 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:45.546 INFO:teuthology.orchestra.run.smithi016.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:45.702 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/672 2023-11-29T02:01:45.703 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/672 2023-11-29T02:01:45.704 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:45.747 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:46.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:46.077 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-11-29T02:01:47.597 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:47.622 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:47.623 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:47.627 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:47.627 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:51.506 INFO:teuthology.orchestra.run.smithi016.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:01:51.537 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/673 2023-11-29T02:01:51.537 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/673 2023-11-29T02:01:51.538 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:51.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:51.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:51.983 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-11-29T02:01:53.315 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:53.353 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:53.361 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:53.378 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:53.378 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:55.608 INFO:teuthology.orchestra.run.smithi016.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-29T02:01:55.865 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/674 2023-11-29T02:01:55.865 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/674 2023-11-29T02:01:55.865 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:01:55.951 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:01:56.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:01:56.421 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-11-29T02:01:57.982 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:01:58.027 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:01:58.034 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:01:58.041 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:01:58.041 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:02:00.815 INFO:teuthology.orchestra.run.smithi016.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:02:01.012 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/675 2023-11-29T02:02:01.012 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/675 2023-11-29T02:02:01.012 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:02:01.118 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:02:01.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:02:01.284 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-11-29T02:02:02.609 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:02:02.647 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:02:02.652 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:02:02.663 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:02:02.663 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:14.060 INFO:teuthology.orchestra.run.smithi016.stdout:generic/676 1031s 2023-11-29T02:19:14.109 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/676 2023-11-29T02:19:14.109 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:14.126 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:14.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:14.446 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-11-29T02:19:15.815 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:15.840 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:15.845 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:15.854 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:15.854 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:17.336 INFO:teuthology.orchestra.run.smithi016.stdout:generic/677 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T02:19:17.359 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/677 2023-11-29T02:19:17.359 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/677 2023-11-29T02:19:17.359 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:17.368 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:17.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:17.488 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-11-29T02:19:18.902 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:18.930 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:18.933 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:18.944 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:18.944 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:20.841 INFO:teuthology.orchestra.run.smithi016.stdout:generic/678 1s 2023-11-29T02:19:20.900 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/678 2023-11-29T02:19:20.900 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:20.920 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:21.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:21.255 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-11-29T02:19:22.815 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:22.851 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:22.853 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:22.859 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:22.859 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:24.956 INFO:teuthology.orchestra.run.smithi016.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T02:19:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/679 2023-11-29T02:19:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/679 2023-11-29T02:19:24.980 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:24.998 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:25.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:25.082 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-11-29T02:19:26.376 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:26.412 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:26.413 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:26.417 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:26.418 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:29.272 INFO:teuthology.orchestra.run.smithi016.stdout:generic/680 3s 2023-11-29T02:19:29.341 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/680 2023-11-29T02:19:29.342 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:29.365 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:29.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:29.745 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-11-29T02:19:31.137 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:31.154 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:31.159 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:31.170 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:31.170 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:32.497 INFO:teuthology.orchestra.run.smithi016.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T02:19:32.540 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/681 2023-11-29T02:19:32.541 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/681 2023-11-29T02:19:32.541 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:32.565 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:32.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:32.667 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-11-29T02:19:34.252 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:34.305 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:34.309 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:34.315 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:34.315 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:35.783 INFO:teuthology.orchestra.run.smithi016.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T02:19:35.819 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/682 2023-11-29T02:19:35.819 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/682 2023-11-29T02:19:35.819 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:35.830 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:35.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:35.909 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-11-29T02:19:37.089 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:37.115 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:37.117 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:37.121 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:37.121 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:38.757 INFO:teuthology.orchestra.run.smithi016.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T02:19:38.774 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/683 2023-11-29T02:19:38.775 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/683 2023-11-29T02:19:38.775 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:38.803 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:38.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:38.932 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-11-29T02:19:40.086 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:40.101 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:40.103 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:40.106 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:40.106 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:46.979 INFO:teuthology.orchestra.run.smithi016.stdout:generic/684 6s 2023-11-29T02:19:47.019 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/684 2023-11-29T02:19:47.020 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:47.037 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:47.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:47.348 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-11-29T02:19:48.991 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:49.023 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:49.028 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:49.043 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:49.043 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:51.236 INFO:teuthology.orchestra.run.smithi016.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-29T02:19:51.269 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/685 2023-11-29T02:19:51.269 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/685 2023-11-29T02:19:51.270 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:51.293 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:51.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:51.441 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-11-29T02:19:52.687 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:52.726 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:52.730 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:52.736 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:52.737 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:54.593 INFO:teuthology.orchestra.run.smithi016.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-11-29T02:19:54.625 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/686 2023-11-29T02:19:54.625 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/686 2023-11-29T02:19:54.625 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:54.658 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:54.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:54.775 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-11-29T02:19:55.930 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:55.984 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:55.989 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:55.992 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:55.992 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:58.070 INFO:teuthology.orchestra.run.smithi016.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-29T02:19:58.093 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/687 2023-11-29T02:19:58.093 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/687 2023-11-29T02:19:58.094 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:19:58.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:19:58.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:19:58.219 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-11-29T02:19:59.473 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:19:59.496 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:19:59.502 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:19:59.508 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:19:59.508 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:01.044 INFO:teuthology.orchestra.run.smithi016.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-29T02:20:01.065 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/688 2023-11-29T02:20:01.065 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/688 2023-11-29T02:20:01.065 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:20:01.095 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:01.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:20:01.179 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-11-29T02:20:02.441 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:20:02.478 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:20:02.479 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:20:02.484 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:20:02.484 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:04.446 INFO:teuthology.orchestra.run.smithi016.stdout:generic/689 1s 2023-11-29T02:20:04.501 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/689 2023-11-29T02:20:04.501 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:20:04.511 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:04.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:20:04.586 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-11-29T02:20:05.670 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:20:05.694 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:20:05.696 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:20:05.699 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:20:05.699 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:07.315 INFO:teuthology.orchestra.run.smithi016.stdout:generic/690 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T02:20:07.330 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/690 2023-11-29T02:20:07.331 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/690 2023-11-29T02:20:07.333 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:20:07.365 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:07.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:20:07.487 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-11-29T02:20:08.793 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:20:08.826 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:20:08.828 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:20:08.831 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:20:08.831 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:10.248 INFO:teuthology.orchestra.run.smithi016.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-29T02:20:10.277 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/691 2023-11-29T02:20:10.278 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/691 2023-11-29T02:20:10.278 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:20:10.302 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:10.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:20:10.417 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-11-29T02:20:11.744 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:20:11.776 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:20:11.780 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:20:11.789 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:20:11.790 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:13.285 INFO:teuthology.orchestra.run.smithi016.stdout:generic/692 [not run] fsverity utility required, skipped this test 2023-11-29T02:20:13.299 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/692 2023-11-29T02:20:13.300 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/692 2023-11-29T02:20:13.300 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:20:13.319 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:13.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:20:13.445 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-11-29T02:20:14.609 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:20:14.654 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:20:14.659 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:20:14.669 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:20:14.669 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:17.410 INFO:teuthology.orchestra.run.smithi016.stdout:generic/693 [not run] encryption policy '-c 1 -n 10 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-11-29T02:20:17.497 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/693 2023-11-29T02:20:17.498 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/693 2023-11-29T02:20:17.498 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:20:17.509 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:20:17.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:20:17.613 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-11-29T02:20:18.894 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:20:18.939 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:20:18.945 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:20:18.952 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:20:18.952 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:06.879 INFO:teuthology.orchestra.run.smithi016.stdout:generic/694 47s 2023-11-29T02:21:06.930 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/694 2023-11-29T02:21:06.933 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:06.949 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:07.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:07.053 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-11-29T02:21:08.344 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:08.380 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:08.385 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:08.394 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:08.395 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:10.084 INFO:teuthology.orchestra.run.smithi016.stdout:generic/695 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T02:21:10.100 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/695 2023-11-29T02:21:10.100 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/695 2023-11-29T02:21:10.100 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:10.117 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:10.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:10.225 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-11-29T02:21:11.461 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:11.503 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:11.503 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:11.514 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:11.515 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:15.688 INFO:teuthology.orchestra.run.smithi016.stdout:generic/696 3s 2023-11-29T02:21:15.808 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/696 2023-11-29T02:21:15.809 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:15.843 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:16.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:16.160 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-11-29T02:21:17.815 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:17.865 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:17.869 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:17.882 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:17.882 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:20.590 INFO:teuthology.orchestra.run.smithi016.stdout:generic/697 2s 2023-11-29T02:21:20.623 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/697 2023-11-29T02:21:20.624 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:20.647 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:20.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:20.885 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-11-29T02:21:22.482 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:22.517 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:22.523 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:22.528 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:22.529 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:27.857 INFO:teuthology.orchestra.run.smithi016.stdout:generic/698 5s 2023-11-29T02:21:27.925 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/698 2023-11-29T02:21:27.925 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:27.943 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:27.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:27.997 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-11-29T02:21:29.296 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:29.332 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:29.340 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:29.347 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:29.347 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:32.488 INFO:teuthology.orchestra.run.smithi016.stdout:generic/699 [not run] overlayfs doesn't support idmappped layers 2023-11-29T02:21:32.544 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/699 2023-11-29T02:21:32.544 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/699 2023-11-29T02:21:32.544 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:32.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:32.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:32.818 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-11-29T02:21:34.155 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:34.191 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:34.193 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:34.204 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:34.205 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:36.077 INFO:teuthology.orchestra.run.smithi016.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2023-11-29T02:21:36.106 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/700 2023-11-29T02:21:36.106 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/700 2023-11-29T02:21:36.107 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:21:36.132 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:21:36.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:21:36.540 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-11-29T02:21:37.999 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:21:38.035 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:21:38.042 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:21:38.047 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:21:38.047 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:19.621 INFO:teuthology.orchestra.run.smithi016.stdout:generic/701 41s 2023-11-29T02:22:19.681 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/701 2023-11-29T02:22:19.681 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:22:19.711 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:26.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:22:26.991 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-11-29T02:22:28.414 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:22:28.453 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:22:28.457 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:22:28.471 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:22:28.471 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:30.638 INFO:teuthology.orchestra.run.smithi016.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-29T02:22:30.744 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/702 2023-11-29T02:22:30.746 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/702 2023-11-29T02:22:30.746 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:22:30.873 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:31.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:22:31.219 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-11-29T02:22:32.540 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:22:32.569 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:22:32.572 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:22:32.580 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:22:32.580 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:34.331 INFO:teuthology.orchestra.run.smithi016.stdout:generic/703 [not run] require 172.21.15.16:6789:/scratch to be valid block disk 2023-11-29T02:22:34.372 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/703 2023-11-29T02:22:34.373 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/703 2023-11-29T02:22:34.373 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:22:34.400 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:34.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:22:34.516 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-11-29T02:22:35.879 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:22:35.925 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:22:35.930 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:22:35.936 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:22:35.936 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:37.564 INFO:teuthology.orchestra.run.smithi016.stdout:generic/704 [not run] require 172.21.15.16:6789:/test to be valid block disk 2023-11-29T02:22:37.587 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/704 2023-11-29T02:22:37.588 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/704 2023-11-29T02:22:37.588 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:22:37.601 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:37.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:22:37.677 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-11-29T02:22:38.808 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:22:38.864 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:22:38.871 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:22:38.879 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:22:38.879 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:40.817 INFO:teuthology.orchestra.run.smithi016.stdout:generic/705 [not run] ceph does not support shutdown 2023-11-29T02:22:40.864 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/705 2023-11-29T02:22:40.865 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/705 2023-11-29T02:22:40.865 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:22:40.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:40.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:22:40.975 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-11-29T02:22:42.395 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:22:42.442 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:22:42.450 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:22:42.457 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:22:42.458 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:46.494 INFO:teuthology.orchestra.run.smithi016.stdout:generic/706 4s 2023-11-29T02:22:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/706 2023-11-29T02:22:46.537 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T02:22:46.556 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T02:22:46.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T02:22:46.947 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-11-29T02:22:48.351 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T02:22:48.381 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T02:22:48.386 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T02:22:48.403 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T02:22:48.403 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:12:59.049 INFO:teuthology.orchestra.run.smithi016.stdout:generic/707 3010s 2023-11-29T03:12:59.528 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/707 2023-11-29T03:12:59.528 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:12:59.547 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:12:59.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:12:59.630 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-11-29T03:13:02.018 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:02.072 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:02.077 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:02.081 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:02.081 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:14.698 INFO:teuthology.orchestra.run.smithi016.stdout:generic/708 1s 2023-11-29T03:13:14.750 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/708 2023-11-29T03:13:14.750 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:14.768 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:15.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:15.264 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-11-29T03:13:16.626 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:16.654 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:16.656 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:16.665 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:16.665 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:18.183 INFO:teuthology.orchestra.run.smithi016.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:18.208 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/709 2023-11-29T03:13:18.208 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/709 2023-11-29T03:13:18.208 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:18.239 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:18.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:18.492 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-11-29T03:13:20.318 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:20.361 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:20.367 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:20.381 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:20.382 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:21.992 INFO:teuthology.orchestra.run.smithi016.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:22.030 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/710 2023-11-29T03:13:22.030 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/710 2023-11-29T03:13:22.030 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:22.049 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:22.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:22.269 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-11-29T03:13:23.909 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:23.948 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:23.953 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:23.967 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:23.967 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:25.704 INFO:teuthology.orchestra.run.smithi016.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:25.732 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/711 2023-11-29T03:13:25.732 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/711 2023-11-29T03:13:25.733 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:25.766 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:26.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:26.187 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-11-29T03:13:27.726 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:27.776 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:27.781 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:27.792 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:27.792 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:29.501 INFO:teuthology.orchestra.run.smithi016.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:29.522 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/712 2023-11-29T03:13:29.523 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/712 2023-11-29T03:13:29.523 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:29.532 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:29.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:29.800 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-11-29T03:13:31.332 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:31.364 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:31.368 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:31.377 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:31.377 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:33.134 INFO:teuthology.orchestra.run.smithi016.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-11-29T03:13:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/713 2023-11-29T03:13:33.179 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/713 2023-11-29T03:13:33.180 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:33.214 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:33.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:33.646 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-11-29T03:13:35.045 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:35.102 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:35.103 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:35.108 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:35.108 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:36.678 INFO:teuthology.orchestra.run.smithi016.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:36.725 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/714 2023-11-29T03:13:36.725 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/714 2023-11-29T03:13:36.726 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:36.756 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:37.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:37.273 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-11-29T03:13:38.770 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:38.806 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:38.810 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:38.820 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:38.820 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:40.252 INFO:teuthology.orchestra.run.smithi016.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph 2023-11-29T03:13:40.280 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/715 2023-11-29T03:13:40.281 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/715 2023-11-29T03:13:40.281 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:40.302 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:40.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:40.658 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-11-29T03:13:42.107 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:42.150 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:42.156 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:42.164 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:42.164 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:43.664 INFO:teuthology.orchestra.run.smithi016.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:43.697 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/716 2023-11-29T03:13:43.698 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/716 2023-11-29T03:13:43.698 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:43.719 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:44.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:44.026 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-11-29T03:13:45.576 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:45.616 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:45.619 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:45.629 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:45.630 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:47.192 INFO:teuthology.orchestra.run.smithi016.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:47.235 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/717 2023-11-29T03:13:47.235 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/717 2023-11-29T03:13:47.235 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:47.249 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:47.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:47.599 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-11-29T03:13:49.089 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:49.131 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:49.132 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:49.138 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:49.139 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:50.616 INFO:teuthology.orchestra.run.smithi016.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:50.629 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/718 2023-11-29T03:13:50.629 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/718 2023-11-29T03:13:50.629 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:50.651 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:50.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:50.971 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-11-29T03:13:52.521 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:52.555 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:52.557 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:52.569 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:52.569 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:54.261 INFO:teuthology.orchestra.run.smithi016.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:54.294 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/719 2023-11-29T03:13:54.295 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/719 2023-11-29T03:13:54.295 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:54.310 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:54.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:54.684 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-11-29T03:13:56.273 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:56.316 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:56.325 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:56.327 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:56.327 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:57.917 INFO:teuthology.orchestra.run.smithi016.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:13:57.961 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/720 2023-11-29T03:13:57.961 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/720 2023-11-29T03:13:57.961 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:13:57.979 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:13:58.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:13:58.398 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-11-29T03:13:59.912 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:13:59.930 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:13:59.932 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:13:59.937 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:13:59.937 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:01.585 INFO:teuthology.orchestra.run.smithi016.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-11-29T03:14:01.611 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/721 2023-11-29T03:14:01.611 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/721 2023-11-29T03:14:01.611 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:01.638 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:01.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:01.812 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-11-29T03:14:03.003 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:03.036 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:03.042 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:03.047 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:03.047 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:04.806 INFO:teuthology.orchestra.run.smithi016.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-11-29T03:14:04.847 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/722 2023-11-29T03:14:04.848 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/722 2023-11-29T03:14:04.848 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:04.874 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:05.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:05.152 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-11-29T03:14:06.723 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:06.752 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:06.761 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:06.769 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:06.769 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:08.481 INFO:teuthology.orchestra.run.smithi016.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph 2023-11-29T03:14:08.525 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/723 2023-11-29T03:14:08.525 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/723 2023-11-29T03:14:08.525 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:08.558 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:08.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:08.909 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-11-29T03:14:10.546 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:10.582 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:10.583 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:10.589 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:10.589 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:12.221 INFO:teuthology.orchestra.run.smithi016.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-11-29T03:14:12.259 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/724 2023-11-29T03:14:12.261 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/724 2023-11-29T03:14:12.261 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:12.278 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:12.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:12.575 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-11-29T03:14:14.177 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:14.231 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:14.232 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:14.237 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:14.237 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:15.870 INFO:teuthology.orchestra.run.smithi016.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-11-29T03:14:15.900 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/725 2023-11-29T03:14:15.900 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/725 2023-11-29T03:14:15.900 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:15.912 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:16.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:16.158 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-11-29T03:14:17.538 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:17.585 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:17.592 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:17.599 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:17.600 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:20.354 INFO:teuthology.orchestra.run.smithi016.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-11-29T03:14:20.379 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/726 2023-11-29T03:14:20.379 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/726 2023-11-29T03:14:20.379 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:20.407 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:20.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:20.724 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-11-29T03:14:22.275 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:22.322 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:22.322 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:22.330 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:22.330 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:24.089 INFO:teuthology.orchestra.run.smithi016.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph 2023-11-29T03:14:24.114 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/727 2023-11-29T03:14:24.114 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/727 2023-11-29T03:14:24.114 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:24.140 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:24.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:24.504 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-11-29T03:14:25.972 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:26.014 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:26.021 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:26.033 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:26.033 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:32.094 INFO:teuthology.orchestra.run.smithi016.stdout:generic/728 6s 2023-11-29T03:14:32.147 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/728 2023-11-29T03:14:32.148 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:32.178 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:32.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:32.437 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-11-29T03:14:34.104 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:34.149 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:34.159 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:34.172 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:34.172 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:36.368 INFO:teuthology.orchestra.run.smithi016.stdout:generic/729 2s 2023-11-29T03:14:36.412 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/729 2023-11-29T03:14:36.412 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:36.432 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:36.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:36.700 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-11-29T03:14:38.337 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:38.380 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:38.382 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:38.391 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:38.391 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:39.918 INFO:teuthology.orchestra.run.smithi016.stdout:generic/730 [not run] require 172.21.15.16:6789:/test to be valid block disk 2023-11-29T03:14:39.942 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/730 2023-11-29T03:14:39.942 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/730 2023-11-29T03:14:39.942 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:39.966 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:40.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:40.035 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-11-29T03:14:41.254 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:41.293 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:41.295 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:41.300 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:41.300 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:42.882 INFO:teuthology.orchestra.run.smithi016.stdout:generic/731 [not run] require 172.21.15.16:6789:/test to be valid block disk 2023-11-29T03:14:42.918 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/731 2023-11-29T03:14:42.918 INFO:teuthology.orchestra.run.smithi016.stdout:Not run: generic/731 2023-11-29T03:14:42.918 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:42.934 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:43.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:43.018 DEBUG:teuthology.orchestra.run.smithi016:> (cd /tmp/tmp.SqFPnd7Bgcxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2023-11-29T03:14:44.474 INFO:teuthology.orchestra.run.smithi016.stdout:FSTYP -- ceph 2023-11-29T03:14:44.499 INFO:teuthology.orchestra.run.smithi016.stdout:PLATFORM -- Linux/x86_64 smithi016 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-29T03:14:44.503 INFO:teuthology.orchestra.run.smithi016.stdout:MKFS_OPTIONS -- 172.21.15.16:6789:/scratch 2023-11-29T03:14:44.519 INFO:teuthology.orchestra.run.smithi016.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQCcJWZlQYABBRAAQjuwHmmz8HkTEgpdizhkxw== 172.21.15.16:6789:/scratch /tmp/tmp.Vlt2oGtC1Iscratch 2023-11-29T03:14:44.519 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:47.752 INFO:teuthology.orchestra.run.smithi016.stdout:generic/732 3s 2023-11-29T03:14:47.805 INFO:teuthology.orchestra.run.smithi016.stdout:Ran: generic/732 2023-11-29T03:14:47.806 INFO:teuthology.orchestra.run.smithi016.stdout:Passed all 1 tests 2023-11-29T03:14:47.814 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:47.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-11-29T03:14:47.883 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 1========================================================= 2023-11-29T03:14:47.887 DEBUG:teuthology.orchestra.run.smithi016:> sudo userdel --force --remove fsgqa 2023-11-29T03:14:48.107 INFO:teuthology.orchestra.run.smithi016.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-11-29T03:14:48.484 DEBUG:teuthology.orchestra.run.smithi016:> sudo userdel --force --remove 123456-fsgqa 2023-11-29T03:14:48.574 INFO:teuthology.orchestra.run.smithi016.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-11-29T03:14:48.574 INFO:teuthology.orchestra.run.smithi016.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-11-29T03:14:48.992 DEBUG:teuthology.orchestra.run.smithi016:> sudo groupdel fsgqa 2023-11-29T03:14:49.042 INFO:teuthology.orchestra.run.smithi016.stderr:groupdel: group 'fsgqa' does not exist 2023-11-29T03:14:49.049 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-11-29T03:14:49.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:14:49.050 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.SqFPnd7Bgcxfstests-dev/results) 2023-11-29T03:14:49.259 INFO:teuthology.orchestra.run.smithi016.stdout: File: /tmp/tmp.SqFPnd7Bgcxfstests-dev/results 2023-11-29T03:14:49.259 INFO:teuthology.orchestra.run.smithi016.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2023-11-29T03:14:49.259 INFO:teuthology.orchestra.run.smithi016.stdout:Device: 801h/2049d Inode: 799829 Links: 3 2023-11-29T03:14:49.259 INFO:teuthology.orchestra.run.smithi016.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-29T03:14:49.259 INFO:teuthology.orchestra.run.smithi016.stdout:Access: 2023-11-28 17:42:44.280693718 +0000 2023-11-29T03:14:49.259 INFO:teuthology.orchestra.run.smithi016.stdout:Modify: 2023-11-29 03:14:47.793999363 +0000 2023-11-29T03:14:49.260 INFO:teuthology.orchestra.run.smithi016.stdout:Change: 2023-11-29 03:14:47.793999363 +0000 2023-11-29T03:14:49.260 INFO:teuthology.orchestra.run.smithi016.stdout: Birth: 2023-11-28 17:42:44.280693718 +0000 2023-11-29T03:14:49.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:14:49.273 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2023-11-29T03:14:49.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:14:49.369 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.SqFPnd7Bgcxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2023-11-29T03:14:51.452 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.SqFPnd7Bgcxfstests-dev to /var/log/ceph. 2023-11-29T03:14:51.453 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf /tmp/tmp.SqFPnd7Bgcxfstests-dev 2023-11-29T03:14:52.568 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-29T03:14:52.569 DEBUG:teuthology.orchestra.run.smithi016:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T03:14:52.827 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-29T03:14:53.402 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-29T03:14:53.403 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-29T03:14:53.403 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:14:53.454 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-29T03:14:53.455 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:14:53.539 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T03:14:54.953 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.945+0000 7fec7e079640 1 Processor -- start 2023-11-29T03:14:54.958 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.945+0000 7fec7e079640 1 -- start start 2023-11-29T03:14:54.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.953+0000 7fec7e079640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec780c47c0 0x7fec780b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:54.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.957+0000 7fec7e079640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7806fdc0 con 0x7fec780d08c0 2023-11-29T03:14:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.957+0000 7fec7e079640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec780700a0 con 0x7fec7809a450 2023-11-29T03:14:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.957+0000 7fec777fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fec780d08c0 0x7fec780c40b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:34046/0 (socket says 172.21.15.16:34046) 2023-11-29T03:14:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.957+0000 7fec777fe640 1 -- 172.21.15.16:0/3010045959 learned_addr learned my addr 172.21.15.16:0/3010045959 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:14:54.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.957+0000 7fec76ffd640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fec780c47c0 0x7fec780b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:54.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.957+0000 7fec7e079640 1 -- 172.21.15.16:0/3010045959 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7806b6b0 con 0x7fec780c47c0 2023-11-29T03:14:54.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.961+0000 7fec76ffd640 1 -- 172.21.15.16:0/3010045959 >> v1:172.21.15.64:6789/0 conn(0x7fec7809a450 legacy=0x7fec780cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:14:54.966 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.961+0000 7fec76ffd640 1 -- 172.21.15.16:0/3010045959 >> v1:172.21.15.16:6789/0 conn(0x7fec780d08c0 legacy=0x7fec780c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:14:54.971 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:54.965+0000 7fec76ffd640 1 -- 172.21.15.16:0/3010045959 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec78070380 con 0x7fec780c47c0 2023-11-29T03:14:55.023 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.017+0000 7fec76ffd640 1 --2- 172.21.15.16:0/3010045959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780c47c0 0x7fec780b36f0 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7fec680097c0 tx=0x7fec6801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7235db4b92cac3b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.025+0000 7fec767fc640 1 -- 172.21.15.16:0/3010045959 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680ab600 con 0x7fec780c47c0 2023-11-29T03:14:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.025+0000 7fec767fc640 1 -- 172.21.15.16:0/3010045959 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680a7050 con 0x7fec780c47c0 2023-11-29T03:14:55.037 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.025+0000 7fec767fc640 1 -- 172.21.15.16:0/3010045959 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680ab980 con 0x7fec780c47c0 2023-11-29T03:14:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.033+0000 7fec7e079640 1 -- 172.21.15.16:0/3010045959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780c47c0 msgr2=0x7fec780b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.033+0000 7fec7e079640 1 --2- 172.21.15.16:0/3010045959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780c47c0 0x7fec780b36f0 secure :-1 s=READY pgs=3272 cs=0 l=1 rev1=1 crypto rx=0x7fec680097c0 tx=0x7fec6801c400 comp rx=0 tx=0).stop 2023-11-29T03:14:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.033+0000 7fec7e079640 1 -- 172.21.15.16:0/3010045959 shutdown_connections 2023-11-29T03:14:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.033+0000 7fec7e079640 1 --2- 172.21.15.16:0/3010045959 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780c47c0 0x7fec780b36f0 unknown :-1 s=CLOSED pgs=3272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.033+0000 7fec7e079640 1 -- 172.21.15.16:0/3010045959 >> 172.21.15.16:0/3010045959 conn(0x7fec780b2bd0 msgr2=0x7fec780b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:55.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.033+0000 7fec7e079640 1 -- 172.21.15.16:0/3010045959 shutdown_connections 2023-11-29T03:14:55.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.041+0000 7fec7e079640 1 -- 172.21.15.16:0/3010045959 wait complete. 2023-11-29T03:14:55.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.049+0000 7fec7e079640 1 Processor -- start 2023-11-29T03:14:55.059 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.053+0000 7fec7e079640 1 -- start start 2023-11-29T03:14:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.061+0000 7fec7e079640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec7809a450 0x7fec780cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.061+0000 7fec7e079640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 0x7fec78157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.061+0000 7fec7e079640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780d08c0 0x7fec780c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 0x7fec78157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec7e079640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780cbf00 con 0x7fec780d08c0 2023-11-29T03:14:55.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec7e079640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec780cd960 con 0x7fec780c47c0 2023-11-29T03:14:55.071 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 0x7fec78157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:45834/0 (socket says 172.21.15.16:45834) 2023-11-29T03:14:55.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 -- 172.21.15.16:0/2294768863 learned_addr learned my addr 172.21.15.16:0/2294768863 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:55.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec777fe640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec7809a450 0x7fec780cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec780cb8b0 con 0x7fec7809a450 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec77fff640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780d08c0 0x7fec780c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 -- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec7809a450 msgr2=0x7fec780cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec7809a450 0x7fec780cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 -- 172.21.15.16:0/2294768863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780d08c0 msgr2=0x7fec780c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780d08c0 0x7fec780c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 -- 172.21.15.16:0/2294768863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009420 con 0x7fec780c47c0 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec77fff640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780d08c0 0x7fec780c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.065+0000 7fec76ffd640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 0x7fec78157c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec68019010 tx=0x7fec680191a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.113+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680b4600 con 0x7fec780c47c0 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.113+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec680b4760 con 0x7fec780c47c0 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.113+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec680b4ad0 con 0x7fec780c47c0 2023-11-29T03:14:55.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.113+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec780cbb90 con 0x7fec780c47c0 2023-11-29T03:14:55.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.113+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec780c8c30 con 0x7fec780c47c0 2023-11-29T03:14:55.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.117+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5c005260 con 0x7fec780c47c0 2023-11-29T03:14:55.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.121+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fec680b2040 con 0x7fec780c47c0 2023-11-29T03:14:55.139 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.133+0000 7fec6ffff640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fec58066920 0x7fec58068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.133+0000 7fec777fe640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fec58066920 0x7fec58068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.141 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.133+0000 7fec777fe640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fec58066920 0x7fec58068de0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fec60007ca0 tx=0x7fec60007bf0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:55.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.165+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fec680ef6a0 con 0x7fec780c47c0 2023-11-29T03:14:55.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.217+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec680eb300 con 0x7fec780c47c0 2023-11-29T03:14:55.494 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.485+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec5c005510 con 0x7fec780c47c0 2023-11-29T03:14:55.528 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.521+0000 7fec6ffff640 1 -- 172.21.15.16:0/2294768863 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16711 (secure 0 0 0) 0x7fec680b0020 con 0x7fec780c47c0 2023-11-29T03:14:55.531 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:14:55.531 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:41:17.472386+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fec58066920 msgr2=0x7fec58068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fec58066920 0x7fec58068de0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fec60007ca0 tx=0x7fec60007bf0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 msgr2=0x7fec78157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 0x7fec78157c20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fec68019010 tx=0x7fec680191a0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 shutdown_connections 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fec780d08c0 0x7fec780c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.534 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fec58066920 0x7fec58068de0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fec780c47c0 0x7fec78157c20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 --2- 172.21.15.16:0/2294768863 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fec7809a450 0x7fec780cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 >> 172.21.15.16:0/2294768863 conn(0x7fec780b2bd0 msgr2=0x7fec780c40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:55.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 shutdown_connections 2023-11-29T03:14:55.535 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.525+0000 7fec7e079640 1 -- 172.21.15.16:0/2294768863 wait complete. 2023-11-29T03:14:55.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:40:25.116530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:40:26.310896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T03:14:55.627 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T03:14:55.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.913+0000 7f7b46a67640 1 Processor -- start 2023-11-29T03:14:55.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.913+0000 7f7b46a67640 1 -- start start 2023-11-29T03:14:55.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b46a67640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7b4006b160 0x7f7b400703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b46a67640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b400b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b46a67640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f7b40159150 0x7f7b4006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b46a67640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400cecb0 con 0x7f7b40159150 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b46a67640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b400ccd80 con 0x7f7b4006b160 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b46a67640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b400b4460 con 0x7f7b400ce2c0 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b400b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b400b28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:42976/0 (socket says 172.21.15.16:42976) 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 -- 172.21.15.16:0/3163587730 learned_addr learned my addr 172.21.15.16:0/3163587730 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:55.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45a65640 1 --2- 172.21.15.16:0/3163587730 >> v2:172.21.15.64:3300/0 conn(0x7f7b4006b160 0x7f7b400703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 -- 172.21.15.16:0/3163587730 >> v2:172.21.15.64:3300/0 conn(0x7f7b4006b160 msgr2=0x7f7b400703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:14:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 --2- 172.21.15.16:0/3163587730 >> v2:172.21.15.64:3300/0 conn(0x7f7b4006b160 0x7f7b400703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 -- 172.21.15.16:0/3163587730 >> v2:172.21.15.16:3300/0 conn(0x7f7b40159150 msgr2=0x7f7b4006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:14:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 --2- 172.21.15.16:0/3163587730 >> v2:172.21.15.16:3300/0 conn(0x7f7b40159150 0x7f7b4006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.921+0000 7f7b45264640 1 -- 172.21.15.16:0/3163587730 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b400b3c50 con 0x7f7b400ce2c0 2023-11-29T03:14:55.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.933+0000 7f7b45264640 1 --2- 172.21.15.16:0/3163587730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b400b28a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7b4006d940 tx=0x7f7b3002fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12609731bd4a9ef5 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:55.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.937+0000 7f7b44a63640 1 -- 172.21.15.16:0/3163587730 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b9af0 con 0x7f7b400ce2c0 2023-11-29T03:14:55.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.937+0000 7f7b44a63640 1 -- 172.21.15.16:0/3163587730 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300b9c50 con 0x7f7b400ce2c0 2023-11-29T03:14:55.944 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.937+0000 7f7b44a63640 1 -- 172.21.15.16:0/3163587730 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300c1440 con 0x7f7b400ce2c0 2023-11-29T03:14:55.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.937+0000 7f7b46a67640 1 -- 172.21.15.16:0/3163587730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 msgr2=0x7f7b400b28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.937+0000 7f7b46a67640 1 --2- 172.21.15.16:0/3163587730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b400b28a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7b4006d940 tx=0x7f7b3002fd20 comp rx=0 tx=0).stop 2023-11-29T03:14:55.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 -- 172.21.15.16:0/3163587730 shutdown_connections 2023-11-29T03:14:55.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 --2- 172.21.15.16:0/3163587730 >> v2:172.21.15.16:3300/0 conn(0x7f7b40159150 0x7f7b4006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 --2- 172.21.15.16:0/3163587730 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b400b28a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 --2- 172.21.15.16:0/3163587730 >> v2:172.21.15.64:3300/0 conn(0x7f7b4006b160 0x7f7b400703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.948 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 -- 172.21.15.16:0/3163587730 >> 172.21.15.16:0/3163587730 conn(0x7f7b4006a5a0 msgr2=0x7f7b4006a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:55.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 -- 172.21.15.16:0/3163587730 shutdown_connections 2023-11-29T03:14:55.949 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.941+0000 7f7b46a67640 1 -- 172.21.15.16:0/3163587730 wait complete. 2023-11-29T03:14:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.949+0000 7f7b46a67640 1 Processor -- start 2023-11-29T03:14:55.955 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.949+0000 7f7b46a67640 1 -- start start 2023-11-29T03:14:55.959 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b46a67640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b4006b160 0x7f7b401ee590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.960 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b46a67640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b4014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b46a67640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b40159150 0x7f7b4013b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b46a67640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4014fc30 con 0x7f7b40159150 2023-11-29T03:14:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b46a67640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4014ff10 con 0x7f7b4006b160 2023-11-29T03:14:55.961 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b46a67640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401501f0 con 0x7f7b400ce2c0 2023-11-29T03:14:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b4014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b4014cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:42982/0 (socket says 172.21.15.16:42982) 2023-11-29T03:14:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 -- 172.21.15.16:0/1782258213 learned_addr learned my addr 172.21.15.16:0/1782258213 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:55.962 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45a65640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b4006b160 0x7f7b401ee590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 -- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b4006b160 msgr2=0x7f7b401ee590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b4006b160 0x7f7b401ee590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 -- 172.21.15.16:0/1782258213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b40159150 msgr2=0x7f7b4013b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b40159150 0x7f7b4013b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:55.963 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45264640 1 -- 172.21.15.16:0/1782258213 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300094d0 con 0x7f7b400ce2c0 2023-11-29T03:14:55.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.953+0000 7f7b45a65640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b4006b160 0x7f7b401ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:14:55.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b45264640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b4014cf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b300c4040 tx=0x7f7b3002cac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:55.964 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300c1d50 con 0x7f7b400ce2c0 2023-11-29T03:14:55.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300cc470 con 0x7f7b400ce2c0 2023-11-29T03:14:55.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300cc820 con 0x7f7b400ce2c0 2023-11-29T03:14:55.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b401504d0 con 0x7f7b400ce2c0 2023-11-29T03:14:55.965 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4014d470 con 0x7f7b400ce2c0 2023-11-29T03:14:55.967 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.957+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400cb710 con 0x7f7b400ce2c0 2023-11-29T03:14:55.969 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.961+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f7b300c8070 con 0x7f7b400ce2c0 2023-11-29T03:14:55.973 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.965+0000 7f7b367fc640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7b24066900 0x7f7b24068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:55.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.965+0000 7f7b45a65640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7b24066900 0x7f7b24068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:55.974 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.965+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f7b30133610 con 0x7f7b400ce2c0 2023-11-29T03:14:55.977 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:55.969+0000 7f7b45a65640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7b24066900 0x7f7b24068dc0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e740 tx=0x7f7b3800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:56.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.025+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b301008f0 con 0x7f7b400ce2c0 2023-11-29T03:14:56.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.305+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b4004e890 con 0x7f7b400ce2c0 2023-11-29T03:14:56.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.317+0000 7f7b367fc640 1 -- 172.21.15.16:0/1782258213 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b30103f10 con 0x7f7b400ce2c0 2023-11-29T03:14:56.326 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-29T03:14:56.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7b24066900 msgr2=0x7f7b24068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:56.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7b24066900 0x7f7b24068dc0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e740 tx=0x7f7b3800b040 comp rx=0 tx=0).stop 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 msgr2=0x7f7b4014cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b4014cf30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7b300c4040 tx=0x7f7b3002cac0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 shutdown_connections 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7b40159150 0x7f7b4013b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7b400ce2c0 0x7f7b4014cf30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f7b24066900 0x7f7b24068dc0 secure :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f7b3800e740 tx=0x7f7b3800b040 comp rx=0 tx=0).stop 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 --2- 172.21.15.16:0/1782258213 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b4006b160 0x7f7b401ee590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.325+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 >> 172.21.15.16:0/1782258213 conn(0x7f7b4006a5a0 msgr2=0x7f7b400afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.329+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 shutdown_connections 2023-11-29T03:14:56.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.329+0000 7f7b46a67640 1 -- 172.21.15.16:0/1782258213 wait complete. 2023-11-29T03:14:56.417 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T03:14:56.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.673+0000 7feab29c4640 1 Processor -- start 2023-11-29T03:14:56.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.673+0000 7feab29c4640 1 -- start start 2023-11-29T03:14:56.686 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.677+0000 7feab29c4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7feaac06c330 0x7feaac070ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:56.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feab29c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac071020 0x7feaac0cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:56.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feab29c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0ce560 con 0x7feaac159430 2023-11-29T03:14:56.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feab29c4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaac071490 con 0x7feaac06c330 2023-11-29T03:14:56.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feab29c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac159810 con 0x7feaac071020 2023-11-29T03:14:56.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feaabfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7feaac159430 0x7feaac0b2710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:46584/0 (socket says 172.21.15.16:46584) 2023-11-29T03:14:56.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feaabfff640 1 -- 172.21.15.16:0/1752712816 learned_addr learned my addr 172.21.15.16:0/1752712816 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:14:56.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feab0f61640 1 --2- 172.21.15.16:0/1752712816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac071020 0x7feaac0cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:56.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feaaaffd640 1 -- 172.21.15.16:0/1752712816 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182639912 0 0) 0x7feaac0ce560 con 0x7feaac159430 2023-11-29T03:14:56.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.681+0000 7feaaaffd640 1 -- 172.21.15.16:0/1752712816 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea94003450 con 0x7feaac159430 2023-11-29T03:14:56.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.685+0000 7feab0f61640 1 -- 172.21.15.16:0/1752712816 >> v2:172.21.15.16:3300/0 conn(0x7feaac06c330 msgr2=0x7feaac070ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:14:56.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.685+0000 7feab0f61640 1 --2- 172.21.15.16:0/1752712816 >> v2:172.21.15.16:3300/0 conn(0x7feaac06c330 0x7feaac070ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.685+0000 7feab0f61640 1 -- 172.21.15.16:0/1752712816 >> v1:172.21.15.64:6789/0 conn(0x7feaac159430 legacy=0x7feaac0b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:56.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.685+0000 7feab0f61640 1 -- 172.21.15.16:0/1752712816 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0b2f40 con 0x7feaac071020 2023-11-29T03:14:56.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.685+0000 7feab0f61640 1 --2- 172.21.15.16:0/1752712816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac071020 0x7feaac0cea40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009d90 tx=0x7feaa401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e34b963f61d8c9b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:56.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feaaaffd640 1 -- 172.21.15.16:0/1752712816 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40a5960 con 0x7feaac071020 2023-11-29T03:14:56.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feaaaffd640 1 -- 172.21.15.16:0/1752712816 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40a5ac0 con 0x7feaac071020 2023-11-29T03:14:56.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feaaaffd640 1 -- 172.21.15.16:0/1752712816 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40a5e50 con 0x7feaac071020 2023-11-29T03:14:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 -- 172.21.15.16:0/1752712816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac071020 msgr2=0x7feaac0cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 --2- 172.21.15.16:0/1752712816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac071020 0x7feaac0cea40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009d90 tx=0x7feaa401c900 comp rx=0 tx=0).stop 2023-11-29T03:14:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 -- 172.21.15.16:0/1752712816 shutdown_connections 2023-11-29T03:14:56.699 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 --2- 172.21.15.16:0/1752712816 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac071020 0x7feaac0cea40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 --2- 172.21.15.16:0/1752712816 >> v2:172.21.15.16:3300/0 conn(0x7feaac06c330 0x7feaac070ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 -- 172.21.15.16:0/1752712816 >> 172.21.15.16:0/1752712816 conn(0x7feaac06a5a0 msgr2=0x7feaac06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 -- 172.21.15.16:0/1752712816 shutdown_connections 2023-11-29T03:14:56.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.689+0000 7feab29c4640 1 -- 172.21.15.16:0/1752712816 wait complete. 2023-11-29T03:14:56.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 Processor -- start 2023-11-29T03:14:56.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 -- start start 2023-11-29T03:14:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac06c330 0x7feaac14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:56.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaac071020 0x7feaac15b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 0x7feaac0b0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac150340 con 0x7feaac159430 2023-11-29T03:14:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac159980 con 0x7feaac071020 2023-11-29T03:14:56.703 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.693+0000 7feab29c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1fb9e0 con 0x7feaac06c330 2023-11-29T03:14:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 0x7feaac0b0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 0x7feaac0b0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37448/0 (socket says 172.21.15.16:37448) 2023-11-29T03:14:56.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 -- 172.21.15.16:0/3731006842 learned_addr learned my addr 172.21.15.16:0/3731006842 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 -- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac06c330 msgr2=0x7feaac14fe00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac06c330 0x7feaac14fe00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 -- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaac071020 msgr2=0x7feaac15b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feaab7fe640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaac071020 0x7feaac15b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaac071020 0x7feaac15b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 -- 172.21.15.16:0/3731006842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4009a70 con 0x7feaac159430 2023-11-29T03:14:56.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feaab7fe640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaac071020 0x7feaac15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T03:14:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab0f61640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 0x7feaac0b0370 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009d90 tx=0x7feaa40196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40aed80 con 0x7feaac159430 2023-11-29T03:14:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa4009450 con 0x7feaac159430 2023-11-29T03:14:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac0afb70 con 0x7feaac159430 2023-11-29T03:14:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40b7630 con 0x7feaac159430 2023-11-29T03:14:56.707 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.697+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac159b90 con 0x7feaac159430 2023-11-29T03:14:56.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.705+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7feaa40b4050 con 0x7feaac159430 2023-11-29T03:14:56.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.705+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac068860 con 0x7feaac159430 2023-11-29T03:14:56.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.709+0000 7feaa8ff9640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea98066950 0x7fea98068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:56.722 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.717+0000 7feaabfff640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea98066950 0x7fea98068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:56.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.717+0000 7feaabfff640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea98066950 0x7fea98068e10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000c10 tx=0x7fea9c007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:56.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.717+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feaa40f10a0 con 0x7feaac159430 2023-11-29T03:14:56.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:56.825+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feaa40ecce0 con 0x7feaac159430 2023-11-29T03:14:57.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.661+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feaac0b2a10 con 0x7feaac159430 2023-11-29T03:14:57.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.689+0000 7feaa8ff9640 1 -- 172.21.15.16:0/3731006842 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7feaa40c70a0 con 0x7feaac159430 2023-11-29T03:14:57.699 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-29T03:14:57.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea98066950 msgr2=0x7fea98068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:57.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea98066950 0x7fea98068e10 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000c10 tx=0x7fea9c007990 comp rx=0 tx=0).stop 2023-11-29T03:14:57.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 msgr2=0x7feaac0b0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:57.704 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 0x7feaac0b0370 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7feaa4009d90 tx=0x7feaa40196a0 comp rx=0 tx=0).stop 2023-11-29T03:14:57.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 shutdown_connections 2023-11-29T03:14:57.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7feaac159430 0x7feaac0b0370 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:57.705 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fea98066950 0x7fea98068e10 secure :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fea9c000c10 tx=0x7fea9c007990 comp rx=0 tx=0).stop 2023-11-29T03:14:57.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7feaac071020 0x7feaac15b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:57.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 --2- 172.21.15.16:0/3731006842 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7feaac06c330 0x7feaac14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:57.706 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.697+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 >> 172.21.15.16:0/3731006842 conn(0x7feaac06a5a0 msgr2=0x7feaac156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:57.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.701+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 shutdown_connections 2023-11-29T03:14:57.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:57.701+0000 7feab29c4640 1 -- 172.21.15.16:0/3731006842 wait complete. 2023-11-29T03:14:57.748 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T03:14:58.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.357+0000 7fdca62c9640 1 Processor -- start 2023-11-29T03:14:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.357+0000 7fdca62c9640 1 -- start start 2023-11-29T03:14:58.365 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.357+0000 7fdca62c9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdca015d540 0x7fdca00b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.357+0000 7fdca62c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00b32c0 con 0x7fdca00d3690 2023-11-29T03:14:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.357+0000 7fdca62c9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca00b35a0 con 0x7fdca00d1f50 2023-11-29T03:14:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.357+0000 7fdca62c9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca015d920 con 0x7fdca015d540 2023-11-29T03:14:58.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.361+0000 7fdc977fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdca00d1f50 0x7fdca00d2f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:45180/0 (socket says 172.21.15.16:45180) 2023-11-29T03:14:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.361+0000 7fdca4866640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fdca00d3690 0x7fdca00cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35228/0 (socket says 172.21.15.16:35228) 2023-11-29T03:14:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.361+0000 7fdc977fe640 1 -- 172.21.15.16:0/2082685563 learned_addr learned my addr 172.21.15.16:0/2082685563 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:14:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.361+0000 7fdc9ffff640 1 --2- 172.21.15.16:0/2082685563 >> v2:172.21.15.64:3300/0 conn(0x7fdca015d540 0x7fdca00b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:58.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.361+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036624127 0 0) 0x7fdca00b35a0 con 0x7fdca00d1f50 2023-11-29T03:14:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc8c003530 con 0x7fdca00d1f50 2023-11-29T03:14:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2797274206 0 0) 0x7fdca00b32c0 con 0x7fdca00d3690 2023-11-29T03:14:58.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdca00b35a0 con 0x7fdca00d3690 2023-11-29T03:14:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2629056971 0 0) 0x7fdc8c003530 con 0x7fdca00d1f50 2023-11-29T03:14:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9ffff640 1 -- 172.21.15.16:0/2082685563 >> v1:172.21.15.64:6789/0 conn(0x7fdca00d1f50 legacy=0x7fdca00d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9ffff640 1 -- 172.21.15.16:0/2082685563 >> v1:172.21.15.16:6789/0 conn(0x7fdca00d3690 legacy=0x7fdca00cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:58.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.365+0000 7fdc9ffff640 1 -- 172.21.15.16:0/2082685563 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca00b3880 con 0x7fdca015d540 2023-11-29T03:14:58.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.381+0000 7fdc9ffff640 1 --2- 172.21.15.16:0/2082685563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca015d540 0x7fdca00b29c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009d90 tx=0x7fdc9001c6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=565a260e9789cadd server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:58.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.381+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98001600 con 0x7fdca015d540 2023-11-29T03:14:58.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.381+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc900a5570 con 0x7fdca015d540 2023-11-29T03:14:58.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.381+0000 7fdc9f7fe640 1 -- 172.21.15.16:0/2082685563 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98001600 con 0x7fdca015d540 2023-11-29T03:14:58.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.385+0000 7fdca62c9640 1 -- 172.21.15.16:0/2082685563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca015d540 msgr2=0x7fdca00b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:58.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.385+0000 7fdca62c9640 1 --2- 172.21.15.16:0/2082685563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca015d540 0x7fdca00b29c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fdc90009d90 tx=0x7fdc9001c6f0 comp rx=0 tx=0).stop 2023-11-29T03:14:58.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.385+0000 7fdca62c9640 1 -- 172.21.15.16:0/2082685563 shutdown_connections 2023-11-29T03:14:58.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.385+0000 7fdca62c9640 1 --2- 172.21.15.16:0/2082685563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca015d540 0x7fdca00b29c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:58.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.385+0000 7fdca62c9640 1 -- 172.21.15.16:0/2082685563 >> 172.21.15.16:0/2082685563 conn(0x7fdca008ccf0 msgr2=0x7fdca009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:58.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.389+0000 7fdca62c9640 1 -- 172.21.15.16:0/2082685563 shutdown_connections 2023-11-29T03:14:58.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.389+0000 7fdca62c9640 1 -- 172.21.15.16:0/2082685563 wait complete. 2023-11-29T03:14:58.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.397+0000 7fdca62c9640 1 Processor -- start 2023-11-29T03:14:58.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.397+0000 7fdca62c9640 1 -- start start 2023-11-29T03:14:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdca62c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 0x7fdca015daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdca62c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdca00d3690 0x7fdca0154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdca62c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca015d540 0x7fdca0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdca62c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca015e080 con 0x7fdca015d540 2023-11-29T03:14:58.411 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdca62c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca015e360 con 0x7fdca00d1f50 2023-11-29T03:14:58.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdca62c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca015e640 con 0x7fdca00d3690 2023-11-29T03:14:58.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.401+0000 7fdc9ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 0x7fdca015daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:58.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 0x7fdca015daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:55810/0 (socket says 172.21.15.16:55810) 2023-11-29T03:14:58.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 -- 172.21.15.16:0/146775484 learned_addr learned my addr 172.21.15.16:0/146775484 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:58.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdca4866640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca015d540 0x7fdca0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc977fe640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdca00d3690 0x7fdca0154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 -- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdca00d3690 msgr2=0x7fdca0154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:58.414 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdca00d3690 0x7fdca0154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:58.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 -- 172.21.15.16:0/146775484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca015d540 msgr2=0x7fdca0154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:58.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca015d540 0x7fdca0154160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:58.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc9ffff640 1 -- 172.21.15.16:0/146775484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc90009a70 con 0x7fdca00d1f50 2023-11-29T03:14:58.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.405+0000 7fdc977fe640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdca00d3690 0x7fdca0154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T03:14:58.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.409+0000 7fdc9ffff640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 0x7fdca015daa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc9001a320 tx=0x7fdc90019490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:58.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.413+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc98001600 con 0x7fdca00d1f50 2023-11-29T03:14:58.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.413+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc900ad440 con 0x7fdca00d1f50 2023-11-29T03:14:58.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.413+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc88001680 con 0x7fdca00d1f50 2023-11-29T03:14:58.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.413+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca015e920 con 0x7fdca00d1f50 2023-11-29T03:14:58.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.413+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca0159170 con 0x7fdca00d1f50 2023-11-29T03:14:58.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.421+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc84005260 con 0x7fdca00d1f50 2023-11-29T03:14:58.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.425+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc900ad5f0 con 0x7fdca00d1f50 2023-11-29T03:14:58.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.429+0000 7fdc9d7fa640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc80066920 0x7fdc80068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:58.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.429+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdc9011ede0 con 0x7fdca00d1f50 2023-11-29T03:14:58.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.429+0000 7fdc977fe640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc80066920 0x7fdc80068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:58.439 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.433+0000 7fdc977fe640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc80066920 0x7fdc80068de0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdc880011f0 tx=0x7fdc88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:58.446 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:58.437+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc900ec250 con 0x7fdca00d1f50 2023-11-29T03:14:59.277 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.269+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc84005a90 con 0x7fdca00d1f50 2023-11-29T03:14:59.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.273+0000 7fdc9d7fa640 1 -- 172.21.15.16:0/146775484 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc900c6020 con 0x7fdca00d1f50 2023-11-29T03:14:59.281 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-29T03:14:59.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc80066920 msgr2=0x7fdc80068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:59.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc80066920 0x7fdc80068de0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdc880011f0 tx=0x7fdc88009040 comp rx=0 tx=0).stop 2023-11-29T03:14:59.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 msgr2=0x7fdca015daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:59.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 0x7fdca015daa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdc9001a320 tx=0x7fdc90019490 comp rx=0 tx=0).stop 2023-11-29T03:14:59.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 shutdown_connections 2023-11-29T03:14:59.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdca015d540 0x7fdca0154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdca00d3690 0x7fdca0154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc80066920 0x7fdc80068de0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 --2- 172.21.15.16:0/146775484 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdca00d1f50 0x7fdca015daa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 >> 172.21.15.16:0/146775484 conn(0x7fdca008ccf0 msgr2=0x7fdca00d2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 shutdown_connections 2023-11-29T03:14:59.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.281+0000 7fdca62c9640 1 -- 172.21.15.16:0/146775484 wait complete. 2023-11-29T03:14:59.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-29T03:14:59.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.601+0000 7f4ca905f640 1 Processor -- start 2023-11-29T03:14:59.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.601+0000 7f4ca905f640 1 -- start start 2023-11-29T03:14:59.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca905f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4ca415d4a0 0x7f4ca40d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:59.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca905f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 0x7f4ca40d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:59.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca905f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca40ce7b0 con 0x7f4ca415d880 2023-11-29T03:14:59.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca905f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca40cea90 con 0x7f4ca415d4a0 2023-11-29T03:14:59.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca905f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40ced70 con 0x7f4ca40cf850 2023-11-29T03:14:59.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 0x7f4ca40d3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:59.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 0x7f4ca40d3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:49574/0 (socket says 172.21.15.16:49574) 2023-11-29T03:14:59.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 -- 172.21.15.16:0/125789306 learned_addr learned my addr 172.21.15.16:0/125789306 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:59.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 -- 172.21.15.16:0/125789306 >> v2:172.21.15.64:3300/0 conn(0x7f4ca415d4a0 msgr2=0x7f4ca40d1f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T03:14:59.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 --2- 172.21.15.16:0/125789306 >> v2:172.21.15.64:3300/0 conn(0x7f4ca415d4a0 0x7f4ca40d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 -- 172.21.15.16:0/125789306 >> v1:172.21.15.16:6789/0 conn(0x7f4ca415d880 legacy=0x7f4ca40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:14:59.620 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.609+0000 7f4ca359e640 1 -- 172.21.15.16:0/125789306 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca40cf050 con 0x7f4ca40cf850 2023-11-29T03:14:59.630 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.621+0000 7f4ca359e640 1 --2- 172.21.15.16:0/125789306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 0x7f4ca40d3070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009870 tx=0x7f4c8c01cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b38453aa9b39ed1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:59.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca1d9b640 1 -- 172.21.15.16:0/125789306 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0ab5f0 con 0x7f4ca40cf850 2023-11-29T03:14:59.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca1d9b640 1 -- 172.21.15.16:0/125789306 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0ab750 con 0x7f4ca40cf850 2023-11-29T03:14:59.631 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca1d9b640 1 -- 172.21.15.16:0/125789306 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0abae0 con 0x7f4ca40cf850 2023-11-29T03:14:59.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca905f640 1 -- 172.21.15.16:0/125789306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 msgr2=0x7f4ca40d3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:59.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca905f640 1 --2- 172.21.15.16:0/125789306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 0x7f4ca40d3070 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009870 tx=0x7f4c8c01cf80 comp rx=0 tx=0).stop 2023-11-29T03:14:59.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca905f640 1 -- 172.21.15.16:0/125789306 shutdown_connections 2023-11-29T03:14:59.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca905f640 1 --2- 172.21.15.16:0/125789306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca40cf850 0x7f4ca40d3070 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.625+0000 7f4ca905f640 1 --2- 172.21.15.16:0/125789306 >> v2:172.21.15.64:3300/0 conn(0x7f4ca415d4a0 0x7f4ca40d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.636 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.629+0000 7f4ca905f640 1 -- 172.21.15.16:0/125789306 >> 172.21.15.16:0/125789306 conn(0x7f4ca408cd70 msgr2=0x7f4ca409c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:14:59.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.633+0000 7f4ca905f640 1 -- 172.21.15.16:0/125789306 shutdown_connections 2023-11-29T03:14:59.639 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.633+0000 7f4ca905f640 1 -- 172.21.15.16:0/125789306 wait complete. 2023-11-29T03:14:59.656 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 Processor -- start 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 -- start start 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca40cf850 0x7f4ca40c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 0x7f4ca41523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca415d880 0x7f4ca415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca4152990 con 0x7f4ca40cf850 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca415b310 con 0x7f4ca415d4a0 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.645+0000 7f4ca905f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca415b5f0 con 0x7f4ca415d880 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 0x7f4ca41523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:59.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 0x7f4ca41523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:55836/0 (socket says 172.21.15.16:55836) 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 -- 172.21.15.16:0/2814906581 learned_addr learned my addr 172.21.15.16:0/2814906581 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca359e640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca415d880 0x7f4ca415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca2d9d640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca40cf850 0x7f4ca40c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 -- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca415d880 msgr2=0x7f4ca415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca415d880 0x7f4ca415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 -- 172.21.15.16:0/2814906581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca40cf850 msgr2=0x7f4ca40c8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca40cf850 0x7f4ca40c8010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:14:59.658 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 -- 172.21.15.16:0/2814906581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0094d0 con 0x7f4ca415d4a0 2023-11-29T03:14:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca2d9d640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca40cf850 0x7f4ca40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T03:14:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca259c640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 0x7f4ca41523f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400b3e0 tx=0x7f4c9400b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94011830 con 0x7f4ca415d4a0 2023-11-29T03:14:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c940119b0 con 0x7f4ca415d4a0 2023-11-29T03:14:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca415b8d0 con 0x7f4ca415d4a0 2023-11-29T03:14:59.659 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c94011d60 con 0x7f4ca415d4a0 2023-11-29T03:14:59.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.649+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca415c840 con 0x7f4ca415d4a0 2023-11-29T03:14:59.660 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.653+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca4152b20 con 0x7f4ca415d4a0 2023-11-29T03:14:59.661 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.653+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4c9401a400 con 0x7f4ca415d4a0 2023-11-29T03:14:59.664 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.657+0000 7f4c9b7fe640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4c88066920 0x7f4c88068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:14:59.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.657+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4c94084660 con 0x7f4ca415d4a0 2023-11-29T03:14:59.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.661+0000 7f4ca2d9d640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4c88066920 0x7f4c88068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:14:59.675 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.669+0000 7f4ca2d9d640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4c88066920 0x7f4c88068de0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c007eb0 tx=0x7f4c9c0073c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:14:59.676 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:14:59.669+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4c94051800 con 0x7f4ca415d4a0 2023-11-29T03:15:00.590 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.581+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4ca4067530 con 0x7f4ca415d4a0 2023-11-29T03:15:00.599 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.593+0000 7f4c9b7fe640 1 -- 172.21.15.16:0/2814906581 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4c94054e20 con 0x7f4ca415d4a0 2023-11-29T03:15:00.604 INFO:teuthology.orchestra.run.smithi016.stderr:listed 0 entries 2023-11-29T03:15:00.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4c88066920 msgr2=0x7f4c88068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:00.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4c88066920 0x7f4c88068de0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c007eb0 tx=0x7f4c9c0073c0 comp rx=0 tx=0).stop 2023-11-29T03:15:00.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 msgr2=0x7f4ca41523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:00.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 0x7f4ca41523f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400b3e0 tx=0x7f4c9400b8a0 comp rx=0 tx=0).stop 2023-11-29T03:15:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 shutdown_connections 2023-11-29T03:15:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4ca415d880 0x7f4ca415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4c88066920 0x7f4c88068de0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4ca415d4a0 0x7f4ca41523f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 --2- 172.21.15.16:0/2814906581 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4ca40cf850 0x7f4ca40c8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:00.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.601+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 >> 172.21.15.16:0/2814906581 conn(0x7f4ca408cd70 msgr2=0x7f4ca4157070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:00.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.605+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 shutdown_connections 2023-11-29T03:15:00.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:00.605+0000 7f4ca905f640 1 -- 172.21.15.16:0/2814906581 wait complete. 2023-11-29T03:15:00.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-29T03:15:00.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:00.679 DEBUG:teuthology.orchestra.run.smithi016:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-29T03:15:00.801 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi016.front.sepia.ceph.com 2023-11-29T03:15:00.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:00.801 DEBUG:teuthology.orchestra.run.smithi016:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-29T03:15:00.863 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-29T03:15:00.863 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:00.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354692k,nr_inodes=4088673,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T03:15:00.885 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-29T03:15:00.885 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:00.905 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=855 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T03:15:00.905 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-29T03:15:00.905 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:00.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354692k,nr_inodes=4088673,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T03:15:00.942 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T03:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.589+0000 7ff969cc8640 1 Processor -- start 2023-11-29T03:15:01.598 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.589+0000 7ff969cc8640 1 -- start start 2023-11-29T03:15:01.601 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff969cc8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff9640d3210 0x7ff9640d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff969cc8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640b3700 0x7ff9640b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff969cc8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9640d3ba0 con 0x7ff96415d480 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff969cc8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9640b3250 con 0x7ff9640d3210 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff969cc8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640ce8f0 con 0x7ff9640b3700 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff95bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff9640d3210 0x7ff9640d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff95bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff9640d3210 0x7ff9640d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:55840/0 (socket says 172.21.15.16:55840) 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff95bfff640 1 -- 172.21.15.16:0/3251322327 learned_addr learned my addr 172.21.15.16:0/3251322327 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff968cc6640 1 --1- 172.21.15.16:0/3251322327 >> v1:172.21.15.16:6789/0 conn(0x7ff96415d480 0x7ff9640cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35250/0 (socket says 172.21.15.16:35250) 2023-11-29T03:15:01.602 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff9694c7640 1 --2- 172.21.15.16:0/3251322327 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640b3700 0x7ff9640b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff9694c7640 1 -- 172.21.15.16:0/3251322327 >> v2:172.21.15.64:3300/0 conn(0x7ff9640d3210 msgr2=0x7ff9640d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff9694c7640 1 --2- 172.21.15.16:0/3251322327 >> v2:172.21.15.64:3300/0 conn(0x7ff9640d3210 0x7ff9640d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff95b7fe640 1 -- 172.21.15.16:0/3251322327 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261365061 0 0) 0x7ff954001120 con 0x7ff96415d480 2023-11-29T03:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff9694c7640 1 -- 172.21.15.16:0/3251322327 >> v1:172.21.15.16:6789/0 conn(0x7ff96415d480 legacy=0x7ff9640cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:01.603 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.593+0000 7ff9694c7640 1 -- 172.21.15.16:0/3251322327 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9640cebd0 con 0x7ff9640b3700 2023-11-29T03:15:01.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.597+0000 7ff9694c7640 1 --2- 172.21.15.16:0/3251322327 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640b3700 0x7ff9640b3b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009d90 tx=0x7ff95c01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8850fef6d9e42e1f server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:01.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.597+0000 7ff95b7fe640 1 -- 172.21.15.16:0/3251322327 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0a59a0 con 0x7ff9640b3700 2023-11-29T03:15:01.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.597+0000 7ff95b7fe640 1 -- 172.21.15.16:0/3251322327 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0a5b00 con 0x7ff9640b3700 2023-11-29T03:15:01.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.597+0000 7ff95b7fe640 1 -- 172.21.15.16:0/3251322327 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0a5e90 con 0x7ff9640b3700 2023-11-29T03:15:01.608 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 -- 172.21.15.16:0/3251322327 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640b3700 msgr2=0x7ff9640b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:01.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 --2- 172.21.15.16:0/3251322327 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640b3700 0x7ff9640b3b50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff95c009d90 tx=0x7ff95c01c8c0 comp rx=0 tx=0).stop 2023-11-29T03:15:01.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 -- 172.21.15.16:0/3251322327 shutdown_connections 2023-11-29T03:15:01.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 --2- 172.21.15.16:0/3251322327 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640b3700 0x7ff9640b3b50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:01.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 --2- 172.21.15.16:0/3251322327 >> v2:172.21.15.64:3300/0 conn(0x7ff9640d3210 0x7ff9640d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:01.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 -- 172.21.15.16:0/3251322327 >> 172.21.15.16:0/3251322327 conn(0x7ff96408cc90 msgr2=0x7ff96409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:01.609 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 -- 172.21.15.16:0/3251322327 shutdown_connections 2023-11-29T03:15:01.610 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.601+0000 7ff969cc8640 1 -- 172.21.15.16:0/3251322327 wait complete. 2023-11-29T03:15:01.611 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 Processor -- start 2023-11-29T03:15:01.612 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 -- start start 2023-11-29T03:15:01.613 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9640b3700 0x7ff9641532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640d3210 0x7ff9641576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 0x7ff96415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9640b8d60 con 0x7ff96415d480 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff964153800 con 0x7ff9640b3700 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff969cc8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff964157c30 con 0x7ff9640d3210 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff9694c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 0x7ff96415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff9694c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 0x7ff96415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:55992/0 (socket says 172.21.15.16:55992) 2023-11-29T03:15:01.614 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.605+0000 7ff9694c7640 1 -- 172.21.15.16:0/2402304808 learned_addr learned my addr 172.21.15.16:0/2402304808 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:01.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9694c7640 1 -- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640d3210 msgr2=0x7ff9641576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:01.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9694c7640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640d3210 0x7ff9641576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:01.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9694c7640 1 -- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9640b3700 msgr2=0x7ff9641532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:01.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9694c7640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9640b3700 0x7ff9641532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:01.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9694c7640 1 -- 172.21.15.16:0/2402304808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95c009a70 con 0x7ff96415d480 2023-11-29T03:15:01.615 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9694c7640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 0x7ff96415bac0 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 crypto rx=0x7ff95c01cda0 tx=0x7ff95c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0aece0 con 0x7ff96415d480 2023-11-29T03:15:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95c0aee40 con 0x7ff96415d480 2023-11-29T03:15:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c0b7650 con 0x7ff96415d480 2023-11-29T03:15:01.616 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9640ca4f0 con 0x7ff96415d480 2023-11-29T03:15:01.617 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9640caab0 con 0x7ff96415d480 2023-11-29T03:15:01.618 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.609+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96404e890 con 0x7ff96415d480 2023-11-29T03:15:01.654 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.645+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff95c0b4050 con 0x7ff96415d480 2023-11-29T03:15:01.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.649+0000 7ff9597fa640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff9500668d0 0x7ff950068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:01.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.649+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff95c11fe00 con 0x7ff96415d480 2023-11-29T03:15:01.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.649+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff95c120370 con 0x7ff96415d480 2023-11-29T03:15:01.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.649+0000 7ff968cc6640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff9500668d0 0x7ff950068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:01.657 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:01.649+0000 7ff968cc6640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff9500668d0 0x7ff950068d90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff954000c10 tx=0x7ff9540079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:02.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.549+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9640d0500 con 0x7ff96415d480 2023-11-29T03:15:02.567 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:02.568 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:40:27.311390+0000","modified":"2023-11-28T17:40:30.336858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6836/2775576031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2775576031},{"type":"v1","addr":"172.21.15.64:6836","nonce":2775576031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T03:15:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.553+0000 7ff9597fa640 1 -- 172.21.15.16:0/2402304808 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7ff95c0b2090 con 0x7ff96415d480 2023-11-29T03:15:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2023-11-29T03:15:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff9500668d0 msgr2=0x7ff950068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff9500668d0 0x7ff950068d90 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff954000c10 tx=0x7ff9540079d0 comp rx=0 tx=0).stop 2023-11-29T03:15:02.568 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 msgr2=0x7ff96415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 0x7ff96415bac0 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 crypto rx=0x7ff95c01cda0 tx=0x7ff95c019660 comp rx=0 tx=0).stop 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 shutdown_connections 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff96415d480 0x7ff96415bac0 unknown :-1 s=CLOSED pgs=3276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff9640d3210 0x7ff9641576f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff9500668d0 0x7ff950068d90 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 --2- 172.21.15.16:0/2402304808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff9640b3700 0x7ff9641532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:02.569 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.557+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 >> 172.21.15.16:0/2402304808 conn(0x7ff96408cc90 msgr2=0x7ff9640b1de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.561+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 shutdown_connections 2023-11-29T03:15:02.570 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:02.561+0000 7ff969cc8640 1 -- 172.21.15.16:0/2402304808 wait complete. 2023-11-29T03:15:02.609 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T03:15:03.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.189+0000 7ff57ca5e640 1 Processor -- start 2023-11-29T03:15:03.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.189+0000 7ff57ca5e640 1 -- start start 2023-11-29T03:15:03.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff57ca5e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff5780d3660 0x7ff5780b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:03.208 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff57ca5e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5780b3250 con 0x7ff57815d480 2023-11-29T03:15:03.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff576d9d640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ff57815d480 0x7ff5780cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35252/0 (socket says 172.21.15.16:35252) 2023-11-29T03:15:03.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff576d9d640 1 -- 172.21.15.16:0/2863220101 learned_addr learned my addr 172.21.15.16:0/2863220101 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:03.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5780ce8f0 con 0x7ff5780d3210 2023-11-29T03:15:03.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5780cebd0 con 0x7ff5780d3660 2023-11-29T03:15:03.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.201+0000 7ff57759e640 1 --2- 172.21.15.16:0/2863220101 >> v2:172.21.15.16:3300/0 conn(0x7ff5780d3660 0x7ff5780b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:03.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.205+0000 7ff57759e640 1 -- 172.21.15.16:0/2863220101 >> v1:172.21.15.64:6789/0 conn(0x7ff5780d3210 legacy=0x7ff5780b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:03.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.205+0000 7ff57759e640 1 -- 172.21.15.16:0/2863220101 >> v1:172.21.15.16:6789/0 conn(0x7ff57815d480 legacy=0x7ff5780cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:03.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.205+0000 7ff57759e640 1 -- 172.21.15.16:0/2863220101 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5780ceeb0 con 0x7ff5780d3660 2023-11-29T03:15:03.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.213+0000 7ff57759e640 1 --2- 172.21.15.16:0/2863220101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 0x7ff5780b3e10 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7ff570009d90 tx=0x7ff57001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f858b4412de57050 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:03.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.213+0000 7ff575d9b640 1 -- 172.21.15.16:0/2863220101 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700a5960 con 0x7ff5780d3660 2023-11-29T03:15:03.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.213+0000 7ff575d9b640 1 -- 172.21.15.16:0/2863220101 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5700a5ac0 con 0x7ff5780d3660 2023-11-29T03:15:03.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.213+0000 7ff575d9b640 1 -- 172.21.15.16:0/2863220101 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700a5e50 con 0x7ff5780d3660 2023-11-29T03:15:03.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 msgr2=0x7ff5780b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:03.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/2863220101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 0x7ff5780b3e10 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7ff570009d90 tx=0x7ff57001c880 comp rx=0 tx=0).stop 2023-11-29T03:15:03.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 shutdown_connections 2023-11-29T03:15:03.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/2863220101 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 0x7ff5780b3e10 unknown :-1 s=CLOSED pgs=3278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:03.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 >> 172.21.15.16:0/2863220101 conn(0x7ff57808cc90 msgr2=0x7ff57809c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:03.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 shutdown_connections 2023-11-29T03:15:03.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.217+0000 7ff57ca5e640 1 -- 172.21.15.16:0/2863220101 wait complete. 2023-11-29T03:15:03.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.225+0000 7ff57ca5e640 1 Processor -- start 2023-11-29T03:15:03.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.229+0000 7ff57ca5e640 1 -- start start 2023-11-29T03:15:03.240 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57ca5e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5780d3210 0x7ff57815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57ca5e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 0x7ff578160670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57ca5e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 0x7ff5780b0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57ca5e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57815cd40 con 0x7ff5780d3660 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57ca5e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57815bca0 con 0x7ff57815d480 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57ca5e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff57815bf80 con 0x7ff5780d3210 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 0x7ff5780b0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 0x7ff5780b0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:55868/0 (socket says 172.21.15.16:55868) 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 -- 172.21.15.16:0/3400307306 learned_addr learned my addr 172.21.15.16:0/3400307306 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:03.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 -- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5780d3210 msgr2=0x7ff57815b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T03:15:03.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5780d3210 0x7ff57815b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:03.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 -- 172.21.15.16:0/3400307306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 msgr2=0x7ff578160670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T03:15:03.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 0x7ff578160670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:03.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.233+0000 7ff57759e640 1 -- 172.21.15.16:0/3400307306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570009a70 con 0x7ff57815d480 2023-11-29T03:15:03.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.241+0000 7ff57759e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 0x7ff5780b0170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff570019490 tx=0x7ff5780b4b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:03.248 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.241+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700ade00 con 0x7ff57815d480 2023-11-29T03:15:03.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.241+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5700b9450 con 0x7ff57815d480 2023-11-29T03:15:03.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.241+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57815c260 con 0x7ff57815d480 2023-11-29T03:15:03.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.241+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57815c820 con 0x7ff57815d480 2023-11-29T03:15:03.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.241+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5700b9800 con 0x7ff57815d480 2023-11-29T03:15:03.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.245+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff57815ca10 con 0x7ff57815d480 2023-11-29T03:15:03.256 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.249+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff5700b9960 con 0x7ff57815d480 2023-11-29T03:15:03.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.249+0000 7ff55f7fe640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff564066920 0x7ff564068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.253+0000 7ff576d9d640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff564066920 0x7ff564068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.253+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff57011fc40 con 0x7ff57815d480 2023-11-29T03:15:03.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.253+0000 7ff576d9d640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff564066920 0x7ff564068de0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff568000f70 tx=0x7ff568007a10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:03.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:03.257+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5700ece70 con 0x7ff57815d480 2023-11-29T03:15:04.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.061+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff57804e890 con 0x7ff57815d480 2023-11-29T03:15:04.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.065+0000 7ff55f7fe640 1 -- 172.21.15.16:0/3400307306 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16711 (secure 0 0 0) 0x7ff5700f0490 con 0x7ff57815d480 2023-11-29T03:15:04.076 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:04.076 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:41:17.472386+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T03:15:04.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.069+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff564066920 msgr2=0x7ff564068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:04.078 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.069+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff564066920 0x7ff564068de0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7ff568000f70 tx=0x7ff568007a10 comp rx=0 tx=0).stop 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 msgr2=0x7ff5780b0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 0x7ff5780b0170 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff570019490 tx=0x7ff5780b4b60 comp rx=0 tx=0).stop 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 shutdown_connections 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff564066920 0x7ff564068de0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff57815d480 0x7ff5780b0170 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff5780d3660 0x7ff578160670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 --2- 172.21.15.16:0/3400307306 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff5780d3210 0x7ff57815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.073+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 >> 172.21.15.16:0/3400307306 conn(0x7ff57808cc90 msgr2=0x7ff5781590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:04.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.077+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 shutdown_connections 2023-11-29T03:15:04.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.077+0000 7ff57ca5e640 1 -- 172.21.15.16:0/3400307306 wait complete. 2023-11-29T03:15:04.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T17:39:22.827431+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T17:40:25.116530+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T17:40:26.310896+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-29T03:15:04.124 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-29T03:15:04.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.389+0000 7f21bd5fd640 1 Processor -- start 2023-11-29T03:15:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.389+0000 7f21bd5fd640 1 -- start start 2023-11-29T03:15:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21bd5fd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 0x7f21b81651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21bd5fd640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b80b1ec0 con 0x7f21b80cb7f0 2023-11-29T03:15:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21bd5fd640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8165a60 con 0x7f21b8162860 2023-11-29T03:15:04.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21bd5fd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8165d40 con 0x7f21b80cb410 2023-11-29T03:15:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 0x7f21b81651d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21b7fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 0x7f21b81651d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:49622/0 (socket says 172.21.15.16:49622) 2023-11-29T03:15:04.402 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.393+0000 7f21b7fff640 1 -- 172.21.15.16:0/2848472367 learned_addr learned my addr 172.21.15.16:0/2848472367 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:04.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.397+0000 7f21b7fff640 1 -- 172.21.15.16:0/2848472367 >> v1:172.21.15.64:6789/0 conn(0x7f21b8162860 legacy=0x7f21b8144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:04.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.397+0000 7f21b77fe640 1 -- 172.21.15.16:0/2848472367 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289733761 0 0) 0x7f21b8165a60 con 0x7f21b8162860 2023-11-29T03:15:04.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.397+0000 7f21b7fff640 1 -- 172.21.15.16:0/2848472367 >> v1:172.21.15.16:6789/0 conn(0x7f21b80cb7f0 legacy=0x7f21b80b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:04.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.397+0000 7f21b7fff640 1 -- 172.21.15.16:0/2848472367 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8166020 con 0x7f21b80cb410 2023-11-29T03:15:04.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.409+0000 7f21b7fff640 1 --2- 172.21.15.16:0/2848472367 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 0x7f21b81651d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21a80098a0 tx=0x7f21a801c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0d687862579470 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:04.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.409+0000 7f21b77fe640 1 -- 172.21.15.16:0/2848472367 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80ab680 con 0x7f21b80cb410 2023-11-29T03:15:04.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.409+0000 7f21b77fe640 1 -- 172.21.15.16:0/2848472367 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a80ab7e0 con 0x7f21b80cb410 2023-11-29T03:15:04.417 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.409+0000 7f21b77fe640 1 -- 172.21.15.16:0/2848472367 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80abb70 con 0x7f21b80cb410 2023-11-29T03:15:04.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.409+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2848472367 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 msgr2=0x7f21b81651d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:04.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.409+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2848472367 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 0x7f21b81651d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f21a80098a0 tx=0x7f21a801c460 comp rx=0 tx=0).stop 2023-11-29T03:15:04.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.413+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2848472367 shutdown_connections 2023-11-29T03:15:04.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.413+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2848472367 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb410 0x7f21b81651d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.413+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2848472367 >> 172.21.15.16:0/2848472367 conn(0x7f21b806aba0 msgr2=0x7f21b80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:04.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.413+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2848472367 shutdown_connections 2023-11-29T03:15:04.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.413+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2848472367 wait complete. 2023-11-29T03:15:04.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.417+0000 7f21bd5fd640 1 Processor -- start 2023-11-29T03:15:04.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.421+0000 7f21bd5fd640 1 -- start start 2023-11-29T03:15:04.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bd5fd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b80cb410 0x7f21b815ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:04.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bd5fd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb7f0 0x7f21b80cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:04.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bd5fd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 0x7f21b81405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:04.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bd5fd640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81619c0 con 0x7f21b8162860 2023-11-29T03:15:04.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bd5fd640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81555c0 con 0x7f21b80cb410 2023-11-29T03:15:04.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bd5fd640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b8155860 con 0x7f21b80cb7f0 2023-11-29T03:15:04.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 0x7f21b81405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:04.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21af7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb7f0 0x7f21b80cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:04.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 0x7f21b81405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56002/0 (socket says 172.21.15.16:56002) 2023-11-29T03:15:04.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 -- 172.21.15.16:0/2880734804 learned_addr learned my addr 172.21.15.16:0/2880734804 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:04.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21b7fff640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b80cb410 0x7f21b815ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:04.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 -- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb7f0 msgr2=0x7f21b80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:04.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb7f0 0x7f21b80cdd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 -- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b80cb410 msgr2=0x7f21b815ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:04.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b80cb410 0x7f21b815ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:04.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.425+0000 7f21bcdfc640 1 -- 172.21.15.16:0/2880734804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a80094d0 con 0x7f21b8162860 2023-11-29T03:15:04.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.429+0000 7f21bcdfc640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 0x7f21b81405b0 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 crypto rx=0x7f21b0001570 tx=0x7f21b000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:04.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.429+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0003db0 con 0x7f21b8162860 2023-11-29T03:15:04.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.429+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b0005070 con 0x7f21b8162860 2023-11-29T03:15:04.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.429+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0005420 con 0x7f21b8162860 2023-11-29T03:15:04.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.429+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b8155b40 con 0x7f21b8162860 2023-11-29T03:15:04.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.429+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b815f360 con 0x7f21b8162860 2023-11-29T03:15:04.441 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.433+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219c005260 con 0x7f21b8162860 2023-11-29T03:15:04.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.449+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f21b0005580 con 0x7f21b8162860 2023-11-29T03:15:04.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.449+0000 7f21b57fa640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21980668d0 0x7f2198068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:04.458 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.449+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f21b0083fe0 con 0x7f21b8162860 2023-11-29T03:15:04.459 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.453+0000 7f21b7fff640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21980668d0 0x7f2198068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:04.461 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.453+0000 7f21b7fff640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21980668d0 0x7f2198068d90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f21a80af000 tx=0x7f21a80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:04.479 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:04.473+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21b00513c0 con 0x7f21b8162860 2023-11-29T03:15:05.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.357+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f219c005a90 con 0x7f21b8162860 2023-11-29T03:15:05.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.365+0000 7f21b57fa640 1 -- 172.21.15.16:0/2880734804 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21b0017020 con 0x7f21b8162860 2023-11-29T03:15:05.376 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 1 2023-11-29T03:15:05.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.369+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21980668d0 msgr2=0x7f2198068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:05.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.369+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21980668d0 0x7f2198068d90 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f21a80af000 tx=0x7f21a80a7000 comp rx=0 tx=0).stop 2023-11-29T03:15:05.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.369+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 msgr2=0x7f21b81405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:05.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.369+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 0x7f21b81405b0 secure :-1 s=READY pgs=3279 cs=0 l=1 rev1=1 crypto rx=0x7f21b0001570 tx=0x7f21b000cd20 comp rx=0 tx=0).stop 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 shutdown_connections 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f21b8162860 0x7f21b81405b0 unknown :-1 s=CLOSED pgs=3279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f21b80cb7f0 0x7f21b80cdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f21980668d0 0x7f2198068d90 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 --2- 172.21.15.16:0/2880734804 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f21b80cb410 0x7f21b815ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 >> 172.21.15.16:0/2880734804 conn(0x7f21b806aba0 msgr2=0x7f21b8071330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:05.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 shutdown_connections 2023-11-29T03:15:05.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.373+0000 7f21bd5fd640 1 -- 172.21.15.16:0/2880734804 wait complete. 2023-11-29T03:15:05.459 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-29T03:15:05.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.765+0000 7f9272ff5640 1 Processor -- start 2023-11-29T03:15:05.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9272ff5640 1 -- start start 2023-11-29T03:15:05.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9272ff5640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f926c0ae8a0 0x7f926c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:05.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9272ff5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f926c070be0 0x7f926c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:05.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9272ff5640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926c0cee10 con 0x7f926c0cfac0 2023-11-29T03:15:05.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9272ff5640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c15ce10 con 0x7f926c0ae8a0 2023-11-29T03:15:05.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9272ff5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f926c0cebd0 con 0x7f926c070be0 2023-11-29T03:15:05.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f9270d91640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f926c0ae8a0 0x7f926c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:05.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f926bfff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f926c0cfac0 0x7f926c0ce4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:35280/0 (socket says 172.21.15.16:35280) 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.769+0000 7f926bfff640 1 -- 172.21.15.16:0/2223906804 learned_addr learned my addr 172.21.15.16:0/2223906804 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.773+0000 7f9271592640 1 --2- 172.21.15.16:0/2223906804 >> v2:172.21.15.64:3300/0 conn(0x7f926c070be0 0x7f926c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.773+0000 7f9270d91640 1 -- 172.21.15.16:0/2223906804 >> v2:172.21.15.64:3300/0 conn(0x7f926c070be0 msgr2=0x7f926c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.773+0000 7f9270d91640 1 --2- 172.21.15.16:0/2223906804 >> v2:172.21.15.64:3300/0 conn(0x7f926c070be0 0x7f926c070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.773+0000 7f926b7fe640 1 -- 172.21.15.16:0/2223906804 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647951942 0 0) 0x7f926c0cee10 con 0x7f926c0cfac0 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.773+0000 7f9270d91640 1 -- 172.21.15.16:0/2223906804 >> v1:172.21.15.16:6789/0 conn(0x7f926c0cfac0 legacy=0x7f926c0ce4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:05.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.773+0000 7f9270d91640 1 -- 172.21.15.16:0/2223906804 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c0b2ae0 con 0x7f926c0ae8a0 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9270d91640 1 --2- 172.21.15.16:0/2223906804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c15c8d0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7f926c074460 tx=0x7f925c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c3d8a02476d326 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f926b7fe640 1 -- 172.21.15.16:0/2223906804 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c004230 con 0x7f926c0ae8a0 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f926b7fe640 1 -- 172.21.15.16:0/2223906804 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925c0a7050 con 0x7f926c0ae8a0 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f926b7fe640 1 -- 172.21.15.16:0/2223906804 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925c003620 con 0x7f926c0ae8a0 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 -- 172.21.15.16:0/2223906804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 msgr2=0x7f926c15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 --2- 172.21.15.16:0/2223906804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c15c8d0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7f926c074460 tx=0x7f925c01c460 comp rx=0 tx=0).stop 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 -- 172.21.15.16:0/2223906804 shutdown_connections 2023-11-29T03:15:05.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 --2- 172.21.15.16:0/2223906804 >> v2:172.21.15.64:3300/0 conn(0x7f926c070be0 0x7f926c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 --2- 172.21.15.16:0/2223906804 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c15c8d0 unknown :-1 s=CLOSED pgs=3281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 -- 172.21.15.16:0/2223906804 >> 172.21.15.16:0/2223906804 conn(0x7f926c0cefa0 msgr2=0x7f926c0cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:05.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.785+0000 7f9272ff5640 1 -- 172.21.15.16:0/2223906804 shutdown_connections 2023-11-29T03:15:05.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.789+0000 7f9272ff5640 1 -- 172.21.15.16:0/2223906804 wait complete. 2023-11-29T03:15:05.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.797+0000 7f9272ff5640 1 Processor -- start 2023-11-29T03:15:05.807 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.797+0000 7f9272ff5640 1 -- start start 2023-11-29T03:15:05.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f9272ff5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f926c070be0 0x7f926c144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f9272ff5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c14e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f9272ff5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f926c0cfac0 0x7f926c13f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f9272ff5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c14f450 con 0x7f926c0ae8a0 2023-11-29T03:15:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f9272ff5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926c13e240 con 0x7f926c0cfac0 2023-11-29T03:15:05.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f9272ff5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926c13e520 con 0x7f926c070be0 2023-11-29T03:15:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c14e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c14e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:56016/0 (socket says 172.21.15.16:56016) 2023-11-29T03:15:05.813 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 -- 172.21.15.16:0/3986777772 learned_addr learned my addr 172.21.15.16:0/3986777772 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:05.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 -- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f926c070be0 msgr2=0x7f926c144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:05.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f926c070be0 0x7f926c144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 -- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f926c0cfac0 msgr2=0x7f926c13f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:05.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f926c0cfac0 0x7f926c13f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:05.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 -- 172.21.15.16:0/3986777772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c009420 con 0x7f926c0ae8a0 2023-11-29T03:15:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.805+0000 7f926bfff640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c14e580 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f926000c450 tx=0x7f926000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.809+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600074e0 con 0x7f926c0ae8a0 2023-11-29T03:15:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.809+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260007640 con 0x7f926c0ae8a0 2023-11-29T03:15:05.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.809+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92600049f0 con 0x7f926c0ae8a0 2023-11-29T03:15:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.809+0000 7f9272ff5640 1 -- 172.21.15.16:0/3986777772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f926c146c00 con 0x7f926c0ae8a0 2023-11-29T03:15:05.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.809+0000 7f9272ff5640 1 -- 172.21.15.16:0/3986777772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f926c145040 con 0x7f926c0ae8a0 2023-11-29T03:15:05.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.813+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9244005260 con 0x7f926c0ae8a0 2023-11-29T03:15:05.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.817+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9260004b50 con 0x7f926c0ae8a0 2023-11-29T03:15:05.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.821+0000 7f92697fa640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:05.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.821+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f92600836b0 con 0x7f926c0ae8a0 2023-11-29T03:15:05.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.821+0000 7f9270d91640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:05.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.829+0000 7f9270d91640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f925c0ad000 tx=0x7f925c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:05.853 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:05.845+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9260054300 con 0x7f926c0ae8a0 2023-11-29T03:15:06.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.673+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9244005a90 con 0x7f926c0ae8a0 2023-11-29T03:15:06.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.677+0000 7f92697fa640 1 -- 172.21.15.16:0/3986777772 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9260018020 con 0x7f926c0ae8a0 2023-11-29T03:15:06.685 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 32 2023-11-29T03:15:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 msgr2=0x7f9258068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:06.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f925c0ad000 tx=0x7f925c004740 comp rx=0 tx=0).stop 2023-11-29T03:15:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 msgr2=0x7f926c14e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:06.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c14e580 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f926000c450 tx=0x7f926000c910 comp rx=0 tx=0).stop 2023-11-29T03:15:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 shutdown_connections 2023-11-29T03:15:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f92580668d0 0x7f9258068d90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:06.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f926c0cfac0 0x7f926c13f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f926c0ae8a0 0x7f926c14e580 unknown :-1 s=CLOSED pgs=3282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 --2- 172.21.15.16:0/3986777772 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f926c070be0 0x7f926c144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 >> 172.21.15.16:0/3986777772 conn(0x7f926c0cefa0 msgr2=0x7f926c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:06.694 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 shutdown_connections 2023-11-29T03:15:06.695 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.685+0000 7f92537fe640 1 -- 172.21.15.16:0/3986777772 wait complete. 2023-11-29T03:15:06.747 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-29T03:15:06.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.981+0000 7f1836be6640 1 Processor -- start 2023-11-29T03:15:06.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.981+0000 7f1836be6640 1 -- start start 2023-11-29T03:15:06.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1836be6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f183006b8f0 0x7f183015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:06.995 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1836be6640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f183006bcd0 0x7f183006df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1836be6640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300b2860 con 0x7f18300b3370 2023-11-29T03:15:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1836be6640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18300b3070 con 0x7f183006bcd0 2023-11-29T03:15:06.996 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1836be6640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183015aec0 con 0x7f183006b8f0 2023-11-29T03:15:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1834982640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f183006b8f0 0x7f183015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1835183640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f18300b3370 0x7f183006a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:39770/0 (socket says 172.21.15.16:39770) 2023-11-29T03:15:06.997 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1835183640 1 -- 172.21.15.16:0/1370235433 learned_addr learned my addr 172.21.15.16:0/1370235433 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1834982640 1 -- 172.21.15.16:0/1370235433 >> v2:172.21.15.16:3300/0 conn(0x7f183006bcd0 msgr2=0x7f183006df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1834982640 1 --2- 172.21.15.16:0/1370235433 >> v2:172.21.15.16:3300/0 conn(0x7f183006bcd0 0x7f183006df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1834982640 1 -- 172.21.15.16:0/1370235433 >> v1:172.21.15.16:6789/0 conn(0x7f18300b3370 legacy=0x7f183006a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:06.998 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:06.989+0000 7f1834982640 1 -- 172.21.15.16:0/1370235433 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300b2ab0 con 0x7f183006b8f0 2023-11-29T03:15:07.019 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.013+0000 7f1834982640 1 --2- 172.21.15.16:0/1370235433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006b8f0 0x7f183015a980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1830070470 tx=0x7f182401e910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e466c8899e5810aa server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.013+0000 7f182f7fe640 1 -- 172.21.15.16:0/1370235433 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240a7a00 con 0x7f183006b8f0 2023-11-29T03:15:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.013+0000 7f182f7fe640 1 -- 172.21.15.16:0/1370235433 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18240a7b60 con 0x7f183006b8f0 2023-11-29T03:15:07.021 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.013+0000 7f182f7fe640 1 -- 172.21.15.16:0/1370235433 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18240af440 con 0x7f183006b8f0 2023-11-29T03:15:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 -- 172.21.15.16:0/1370235433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006b8f0 msgr2=0x7f183015a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 --2- 172.21.15.16:0/1370235433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006b8f0 0x7f183015a980 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1830070470 tx=0x7f182401e910 comp rx=0 tx=0).stop 2023-11-29T03:15:07.025 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 -- 172.21.15.16:0/1370235433 shutdown_connections 2023-11-29T03:15:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 --2- 172.21.15.16:0/1370235433 >> v2:172.21.15.16:3300/0 conn(0x7f183006bcd0 0x7f183006df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 --2- 172.21.15.16:0/1370235433 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006b8f0 0x7f183015a980 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 -- 172.21.15.16:0/1370235433 >> 172.21.15.16:0/1370235433 conn(0x7f18300cf850 msgr2=0x7f18300cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 -- 172.21.15.16:0/1370235433 shutdown_connections 2023-11-29T03:15:07.026 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.017+0000 7f1836be6640 1 -- 172.21.15.16:0/1370235433 wait complete. 2023-11-29T03:15:07.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.025+0000 7f1836be6640 1 Processor -- start 2023-11-29T03:15:07.032 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.025+0000 7f1836be6640 1 -- start start 2023-11-29T03:15:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f1836be6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f183006b8f0 0x7f18301531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f1836be6640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 0x7f183014e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f1836be6640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18300b3370 0x7f1830157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f1836be6640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183014eb40 con 0x7f18300b3370 2023-11-29T03:15:07.038 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f1836be6640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830158e10 con 0x7f183006bcd0 2023-11-29T03:15:07.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f1836be6640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830157f70 con 0x7f183006b8f0 2023-11-29T03:15:07.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f182ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 0x7f183014e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:07.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f182ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 0x7f183014e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44760/0 (socket says 172.21.15.16:44760) 2023-11-29T03:15:07.039 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.029+0000 7f182ffff640 1 -- 172.21.15.16:0/1172050652 learned_addr learned my addr 172.21.15.16:0/1172050652 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:07.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182ffff640 1 -- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f183006b8f0 msgr2=0x7f18301531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:07.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182ffff640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f183006b8f0 0x7f18301531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182ffff640 1 -- 172.21.15.16:0/1172050652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18300b3370 msgr2=0x7f1830157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:07.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182ffff640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18300b3370 0x7f1830157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.040 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182ffff640 1 -- 172.21.15.16:0/1172050652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182400a5c0 con 0x7f183006bcd0 2023-11-29T03:15:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182ffff640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 0x7f183014e600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f181c00b550 tx=0x7f181c00ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:07.041 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c010870 con 0x7f183006bcd0 2023-11-29T03:15:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c0109f0 con 0x7f183006bcd0 2023-11-29T03:15:07.043 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c010da0 con 0x7f183006bcd0 2023-11-29T03:15:07.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830158200 con 0x7f183006bcd0 2023-11-29T03:15:07.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.033+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18301587c0 con 0x7f183006bcd0 2023-11-29T03:15:07.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.037+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830067220 con 0x7f183006bcd0 2023-11-29T03:15:07.046 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.041+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f181c023480 con 0x7f183006bcd0 2023-11-29T03:15:07.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.041+0000 7f182d7fa640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f18140668d0 0x7f1814068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:07.049 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.041+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f181c0848c0 con 0x7f183006bcd0 2023-11-29T03:15:07.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.041+0000 7f1834982640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f18140668d0 0x7f1814068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:07.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.045+0000 7f1834982640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f18140668d0 0x7f1814068d90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f18240b1000 tx=0x7f1824004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:07.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.045+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f181c051af0 con 0x7f183006bcd0 2023-11-29T03:15:07.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.901+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1830067530 con 0x7f183006bcd0 2023-11-29T03:15:07.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.901+0000 7f182d7fa640 1 -- 172.21.15.16:0/1172050652 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f181c014020 con 0x7f183006bcd0 2023-11-29T03:15:07.914 INFO:teuthology.orchestra.run.smithi016.stdout:pg_num: 64 2023-11-29T03:15:07.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f18140668d0 msgr2=0x7f1814068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:07.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f18140668d0 0x7f1814068d90 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f18240b1000 tx=0x7f1824004740 comp rx=0 tx=0).stop 2023-11-29T03:15:07.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 msgr2=0x7f183014e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:07.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 0x7f183014e600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f181c00b550 tx=0x7f181c00ba10 comp rx=0 tx=0).stop 2023-11-29T03:15:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 shutdown_connections 2023-11-29T03:15:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f18300b3370 0x7f1830157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f18140668d0 0x7f1814068d90 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f183006bcd0 0x7f183014e600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 --2- 172.21.15.16:0/1172050652 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f183006b8f0 0x7f18301531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:07.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.913+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 >> 172.21.15.16:0/1172050652 conn(0x7f18300cf850 msgr2=0x7f18301567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:07.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.917+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 shutdown_connections 2023-11-29T03:15:07.925 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:07.917+0000 7f1836be6640 1 -- 172.21.15.16:0/1172050652 wait complete. 2023-11-29T03:15:07.964 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T03:15:08.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.317+0000 7ff0b2b2a640 1 Processor -- start 2023-11-29T03:15:08.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.317+0000 7ff0b2b2a640 1 -- start start 2023-11-29T03:15:08.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b2b2a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7ff0ac144c80 0x7ff0ac0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:08.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b2b2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 0x7ff0ac070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:08.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b2b2a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0ac0ce4f0 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b2b2a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0ac0709b0 con 0x7ff0ac144c80 2023-11-29T03:15:08.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b2b2a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac145060 con 0x7ff0ac0cf640 2023-11-29T03:15:08.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 0x7ff0ac070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:08.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 0x7ff0ac070dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:35058/0 (socket says 172.21.15.16:35058) 2023-11-29T03:15:08.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 -- 172.21.15.16:0/2157284118 learned_addr learned my addr 172.21.15.16:0/2157284118 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:08.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b08c6640 1 --2- 172.21.15.16:0/2157284118 >> v2:172.21.15.16:3300/0 conn(0x7ff0ac144c80 0x7ff0ac0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:08.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 -- 172.21.15.16:0/2157284118 >> v2:172.21.15.16:3300/0 conn(0x7ff0ac144c80 msgr2=0x7ff0ac0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:08.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 --2- 172.21.15.16:0/2157284118 >> v2:172.21.15.16:3300/0 conn(0x7ff0ac144c80 0x7ff0ac0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 -- 172.21.15.16:0/2157284118 >> v1:172.21.15.16:6789/0 conn(0x7ff0ac0cdf00 legacy=0x7ff0ac0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:08.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.325+0000 7ff0b10c7640 1 -- 172.21.15.16:0/2157284118 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac0ce7d0 con 0x7ff0ac0cf640 2023-11-29T03:15:08.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.337+0000 7ff0b10c7640 1 --2- 172.21.15.16:0/2157284118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 0x7ff0ac070dd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0b1dd0 tx=0x7ff0a401c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56021885ef29078e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:08.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.341+0000 7ff0ab7fe640 1 -- 172.21.15.16:0/2157284118 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40090d0 con 0x7ff0ac0cf640 2023-11-29T03:15:08.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.341+0000 7ff0ab7fe640 1 -- 172.21.15.16:0/2157284118 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a4009230 con 0x7ff0ac0cf640 2023-11-29T03:15:08.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.341+0000 7ff0ab7fe640 1 -- 172.21.15.16:0/2157284118 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40a5960 con 0x7ff0ac0cf640 2023-11-29T03:15:08.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.345+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/2157284118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 msgr2=0x7ff0ac070dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:08.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.345+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/2157284118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 0x7ff0ac070dd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac0b1dd0 tx=0x7ff0a401c9b0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.345+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/2157284118 shutdown_connections 2023-11-29T03:15:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.345+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/2157284118 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cf640 0x7ff0ac070dd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.345+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/2157284118 >> v2:172.21.15.16:3300/0 conn(0x7ff0ac144c80 0x7ff0ac0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.345+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/2157284118 >> 172.21.15.16:0/2157284118 conn(0x7ff0ac06a5a0 msgr2=0x7ff0ac06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.349+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/2157284118 shutdown_connections 2023-11-29T03:15:08.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.349+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/2157284118 wait complete. 2023-11-29T03:15:08.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.357+0000 7ff0b2b2a640 1 Processor -- start 2023-11-29T03:15:08.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.365+0000 7ff0b2b2a640 1 -- start start 2023-11-29T03:15:08.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.369+0000 7ff0b2b2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 0x7ff0ac158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:08.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.369+0000 7ff0b2b2a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 0x7ff0ac0ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:08.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.369+0000 7ff0b2b2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac144c80 0x7ff0ac140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:08.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 0x7ff0ac158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:08.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 0x7ff0ac158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:35066/0 (socket says 172.21.15.16:35066) 2023-11-29T03:15:08.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0abfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 0x7ff0ac0ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:08.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0abfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 0x7ff0ac0ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44768/0 (socket says 172.21.15.16:44768) 2023-11-29T03:15:08.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b10c7640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac144c80 0x7ff0ac140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:08.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 -- 172.21.15.16:0/1676759778 learned_addr learned my addr 172.21.15.16:0/1676759778 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:08.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac0acca0 con 0x7ff0ac144c80 2023-11-29T03:15:08.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac129480 con 0x7ff0ac0cf640 2023-11-29T03:15:08.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0ac129760 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 -- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 msgr2=0x7ff0ac0ac760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 0x7ff0ac0ac760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 -- 172.21.15.16:0/1676759778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac144c80 msgr2=0x7ff0ac140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac144c80 0x7ff0ac140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a4009b30 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.373+0000 7ff0b08c6640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 0x7ff0ac158ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000d5f0 tx=0x7ff0a000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:08.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.377+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a00125f0 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.377+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0a0012750 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.377+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ac129a40 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.377+0000 7ff0b10c7640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac144c80 0x7ff0ac140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.377+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0a0012b00 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.377+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0ac13c860 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.381+0000 7ff0abfff640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 0x7ff0ac0ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:08.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.381+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0ac068860 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.385+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ff0a0012c60 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.385+0000 7ff0a97fa640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff090066900 0x7ff090068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:08.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.385+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff0a0084980 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.385+0000 7ff0abfff640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff090066900 0x7ff090068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:08.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.389+0000 7ff0abfff640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff090066900 0x7ff090068dc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac142db0 tx=0x7ff098009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:08.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.393+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0a0051b30 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.721+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0ac0cc6e0 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.737+0000 7ff0a97fa640 1 -- 172.21.15.16:0/1676759778 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7ff0a0007380 con 0x7ff0ac0cdf00 2023-11-29T03:15:08.746 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:08.746 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:40:27.311390+0000","modified":"2023-11-28T17:40:30.336858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6836/2775576031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2775576031},{"type":"v1","addr":"172.21.15.64:6836","nonce":2775576031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T03:15:08.746 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2023-11-29T03:15:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.741+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff090066900 msgr2=0x7ff090068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.741+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff090066900 0x7ff090068dc0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac142db0 tx=0x7ff098009040 comp rx=0 tx=0).stop 2023-11-29T03:15:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.741+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 msgr2=0x7ff0ac158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:08.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.741+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 0x7ff0ac158ea0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000d5f0 tx=0x7ff0a000dab0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 shutdown_connections 2023-11-29T03:15:08.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ff0ac144c80 0x7ff0ac140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ff090066900 0x7ff090068dc0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff0ac0cf640 0x7ff0ac0ac760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 --2- 172.21.15.16:0/1676759778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ff0ac0cdf00 0x7ff0ac158ea0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:08.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 >> 172.21.15.16:0/1676759778 conn(0x7ff0ac06a5a0 msgr2=0x7ff0ac06a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:08.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 shutdown_connections 2023-11-29T03:15:08.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:08.749+0000 7ff0b2b2a640 1 -- 172.21.15.16:0/1676759778 wait complete. 2023-11-29T03:15:08.832 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T03:15:09.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.065+0000 7f88374fe640 1 Processor -- start 2023-11-29T03:15:09.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.069+0000 7f88374fe640 1 -- start start 2023-11-29T03:15:09.080 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f88374fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f883015d540 0x7f88300b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:09.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f88374fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f88300d1f50 0x7f88300d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:09.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f88374fe640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88300b32c0 con 0x7f88300d34c0 2023-11-29T03:15:09.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f88374fe640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883015d920 con 0x7f88300d1f50 2023-11-29T03:15:09.081 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f88374fe640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88300b35a0 con 0x7f883015d540 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f8834a99640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f88300d1f50 0x7f88300d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f883529a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f883015d540 0x7f88300b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f883529a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f883015d540 0x7f88300b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44772/0 (socket says 172.21.15.16:44772) 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.073+0000 7f883529a640 1 -- 172.21.15.16:0/1379180678 learned_addr learned my addr 172.21.15.16:0/1379180678 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.077+0000 7f883529a640 1 -- 172.21.15.16:0/1379180678 >> v2:172.21.15.16:3300/0 conn(0x7f88300d1f50 msgr2=0x7f88300d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.077+0000 7f883529a640 1 --2- 172.21.15.16:0/1379180678 >> v2:172.21.15.16:3300/0 conn(0x7f88300d1f50 0x7f88300d2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:09.083 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.077+0000 7f883529a640 1 -- 172.21.15.16:0/1379180678 >> v1:172.21.15.16:6789/0 conn(0x7f88300d34c0 legacy=0x7f88300cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:09.084 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.077+0000 7f883529a640 1 -- 172.21.15.16:0/1379180678 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88300b3880 con 0x7f883015d540 2023-11-29T03:15:09.089 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.081+0000 7f883529a640 1 --2- 172.21.15.16:0/1379180678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88300b29c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f883008cc80 tx=0x7f882c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c23ec6e9c5f253bb server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.081+0000 7f8827fff640 1 -- 172.21.15.16:0/1379180678 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0aa5f0 con 0x7f883015d540 2023-11-29T03:15:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.081+0000 7f8827fff640 1 -- 172.21.15.16:0/1379180678 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882c0aa750 con 0x7f883015d540 2023-11-29T03:15:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.081+0000 7f8827fff640 1 -- 172.21.15.16:0/1379180678 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882c0aaae0 con 0x7f883015d540 2023-11-29T03:15:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.081+0000 7f88374fe640 1 -- 172.21.15.16:0/1379180678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 msgr2=0x7f88300b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:09.090 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.081+0000 7f88374fe640 1 --2- 172.21.15.16:0/1379180678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88300b29c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f883008cc80 tx=0x7f882c01c490 comp rx=0 tx=0).stop 2023-11-29T03:15:09.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.089+0000 7f88374fe640 1 -- 172.21.15.16:0/1379180678 shutdown_connections 2023-11-29T03:15:09.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.089+0000 7f88374fe640 1 --2- 172.21.15.16:0/1379180678 >> v2:172.21.15.16:3300/0 conn(0x7f88300d1f50 0x7f88300d2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:09.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.089+0000 7f88374fe640 1 --2- 172.21.15.16:0/1379180678 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88300b29c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:09.096 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.089+0000 7f88374fe640 1 -- 172.21.15.16:0/1379180678 >> 172.21.15.16:0/1379180678 conn(0x7f883008ccf0 msgr2=0x7f883009c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:09.097 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.089+0000 7f88374fe640 1 -- 172.21.15.16:0/1379180678 shutdown_connections 2023-11-29T03:15:09.098 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.089+0000 7f88374fe640 1 -- 172.21.15.16:0/1379180678 wait complete. 2023-11-29T03:15:09.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 Processor -- start 2023-11-29T03:15:09.100 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 -- start start 2023-11-29T03:15:09.102 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300d1f50 0x7f883015fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88300d34c0 0x7f883015e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88301589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883014a080 con 0x7f88300d1f50 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883015db20 con 0x7f883015d540 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f88374fe640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883015ddc0 con 0x7f88300d34c0 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.093+0000 7f8835a9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88301589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88301589c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44776/0 (socket says 172.21.15.16:44776) 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 -- 172.21.15.16:0/2167457735 learned_addr learned my addr 172.21.15.16:0/2167457735 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:09.103 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8834a99640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88300d34c0 0x7f883015e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:09.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 -- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88300d34c0 msgr2=0x7f883015e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:09.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88300d34c0 0x7f883015e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:09.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 -- 172.21.15.16:0/2167457735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300d1f50 msgr2=0x7f883015fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:09.104 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300d1f50 0x7f883015fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 -- 172.21.15.16:0/2167457735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882c0094d0 con 0x7f883015d540 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8835a9b640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88301589c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f882800c780 tx=0x7f882800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828004b70 con 0x7f883015d540 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882800ce90 con 0x7f883015d540 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883015e0a0 con 0x7f883015d540 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800a850 con 0x7f883015d540 2023-11-29T03:15:09.105 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.097+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8830160320 con 0x7f883015d540 2023-11-29T03:15:09.106 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.101+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f882800a9b0 con 0x7f883015d540 2023-11-29T03:15:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.101+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8830068860 con 0x7f883015d540 2023-11-29T03:15:09.107 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.101+0000 7f8825ffb640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88140668d0 0x7f8814068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:09.108 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.101+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f88280845f0 con 0x7f883015d540 2023-11-29T03:15:09.109 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.101+0000 7f883529a640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88140668d0 0x7f8814068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:09.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.105+0000 7f883529a640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88140668d0 0x7f8814068d90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ae000 tx=0x7f882c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:09.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.113+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88280517a0 con 0x7f883015d540 2023-11-29T03:15:09.988 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.981+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f883015e550 con 0x7f883015d540 2023-11-29T03:15:09.994 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:09.985+0000 7f8825ffb640 1 -- 172.21.15.16:0/2167457735 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16711 (secure 0 0 0) 0x7f8828082e60 con 0x7f883015d540 2023-11-29T03:15:09.995 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:09.995 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:41:17.472386+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T03:15:10.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88140668d0 msgr2=0x7f8814068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:10.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88140668d0 0x7f8814068d90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f882c0ae000 tx=0x7f882c008040 comp rx=0 tx=0).stop 2023-11-29T03:15:10.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 msgr2=0x7f88301589c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:10.013 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88301589c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f882800c780 tx=0x7f882800cc40 comp rx=0 tx=0).stop 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 shutdown_connections 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f88140668d0 0x7f8814068d90 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f883015d540 0x7f88301589c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f88300d34c0 0x7f883015e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 --2- 172.21.15.16:0/2167457735 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f88300d1f50 0x7f883015fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 >> 172.21.15.16:0/2167457735 conn(0x7f883008ccf0 msgr2=0x7f88300aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:10.014 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 shutdown_connections 2023-11-29T03:15:10.015 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.005+0000 7f88374fe640 1 -- 172.21.15.16:0/2167457735 wait complete. 2023-11-29T03:15:10.085 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T03:15:10.085 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T03:15:10.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.309+0000 7f3a68c9c640 1 Processor -- start 2023-11-29T03:15:10.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.313+0000 7f3a68c9c640 1 -- start start 2023-11-29T03:15:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.317+0000 7f3a68c9c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3a6415d480 0x7f3a640cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.317+0000 7f3a68c9c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 0x7f3a640b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.317+0000 7f3a68c9c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a640b3250 con 0x7f3a640ce3b0 2023-11-29T03:15:10.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.317+0000 7f3a68c9c640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640ce8f0 con 0x7f3a640d3920 2023-11-29T03:15:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.317+0000 7f3a68c9c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a640cebd0 con 0x7f3a6415d480 2023-11-29T03:15:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a63fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 0x7f3a640b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:10.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a637fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3a6415d480 0x7f3a640cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:10.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a637fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3a6415d480 0x7f3a640cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44782/0 (socket says 172.21.15.16:44782) 2023-11-29T03:15:10.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a63fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 0x7f3a640b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58880/0 (socket says 172.21.15.16:58880) 2023-11-29T03:15:10.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a637fe640 1 -- 172.21.15.16:0/1197938255 learned_addr learned my addr 172.21.15.16:0/1197938255 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a637fe640 1 -- 172.21.15.16:0/1197938255 >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 msgr2=0x7f3a640b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:10.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.321+0000 7f3a627fc640 1 -- 172.21.15.16:0/1197938255 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904879537 0 0) 0x7f3a640b3250 con 0x7f3a640ce3b0 2023-11-29T03:15:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.329+0000 7f3a637fe640 1 --2- 172.21.15.16:0/1197938255 >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 0x7f3a640b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.329+0000 7f3a637fe640 1 -- 172.21.15.16:0/1197938255 >> v1:172.21.15.64:6789/0 conn(0x7f3a640ce3b0 legacy=0x7f3a640d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:10.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.329+0000 7f3a637fe640 1 -- 172.21.15.16:0/1197938255 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a640ceeb0 con 0x7f3a6415d480 2023-11-29T03:15:10.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.329+0000 7f3a63fff640 1 --2- 172.21.15.16:0/1197938255 >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 0x7f3a640b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:10.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.333+0000 7f3a637fe640 1 --2- 172.21.15.16:0/1197938255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640cde70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a640b3180 tx=0x7f3a5401c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c02da4f8ec0856 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.333+0000 7f3a627fc640 1 -- 172.21.15.16:0/1197938255 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540aa610 con 0x7f3a6415d480 2023-11-29T03:15:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.333+0000 7f3a627fc640 1 -- 172.21.15.16:0/1197938255 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a540a6040 con 0x7f3a6415d480 2023-11-29T03:15:10.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.333+0000 7f3a627fc640 1 -- 172.21.15.16:0/1197938255 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a540aa990 con 0x7f3a6415d480 2023-11-29T03:15:10.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.333+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1197938255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 msgr2=0x7f3a640cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:10.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.333+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1197938255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640cde70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3a640b3180 tx=0x7f3a5401c4b0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.337+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1197938255 shutdown_connections 2023-11-29T03:15:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.337+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1197938255 >> v2:172.21.15.16:3300/0 conn(0x7f3a640d3920 0x7f3a640b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.337+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1197938255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640cde70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.337+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1197938255 >> 172.21.15.16:0/1197938255 conn(0x7f3a6408cc90 msgr2=0x7f3a6409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:10.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.337+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1197938255 shutdown_connections 2023-11-29T03:15:10.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.341+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1197938255 wait complete. 2023-11-29T03:15:10.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.345+0000 7f3a68c9c640 1 Processor -- start 2023-11-29T03:15:10.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.349+0000 7f3a68c9c640 1 -- start start 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a68c9c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a640ce3b0 0x7f3a641569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a68c9c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a640d3920 0x7f3a640b65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a68c9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a68c9c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b8e60 con 0x7f3a640ce3b0 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a68c9c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a64156ef0 con 0x7f3a6415d480 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a68c9c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a640b8b80 con 0x7f3a640d3920 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44784/0 (socket says 172.21.15.16:44784) 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 -- 172.21.15.16:0/1300084336 learned_addr learned my addr 172.21.15.16:0/1300084336 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a62ffd640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a640d3920 0x7f3a640b65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:10.361 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a637fe640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a640ce3b0 0x7f3a641569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 -- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a640d3920 msgr2=0x7f3a640b65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a640d3920 0x7f3a640b65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 -- 172.21.15.16:0/1300084336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a640ce3b0 msgr2=0x7f3a641569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a640ce3b0 0x7f3a641569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:10.362 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.353+0000 7f3a63fff640 1 -- 172.21.15.16:0/1300084336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a540094d0 con 0x7f3a6415d480 2023-11-29T03:15:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.357+0000 7f3a63fff640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640b7fc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c007ea0 tx=0x7f3a5c007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.357+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c015600 con 0x7f3a6415d480 2023-11-29T03:15:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.357+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00f040 con 0x7f3a6415d480 2023-11-29T03:15:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.357+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c0159a0 con 0x7f3a6415d480 2023-11-29T03:15:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.357+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a64155ed0 con 0x7f3a6415d480 2023-11-29T03:15:10.364 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.357+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a64156490 con 0x7f3a6415d480 2023-11-29T03:15:10.369 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.361+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a64156680 con 0x7f3a6415d480 2023-11-29T03:15:10.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.365+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3a5c01e3b0 con 0x7f3a6415d480 2023-11-29T03:15:10.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.365+0000 7f3a4bfff640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3a50066950 0x7f3a50068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:10.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.365+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3a5c084500 con 0x7f3a6415d480 2023-11-29T03:15:10.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.365+0000 7f3a637fe640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3a50066950 0x7f3a50068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:10.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.369+0000 7f3a637fe640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3a50066950 0x7f3a50068e10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3a540ae000 tx=0x7f3a540a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:10.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:10.369+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a5c051760 con 0x7f3a6415d480 2023-11-29T03:15:11.421 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.413+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a6404e890 con 0x7f3a6415d480 2023-11-29T03:15:11.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.413+0000 7f3a4bfff640 1 -- 172.21.15.16:0/1300084336 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f3a5c054d80 con 0x7f3a6415d480 2023-11-29T03:15:11.423 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:11.423 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:40:27.311390+0000","modified":"2023-11-28T17:40:30.336858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6836/2775576031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2775576031},{"type":"v1","addr":"172.21.15.64:6836","nonce":2775576031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T03:15:11.423 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2023-11-29T03:15:11.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3a50066950 msgr2=0x7f3a50068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:11.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3a50066950 0x7f3a50068e10 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f3a540ae000 tx=0x7f3a540a7000 comp rx=0 tx=0).stop 2023-11-29T03:15:11.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 msgr2=0x7f3a640b7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:11.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640b7fc0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c007ea0 tx=0x7f3a5c007f90 comp rx=0 tx=0).stop 2023-11-29T03:15:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 shutdown_connections 2023-11-29T03:15:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3a50066950 0x7f3a50068e10 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.430 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3a6415d480 0x7f3a640b7fc0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3a640d3920 0x7f3a640b65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 --2- 172.21.15.16:0/1300084336 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3a640ce3b0 0x7f3a641569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.421+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 >> 172.21.15.16:0/1300084336 conn(0x7f3a6408cc90 msgr2=0x7f3a6415c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:11.431 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.425+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 shutdown_connections 2023-11-29T03:15:11.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.425+0000 7f3a68c9c640 1 -- 172.21.15.16:0/1300084336 wait complete. 2023-11-29T03:15:11.481 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T03:15:11.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.761+0000 7f81703c4640 1 Processor -- start 2023-11-29T03:15:11.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.761+0000 7f81703c4640 1 -- start start 2023-11-29T03:15:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f81703c4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f816815d4a0 0x7f81680d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f81703c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81680cf850 0x7f81680d3070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:11.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f81703c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680ce7b0 con 0x7f816815d880 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f81703c4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81680cea90 con 0x7f816815d4a0 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f81703c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680ced70 con 0x7f81680cf850 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f816815d4a0 0x7f81680d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f816815d4a0 0x7f81680d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58896/0 (socket says 172.21.15.16:58896) 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 -- 172.21.15.16:0/674535601 learned_addr learned my addr 172.21.15.16:0/674535601 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 -- 172.21.15.16:0/674535601 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81680cf850 msgr2=0x7f81680d3070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 --2- 172.21.15.16:0/674535601 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81680cf850 0x7f81680d3070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 -- 172.21.15.16:0/674535601 >> v1:172.21.15.64:6789/0 conn(0x7f816815d880 legacy=0x7f81680cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:11.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.765+0000 7f816e160640 1 -- 172.21.15.16:0/674535601 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680cf050 con 0x7f816815d4a0 2023-11-29T03:15:11.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.769+0000 7f816e160640 1 --2- 172.21.15.16:0/674535601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d4a0 0x7f81680d1f30 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 crypto rx=0x7f8164009870 tx=0x7f816401cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923528c3f73c762c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.769+0000 7f816d15e640 1 -- 172.21.15.16:0/674535601 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640ac630 con 0x7f816815d4a0 2023-11-29T03:15:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.769+0000 7f816d15e640 1 -- 172.21.15.16:0/674535601 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81640ac790 con 0x7f816815d4a0 2023-11-29T03:15:11.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.769+0000 7f816d15e640 1 -- 172.21.15.16:0/674535601 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81640acb20 con 0x7f816815d4a0 2023-11-29T03:15:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 -- 172.21.15.16:0/674535601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d4a0 msgr2=0x7f81680d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:11.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 --2- 172.21.15.16:0/674535601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d4a0 0x7f81680d1f30 secure :-1 s=READY pgs=3285 cs=0 l=1 rev1=1 crypto rx=0x7f8164009870 tx=0x7f816401cf60 comp rx=0 tx=0).stop 2023-11-29T03:15:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 -- 172.21.15.16:0/674535601 shutdown_connections 2023-11-29T03:15:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 --2- 172.21.15.16:0/674535601 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f81680cf850 0x7f81680d3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 --2- 172.21.15.16:0/674535601 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d4a0 0x7f81680d1f30 unknown :-1 s=CLOSED pgs=3285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 -- 172.21.15.16:0/674535601 >> 172.21.15.16:0/674535601 conn(0x7f816808cd70 msgr2=0x7f816809c690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 -- 172.21.15.16:0/674535601 shutdown_connections 2023-11-29T03:15:11.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.773+0000 7f81703c4640 1 -- 172.21.15.16:0/674535601 wait complete. 2023-11-29T03:15:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 Processor -- start 2023-11-29T03:15:11.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 -- start start 2023-11-29T03:15:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81680cf850 0x7f81680c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:11.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f816815d4a0 0x7f816815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 0x7f81680c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681563e0 con 0x7f816815d880 2023-11-29T03:15:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681580c0 con 0x7f81680cf850 2023-11-29T03:15:11.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f81703c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680c6620 con 0x7f816815d4a0 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f816e961640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 0x7f81680c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f816e961640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 0x7f81680c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58904/0 (socket says 172.21.15.16:58904) 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.781+0000 7f816e961640 1 -- 172.21.15.16:0/1747980473 learned_addr learned my addr 172.21.15.16:0/1747980473 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e961640 1 -- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f816815d4a0 msgr2=0x7f816815bfe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e160640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81680cf850 0x7f81680c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e961640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f816815d4a0 0x7f816815bfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e961640 1 -- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81680cf850 msgr2=0x7f81680c60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e961640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81680cf850 0x7f81680c60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e961640 1 -- 172.21.15.16:0/1747980473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81640094d0 con 0x7f816815d880 2023-11-29T03:15:11.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e160640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81680cf850 0x7f81680c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T03:15:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f816e961640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 0x7f81680c6ed0 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7f816000b990 tx=0x7f816000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816000cba0 con 0x7f816815d880 2023-11-29T03:15:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816000cd00 con 0x7f816815d880 2023-11-29T03:15:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8168155860 con 0x7f816815d880 2023-11-29T03:15:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8160014680 con 0x7f816815d880 2023-11-29T03:15:11.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.785+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8168155e20 con 0x7f816815d880 2023-11-29T03:15:11.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.789+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8168158280 con 0x7f816815d880 2023-11-29T03:15:11.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.789+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f816001d3b0 con 0x7f816815d880 2023-11-29T03:15:11.801 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.793+0000 7f815effd640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f814c0668d0 0x7f814c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:11.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.793+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8160084e40 con 0x7f816815d880 2023-11-29T03:15:11.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.797+0000 7f816e160640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f814c0668d0 0x7f814c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:11.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.797+0000 7f816e160640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f814c0668d0 0x7f814c068d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f81640ae000 tx=0x7f8164008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:11.832 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:11.825+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8160051620 con 0x7f816815d880 2023-11-29T03:15:12.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.893+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8168067530 con 0x7f816815d880 2023-11-29T03:15:12.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.897+0000 7f815effd640 1 -- 172.21.15.16:0/1747980473 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f8160019070 con 0x7f816815d880 2023-11-29T03:15:12.906 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:12.906 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T17:40:27.311390+0000","modified":"2023-11-28T17:40:30.336858+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5055},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5055":{"gid":5055,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.64:6836/2775576031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":2775576031},{"type":"v1","addr":"172.21.15.64:6836","nonce":2775576031}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-29T03:15:12.906 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 17 2023-11-29T03:15:12.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f814c0668d0 msgr2=0x7f814c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:12.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f814c0668d0 0x7f814c068d90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f81640ae000 tx=0x7f8164008040 comp rx=0 tx=0).stop 2023-11-29T03:15:12.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 msgr2=0x7f81680c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:12.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 0x7f81680c6ed0 secure :-1 s=READY pgs=3286 cs=0 l=1 rev1=1 crypto rx=0x7f816000b990 tx=0x7f816000be50 comp rx=0 tx=0).stop 2023-11-29T03:15:12.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 shutdown_connections 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f816815d880 0x7f81680c6ed0 unknown :-1 s=CLOSED pgs=3286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f816815d4a0 0x7f816815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f814c0668d0 0x7f814c068d90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 --2- 172.21.15.16:0/1747980473 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f81680cf850 0x7f81680c60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 >> 172.21.15.16:0/1747980473 conn(0x7f816808cd70 msgr2=0x7f816815e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 shutdown_connections 2023-11-29T03:15:12.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:12.901+0000 7f81703c4640 1 -- 172.21.15.16:0/1747980473 wait complete. 2023-11-29T03:15:12.979 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T03:15:13.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 Processor -- start 2023-11-29T03:15:13.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 -- start start 2023-11-29T03:15:13.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f4fac143810 0x7f4fac0721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:13.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4fac0726e0 0x7f4fac06d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:13.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fac146da0 con 0x7f4fac06dae0 2023-11-29T03:15:13.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac06df70 con 0x7f4fac143810 2023-11-29T03:15:13.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fb17f8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fac0b2aa0 con 0x7f4fac0726e0 2023-11-29T03:15:13.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4fac0726e0 0x7f4fac06d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:13.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4fac0726e0 0x7f4fac06d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44796/0 (socket says 172.21.15.16:44796) 2023-11-29T03:15:13.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 -- 172.21.15.16:0/3306882198 learned_addr learned my addr 172.21.15.16:0/3306882198 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:13.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fabfff640 1 --2- 172.21.15.16:0/3306882198 >> v2:172.21.15.16:3300/0 conn(0x7f4fac143810 0x7f4fac0721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:13.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 -- 172.21.15.16:0/3306882198 >> v2:172.21.15.16:3300/0 conn(0x7f4fac143810 msgr2=0x7f4fac0721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:13.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 --2- 172.21.15.16:0/3306882198 >> v2:172.21.15.16:3300/0 conn(0x7f4fac143810 0x7f4fac0721a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:13.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 -- 172.21.15.16:0/3306882198 >> v1:172.21.15.64:6789/0 conn(0x7f4fac06dae0 legacy=0x7f4fac0b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:13.215 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.205+0000 7f4fa3fff640 1 -- 172.21.15.16:0/3306882198 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fac0b2d80 con 0x7f4fac0726e0 2023-11-29T03:15:13.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.209+0000 7f4fa3fff640 1 --2- 172.21.15.16:0/3306882198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac0726e0 0x7f4fac06d5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fac071190 tx=0x7f4f9401c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f27d4db03704bf9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:13.218 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.209+0000 7f4fab7fe640 1 -- 172.21.15.16:0/3306882198 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940ac410 con 0x7f4fac0726e0 2023-11-29T03:15:13.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.209+0000 7f4fab7fe640 1 -- 172.21.15.16:0/3306882198 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f940ac570 con 0x7f4fac0726e0 2023-11-29T03:15:13.219 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fab7fe640 1 -- 172.21.15.16:0/3306882198 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940ac900 con 0x7f4fac0726e0 2023-11-29T03:15:13.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3306882198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac0726e0 msgr2=0x7f4fac06d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:13.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3306882198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac0726e0 0x7f4fac06d5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4fac071190 tx=0x7f4f9401c3b0 comp rx=0 tx=0).stop 2023-11-29T03:15:13.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3306882198 shutdown_connections 2023-11-29T03:15:13.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3306882198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac0726e0 0x7f4fac06d5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:13.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3306882198 >> v2:172.21.15.16:3300/0 conn(0x7f4fac143810 0x7f4fac0721a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:13.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3306882198 >> 172.21.15.16:0/3306882198 conn(0x7f4fac06aba0 msgr2=0x7f4fac0b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:13.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3306882198 shutdown_connections 2023-11-29T03:15:13.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3306882198 wait complete. 2023-11-29T03:15:13.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 Processor -- start 2023-11-29T03:15:13.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.213+0000 7f4fb17f8640 1 -- start start 2023-11-29T03:15:13.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4fac06dae0 0x7f4fac15ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:13.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac0726e0 0x7f4fac138780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:13.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 0x7f4fac0aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:13.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac15a990 con 0x7f4fac0726e0 2023-11-29T03:15:13.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac13e670 con 0x7f4fac143810 2023-11-29T03:15:13.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac15a060 con 0x7f4fac06dae0 2023-11-29T03:15:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 0x7f4fac0aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 0x7f4fac0aedf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44804/0 (socket says 172.21.15.16:44804) 2023-11-29T03:15:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 -- 172.21.15.16:0/3513212573 learned_addr learned my addr 172.21.15.16:0/3513212573 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:13.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fa3fff640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac0726e0 0x7f4fac138780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 -- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4fac06dae0 msgr2=0x7f4fac15ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4fac06dae0 0x7f4fac15ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:13.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 -- 172.21.15.16:0/3513212573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac0726e0 msgr2=0x7f4fac138780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac0726e0 0x7f4fac138780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 -- 172.21.15.16:0/3513212573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f940094d0 con 0x7f4fac143810 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb0ff7640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 0x7f4fac0aedf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c730 tx=0x7f4fa400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4003b80 con 0x7f4fac143810 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fa4003ce0 con 0x7f4fac143810 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa400aa30 con 0x7f4fac143810 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac15a340 con 0x7f4fac143810 2023-11-29T03:15:13.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.217+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac138cc0 con 0x7f4fac143810 2023-11-29T03:15:13.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.221+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fac04e890 con 0x7f4fac143810 2023-11-29T03:15:13.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.229+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f4fa400ab90 con 0x7f4fac143810 2023-11-29T03:15:13.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.229+0000 7f4fa97fa640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4f8c0668d0 0x7f4f8c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:13.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.229+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f4fa4084270 con 0x7f4fac143810 2023-11-29T03:15:13.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.229+0000 7f4fabfff640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4f8c0668d0 0x7f4f8c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:13.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.233+0000 7f4fabfff640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4f8c0668d0 0x7f4f8c068d90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0098f0 tx=0x7f4f9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:13.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:13.233+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fa4051430 con 0x7f4fac143810 2023-11-29T03:15:14.044 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.037+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fac15ab00 con 0x7f4fac143810 2023-11-29T03:15:14.050 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.041+0000 7f4fa97fa640 1 -- 172.21.15.16:0/3513212573 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16711 (secure 0 0 0) 0x7f4fa4054a50 con 0x7f4fac143810 2023-11-29T03:15:14.059 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:14.059 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":37,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-28T17:41:17.472386+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T17:40:25.116530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T17:40:26.310896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.13","mappings":[{"from":4,"to":5}]},{"pgid":"5.15","mappings":[{"from":4,"to":5}]},{"pgid":"5.19","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T03:15:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.057+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4f8c0668d0 msgr2=0x7f4f8c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.057+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4f8c0668d0 0x7f4f8c068d90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0098f0 tx=0x7f4f9c008040 comp rx=0 tx=0).stop 2023-11-29T03:15:14.064 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.057+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 msgr2=0x7f4fac0aedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:14.065 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.057+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 0x7f4fac0aedf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400c730 tx=0x7f4fa400cbf0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 shutdown_connections 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f4f8c0668d0 0x7f4f8c068d90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fac143810 0x7f4fac0aedf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f4fac0726e0 0x7f4fac138780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 --2- 172.21.15.16:0/3513212573 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f4fac06dae0 0x7f4fac15ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 >> 172.21.15.16:0/3513212573 conn(0x7f4fac06aba0 msgr2=0x7f4fac13faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:14.068 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 shutdown_connections 2023-11-29T03:15:14.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.061+0000 7f4fb17f8640 1 -- 172.21.15.16:0/3513212573 wait complete. 2023-11-29T03:15:14.147 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-29T03:15:14.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.705+0000 7fc0c5e46640 1 Processor -- start 2023-11-29T03:15:14.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.705+0000 7fc0c5e46640 1 -- start start 2023-11-29T03:15:14.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0c5e46640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fc0c015d6a0 0x7fc0c00adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:14.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0c5e46640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc0c006d870 0x7fc0c006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:14.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0c5e46640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c00b21d0 con 0x7fc0c006e870 2023-11-29T03:15:14.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0c5e46640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c00ae9c0 con 0x7fc0c015d6a0 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0bffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc0c006d870 0x7fc0c006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0bffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc0c006d870 0x7fc0c006dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44810/0 (socket says 172.21.15.16:44810) 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0bffff640 1 -- 172.21.15.16:0/1934923118 learned_addr learned my addr 172.21.15.16:0/1934923118 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0bf7fe640 1 --2- 172.21.15.16:0/1934923118 >> v2:172.21.15.16:3300/0 conn(0x7fc0c015d6a0 0x7fc0c00adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0c5e46640 1 -- 172.21.15.16:0/1934923118 --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c006e240 con 0x7fc0c006d870 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.709+0000 7fc0bffff640 1 -- 172.21.15.16:0/1934923118 >> v2:172.21.15.16:3300/0 conn(0x7fc0c015d6a0 msgr2=0x7fc0c00adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.713+0000 7fc0bffff640 1 --2- 172.21.15.16:0/1934923118 >> v2:172.21.15.16:3300/0 conn(0x7fc0c015d6a0 0x7fc0c00adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.719 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.713+0000 7fc0bffff640 1 -- 172.21.15.16:0/1934923118 >> v1:172.21.15.64:6789/0 conn(0x7fc0c006e870 legacy=0x7fc0c01616d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T03:15:14.723 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.713+0000 7fc0bffff640 1 -- 172.21.15.16:0/1934923118 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c00ae120 con 0x7fc0c006d870 2023-11-29T03:15:14.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.717+0000 7fc0bffff640 1 --2- 172.21.15.16:0/1934923118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c006d870 0x7fc0c006dd00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0074460 tx=0x7fc0b401c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccf2fe7016743f17 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:14.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.721+0000 7fc0be7fc640 1 -- 172.21.15.16:0/1934923118 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40aa5f0 con 0x7fc0c006d870 2023-11-29T03:15:14.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.721+0000 7fc0be7fc640 1 -- 172.21.15.16:0/1934923118 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b40aa750 con 0x7fc0c006d870 2023-11-29T03:15:14.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.721+0000 7fc0be7fc640 1 -- 172.21.15.16:0/1934923118 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b40aaae0 con 0x7fc0c006d870 2023-11-29T03:15:14.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.721+0000 7fc0c5e46640 1 -- 172.21.15.16:0/1934923118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c006d870 msgr2=0x7fc0c006dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:14.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.721+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/1934923118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c006d870 0x7fc0c006dd00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0c0074460 tx=0x7fc0b401c490 comp rx=0 tx=0).stop 2023-11-29T03:15:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.725+0000 7fc0c5e46640 1 -- 172.21.15.16:0/1934923118 shutdown_connections 2023-11-29T03:15:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.725+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/1934923118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c006d870 0x7fc0c006dd00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.725+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/1934923118 >> v2:172.21.15.16:3300/0 conn(0x7fc0c015d6a0 0x7fc0c00adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.731 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.725+0000 7fc0c5e46640 1 -- 172.21.15.16:0/1934923118 >> 172.21.15.16:0/1934923118 conn(0x7fc0c00cefa0 msgr2=0x7fc0c00cf3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.725+0000 7fc0c5e46640 1 -- 172.21.15.16:0/1934923118 shutdown_connections 2023-11-29T03:15:14.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.725+0000 7fc0c5e46640 1 -- 172.21.15.16:0/1934923118 wait complete. 2023-11-29T03:15:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.733+0000 7fc0c5e46640 1 Processor -- start 2023-11-29T03:15:14.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.733+0000 7fc0c5e46640 1 -- start start 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0c5e46640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc0c006d870 0x7fc0c014b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0c5e46640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 0x7fc0c0154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0c5e46640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c015d6a0 0x7fc0c01553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 0x7fc0c0154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 0x7fc0c0154ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58936/0 (socket says 172.21.15.16:58936) 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0bf7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc0c006d870 0x7fc0c014b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0bf7fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc0c006d870 0x7fc0c014b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:35136/0 (socket says 172.21.15.16:35136) 2023-11-29T03:15:14.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0bffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c015d6a0 0x7fc0c01553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0bffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c015d6a0 0x7fc0c01553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44820/0 (socket says 172.21.15.16:44820) 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 -- 172.21.15.16:0/3671705353 learned_addr learned my addr 172.21.15.16:0/3671705353 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c014f320 con 0x7fc0c006e870 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c014bd00 con 0x7fc0c015d6a0 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c014bfc0 con 0x7fc0c006d870 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 -- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc0c006d870 msgr2=0x7fc0c014b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc0c006d870 0x7fc0c014b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 -- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c015d6a0 msgr2=0x7fc0c01553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:14.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c015d6a0 0x7fc0c01553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.737+0000 7fc0beffd640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b40094d0 con 0x7fc0c006e870 2023-11-29T03:15:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.741+0000 7fc0beffd640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 0x7fc0c0154ea0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b4a0 tx=0x7fc0b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.741+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0010610 con 0x7fc0c006e870 2023-11-29T03:15:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.741+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b0010790 con 0x7fc0c006e870 2023-11-29T03:15:14.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.741+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b0010b40 con 0x7fc0c006e870 2023-11-29T03:15:14.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.749+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c014c2a0 con 0x7fc0c006e870 2023-11-29T03:15:14.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.749+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c014c860 con 0x7fc0c006e870 2023-11-29T03:15:14.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.749+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c014ca50 con 0x7fc0c006e870 2023-11-29T03:15:14.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.757+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fc0b0010ca0 con 0x7fc0c006e870 2023-11-29T03:15:14.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.757+0000 7fc0a7fff640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc0ac066920 0x7fc0ac068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:14.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.757+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc0b0084020 con 0x7fc0c006e870 2023-11-29T03:15:14.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.761+0000 7fc0bf7fe640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc0ac066920 0x7fc0ac068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:14.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.765+0000 7fc0bf7fe640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc0ac066920 0x7fc0ac068de0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8003ab0 tx=0x7fc0b8009830 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:14.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:14.777+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0b00512e0 con 0x7fc0c006e870 2023-11-29T03:15:15.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.805+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc0c0068860 con 0x7fc0c006e870 2023-11-29T03:15:15.919 INFO:tasks.ceph.mon.a.smithi016.stderr:2023-11-29T03:15:15.909+0000 7fcd3014a640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-29T03:15:15.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.913+0000 7fc0a7fff640 1 -- 172.21.15.16:0/3671705353 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc0b001e090 con 0x7fc0c006e870 2023-11-29T03:15:15.922 INFO:teuthology.orchestra.run.smithi016.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-29T03:15:15.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc0ac066920 msgr2=0x7fc0ac068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:15.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc0ac066920 0x7fc0ac068de0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc0b8003ab0 tx=0x7fc0b8009830 comp rx=0 tx=0).stop 2023-11-29T03:15:15.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 msgr2=0x7fc0c0154ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:15.932 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 0x7fc0c0154ea0 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7fc0b000b4a0 tx=0x7fc0b000b960 comp rx=0 tx=0).stop 2023-11-29T03:15:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 shutdown_connections 2023-11-29T03:15:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fc0ac066920 0x7fc0ac068de0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc0c015d6a0 0x7fc0c01553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fc0c006e870 0x7fc0c0154ea0 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 --2- 172.21.15.16:0/3671705353 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fc0c006d870 0x7fc0c014b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:15.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 >> 172.21.15.16:0/3671705353 conn(0x7fc0c00cefa0 msgr2=0x7fc0c0156c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 shutdown_connections 2023-11-29T03:15:15.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:15.925+0000 7fc0c5e46640 1 -- 172.21.15.16:0/3671705353 wait complete. 2023-11-29T03:15:16.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-29T03:15:16.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.441+0000 7fdf96a79640 1 Processor -- start 2023-11-29T03:15:16.451 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.445+0000 7fdf96a79640 1 -- start start 2023-11-29T03:15:16.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.445+0000 7fdf96a79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf900c9dc0 0x7fdf9006ce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:16.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.445+0000 7fdf96a79640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf9006d3d0 0x7fdf900c5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:16.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.445+0000 7fdf96a79640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9015b660 con 0x7fdf9006a5a0 2023-11-29T03:15:16.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.445+0000 7fdf96a79640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf900cae00 con 0x7fdf9006d3d0 2023-11-29T03:15:16.455 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.445+0000 7fdf96a79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c57c0 con 0x7fdf900c9dc0 2023-11-29T03:15:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf9006d3d0 0x7fdf900c5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf8ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf900c9dc0 0x7fdf9006ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf9006d3d0 0x7fdf900c5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:44830/0 (socket says 172.21.15.16:44830) 2023-11-29T03:15:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 -- 172.21.15.16:0/2461994186 learned_addr learned my addr 172.21.15.16:0/2461994186 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 -- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf900c9dc0 msgr2=0x7fdf9006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:16.456 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 --2- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf900c9dc0 0x7fdf9006ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 -- 172.21.15.16:0/2461994186 >> v1:172.21.15.64:6789/0 conn(0x7fdf9006a5a0 legacy=0x7fdf900ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:16.457 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.449+0000 7fdf95016640 1 -- 172.21.15.16:0/2461994186 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf900c4bb0 con 0x7fdf9006d3d0 2023-11-29T03:15:16.462 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf95016640 1 --2- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006d3d0 0x7fdf900c5c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009e80 tx=0x7fdf8801c980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f38a593031c845b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf8f7fe640 1 -- 172.21.15.16:0/2461994186 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880a5820 con 0x7fdf9006d3d0 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf8f7fe640 1 -- 172.21.15.16:0/2461994186 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880a5980 con 0x7fdf9006d3d0 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf8f7fe640 1 -- 172.21.15.16:0/2461994186 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880a5d10 con 0x7fdf9006d3d0 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 -- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006d3d0 msgr2=0x7fdf900c5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 --2- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006d3d0 0x7fdf900c5c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdf88009e80 tx=0x7fdf8801c980 comp rx=0 tx=0).stop 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 -- 172.21.15.16:0/2461994186 shutdown_connections 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 --2- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006d3d0 0x7fdf900c5c50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 --2- 172.21.15.16:0/2461994186 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf900c9dc0 0x7fdf9006ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.463 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 -- 172.21.15.16:0/2461994186 >> 172.21.15.16:0/2461994186 conn(0x7fdf900cc180 msgr2=0x7fdf900cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:16.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 -- 172.21.15.16:0/2461994186 shutdown_connections 2023-11-29T03:15:16.464 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 -- 172.21.15.16:0/2461994186 wait complete. 2023-11-29T03:15:16.466 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.457+0000 7fdf96a79640 1 Processor -- start 2023-11-29T03:15:16.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 -- start start 2023-11-29T03:15:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006a5a0 0x7fdf9013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf9006d3d0 0x7fdf900c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 0x7fdf900c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c7560 con 0x7fdf900c9dc0 2023-11-29T03:15:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c6950 con 0x7fdf9006a5a0 2023-11-29T03:15:16.470 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf96a79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf900c6c30 con 0x7fdf9006d3d0 2023-11-29T03:15:16.471 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf95016640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 0x7fdf900c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf95016640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 0x7fdf900c86a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:58952/0 (socket says 172.21.15.16:58952) 2023-11-29T03:15:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf95016640 1 -- 172.21.15.16:0/4006326838 learned_addr learned my addr 172.21.15.16:0/4006326838 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf8ffff640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf9006d3d0 0x7fdf900c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.461+0000 7fdf94815640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006a5a0 0x7fdf9013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8ffff640 1 -- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006a5a0 msgr2=0x7fdf9013efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:16.472 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8ffff640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006a5a0 0x7fdf9013efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8ffff640 1 -- 172.21.15.16:0/4006326838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 msgr2=0x7fdf900c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:16.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8ffff640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 0x7fdf900c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8ffff640 1 -- 172.21.15.16:0/4006326838 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf88009b30 con 0x7fdf9006d3d0 2023-11-29T03:15:16.473 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf95016640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 0x7fdf900c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8ffff640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf9006d3d0 0x7fdf900c8160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00e840 tx=0x7fdf7c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0095d0 con 0x7fdf9006d3d0 2023-11-29T03:15:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c00c940 con 0x7fdf9006d3d0 2023-11-29T03:15:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf900c6f10 con 0x7fdf9006d3d0 2023-11-29T03:15:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c00ccb0 con 0x7fdf9006d3d0 2023-11-29T03:15:16.474 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.465+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9013f520 con 0x7fdf9006d3d0 2023-11-29T03:15:16.475 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.469+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9006f500 con 0x7fdf9006d3d0 2023-11-29T03:15:16.477 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.469+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdf7c013470 con 0x7fdf9006d3d0 2023-11-29T03:15:16.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.473+0000 7fdf8d7fa640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdf74066950 0x7fdf74068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:16.480 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.473+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fdf7c084970 con 0x7fdf9006d3d0 2023-11-29T03:15:16.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.473+0000 7fdf94815640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdf74066950 0x7fdf74068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:16.481 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.473+0000 7fdf94815640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdf74066950 0x7fdf74068e10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdf901f7650 tx=0x7fdf84009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:16.484 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.477+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdf7c051b70 con 0x7fdf9006d3d0 2023-11-29T03:15:16.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.673+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdf900c6d70 con 0x7fdf9006d3d0 2023-11-29T03:15:16.779 INFO:tasks.ceph.mds.d.smithi064.stdout:starting mds.d at 2023-11-29T03:15:16.931 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.929+0000 7fdf8d7fa640 1 -- 172.21.15.16:0/4006326838 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdf900c6d70 con 0x7fdf9006d3d0 2023-11-29T03:15:16.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdf74066950 msgr2=0x7fdf74068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:16.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdf74066950 0x7fdf74068e10 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fdf901f7650 tx=0x7fdf84009060 comp rx=0 tx=0).stop 2023-11-29T03:15:16.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf9006d3d0 msgr2=0x7fdf900c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:16.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf9006d3d0 0x7fdf900c8160 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00e840 tx=0x7fdf7c00ed00 comp rx=0 tx=0).stop 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 shutdown_connections 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdf900c9dc0 0x7fdf900c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdf9006d3d0 0x7fdf900c8160 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdf74066950 0x7fdf74068e10 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 --2- 172.21.15.16:0/4006326838 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf9006a5a0 0x7fdf9013efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 >> 172.21.15.16:0/4006326838 conn(0x7fdf900cc180 msgr2=0x7fdf900af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 shutdown_connections 2023-11-29T03:15:16.937 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:16.933+0000 7fdf96a79640 1 -- 172.21.15.16:0/4006326838 wait complete. 2023-11-29T03:15:16.962 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-29T03:15:17.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.389+0000 7faa1b59e640 1 Processor -- start 2023-11-29T03:15:17.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.393+0000 7faa1b59e640 1 -- start start 2023-11-29T03:15:17.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.393+0000 7faa1b59e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa1c160810 0x7faa1c0d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:17.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.393+0000 7faa1b59e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0d3640 0x7faa1c0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:17.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.393+0000 7faa1b59e640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1c0b2a20 con 0x7faa1c0cdd70 2023-11-29T03:15:17.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.393+0000 7faa1b59e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa1c0d1ae0 con 0x7faa1c160810 2023-11-29T03:15:17.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.393+0000 7faa1b59e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0d1d80 con 0x7faa1c0d3640 2023-11-29T03:15:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa1c160810 0x7faa1c0d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7faa1c160810 0x7faa1c0d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37726/0 (socket says 172.21.15.16:37726) 2023-11-29T03:15:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 -- 172.21.15.16:0/446693005 learned_addr learned my addr 172.21.15.16:0/446693005 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:17.400 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1ad9d640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0d3640 0x7faa1c0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:17.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 -- 172.21.15.16:0/446693005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0d3640 msgr2=0x7faa1c0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:17.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0d3640 0x7faa1c0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:17.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 -- 172.21.15.16:0/446693005 >> v1:172.21.15.16:6789/0 conn(0x7faa1c0cdd70 legacy=0x7faa1c0d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:17.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1a59c640 1 -- 172.21.15.16:0/446693005 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1c0d2060 con 0x7faa1c160810 2023-11-29T03:15:17.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.397+0000 7faa1ad9d640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0d3640 0x7faa1c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-29T03:15:17.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1a59c640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c160810 0x7faa1c0d1160 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009870 tx=0x7faa0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a96cc4a1a4c3c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:17.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1959a640 1 -- 172.21.15.16:0/446693005 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0ac630 con 0x7faa1c160810 2023-11-29T03:15:17.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1959a640 1 -- 172.21.15.16:0/446693005 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c0ac790 con 0x7faa1c160810 2023-11-29T03:15:17.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1959a640 1 -- 172.21.15.16:0/446693005 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0acb20 con 0x7faa1c160810 2023-11-29T03:15:17.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 -- 172.21.15.16:0/446693005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c160810 msgr2=0x7faa1c0d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:17.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c160810 0x7faa1c0d1160 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009870 tx=0x7faa0c01c500 comp rx=0 tx=0).stop 2023-11-29T03:15:17.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 -- 172.21.15.16:0/446693005 shutdown_connections 2023-11-29T03:15:17.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0d3640 0x7faa1c0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:17.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 --2- 172.21.15.16:0/446693005 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c160810 0x7faa1c0d1160 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:17.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 -- 172.21.15.16:0/446693005 >> 172.21.15.16:0/446693005 conn(0x7faa1c08afd0 msgr2=0x7faa1c09c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:17.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 -- 172.21.15.16:0/446693005 shutdown_connections 2023-11-29T03:15:17.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.401+0000 7faa1b59e640 1 -- 172.21.15.16:0/446693005 wait complete. 2023-11-29T03:15:17.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.409+0000 7faa1b59e640 1 Processor -- start 2023-11-29T03:15:17.412 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.409+0000 7faa1b59e640 1 -- start start 2023-11-29T03:15:17.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 0x7faa1c0b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:17.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c0d3640 0x7faa1c156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:17.415 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c160810 0x7faa1c0c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:17.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b66d0 con 0x7faa1c0d3640 2023-11-29T03:15:17.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b69b0 con 0x7faa1c160810 2023-11-29T03:15:17.416 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1c0b6c90 con 0x7faa1c0cdd70 2023-11-29T03:15:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 0x7faa1c0b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 0x7faa1c0b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:42628/0 (socket says 172.21.15.16:42628) 2023-11-29T03:15:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 -- 172.21.15.16:0/1355519073 learned_addr learned my addr 172.21.15.16:0/1355519073 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa19d9b640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c0d3640 0x7faa1c156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1ad9d640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c160810 0x7faa1c0c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:17.418 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 -- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c160810 msgr2=0x7faa1c0c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c160810 0x7faa1c0c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 -- 172.21.15.16:0/1355519073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c0d3640 msgr2=0x7faa1c156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c0d3640 0x7faa1c156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 -- 172.21.15.16:0/1355519073 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c0094d0 con 0x7faa1c0cdd70 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1a59c640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 0x7faa1c0b5e80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0af040 tx=0x7faa0c01ad40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0ab8e0 con 0x7faa1c0cdd70 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa0c0aba80 con 0x7faa1c0cdd70 2023-11-29T03:15:17.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1c0b6f70 con 0x7faa1c0cdd70 2023-11-29T03:15:17.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa0c0abe30 con 0x7faa1c0cdd70 2023-11-29T03:15:17.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.413+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1c0b63c0 con 0x7faa1c0cdd70 2023-11-29T03:15:17.420 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.417+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1c0b7490 con 0x7faa1c0cdd70 2023-11-29T03:15:17.422 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.417+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7faa0c0b3040 con 0x7faa1c0cdd70 2023-11-29T03:15:17.425 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.421+0000 7faa0affd640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa9fc066900 0x7fa9fc068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:17.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.421+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5911+0+0 (secure 0 0 0) 0x7faa0c11ed90 con 0x7faa1c0cdd70 2023-11-29T03:15:17.426 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.421+0000 7faa19d9b640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa9fc066900 0x7fa9fc068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:17.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.425+0000 7faa19d9b640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa9fc066900 0x7fa9fc068dc0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faa1c15f600 tx=0x7faa10009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:17.429 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.425+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faa1c0b7490 con 0x7faa1c0cdd70 2023-11-29T03:15:17.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:17.897+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faa1c0b7490 con 0x7faa1c0cdd70 2023-11-29T03:15:18.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.809+0000 7faa0affd640 1 -- 172.21.15.16:0/1355519073 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7faa1c0b7490 con 0x7faa1c0cdd70 2023-11-29T03:15:18.815 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_metadata' removed 2023-11-29T03:15:18.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa9fc066900 msgr2=0x7fa9fc068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa9fc066900 0x7fa9fc068dc0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7faa1c15f600 tx=0x7faa10009060 comp rx=0 tx=0).stop 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 msgr2=0x7faa1c0b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 0x7faa1c0b5e80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0af040 tx=0x7faa0c01ad40 comp rx=0 tx=0).stop 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 shutdown_connections 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa9fc066900 0x7fa9fc068dc0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa1c160810 0x7faa1c0c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7faa1c0d3640 0x7faa1c156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:18.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 --2- 172.21.15.16:0/1355519073 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7faa1c0cdd70 0x7faa1c0b5e80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:18.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 >> 172.21.15.16:0/1355519073 conn(0x7faa1c08afd0 msgr2=0x7faa1c06b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:18.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 shutdown_connections 2023-11-29T03:15:18.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:18.813+0000 7faa1b59e640 1 -- 172.21.15.16:0/1355519073 wait complete. 2023-11-29T03:15:18.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-29T03:15:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.789+0000 7fdc1af1e640 1 Processor -- start 2023-11-29T03:15:19.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.789+0000 7fdc1af1e640 1 -- start start 2023-11-29T03:15:19.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.793+0000 7fdc1af1e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdc1414af10 0x7fdc14070f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:19.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.793+0000 7fdc1af1e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1406d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:19.798 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.793+0000 7fdc1af1e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc14071930 con 0x7fdc1414b2f0 2023-11-29T03:15:19.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.793+0000 7fdc1af1e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc14071c10 con 0x7fdc1414af10 2023-11-29T03:15:19.799 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.793+0000 7fdc1af1e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140ccf20 con 0x7fdc140714b0 2023-11-29T03:15:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.793+0000 7fdc1971b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc1a71d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdc1414b2f0 0x7fdc141652b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:35460/0 (socket says 172.21.15.16:35460) 2023-11-29T03:15:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc1a71d640 1 -- 172.21.15.16:0/2437912574 learned_addr learned my addr 172.21.15.16:0/2437912574 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc1971b640 1 -- 172.21.15.16:0/2437912574 >> v2:172.21.15.64:3300/0 conn(0x7fdc1414af10 msgr2=0x7fdc14070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:19.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc1971b640 1 --2- 172.21.15.16:0/2437912574 >> v2:172.21.15.64:3300/0 conn(0x7fdc1414af10 0x7fdc14070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:19.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc18f1a640 1 -- 172.21.15.16:0/2437912574 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466608679 0 0) 0x7fdc14071930 con 0x7fdc1414b2f0 2023-11-29T03:15:19.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc1971b640 1 -- 172.21.15.16:0/2437912574 >> v1:172.21.15.64:6789/0 conn(0x7fdc1414b2f0 legacy=0x7fdc141652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:19.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.797+0000 7fdc1971b640 1 -- 172.21.15.16:0/2437912574 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140cd200 con 0x7fdc140714b0 2023-11-29T03:15:19.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.813+0000 7fdc1971b640 1 --2- 172.21.15.16:0/2437912574 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1406d890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009d90 tx=0x7fdc0401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4245718a312dba77 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.813+0000 7fdc18f1a640 1 -- 172.21.15.16:0/2437912574 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040a59c0 con 0x7fdc140714b0 2023-11-29T03:15:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.813+0000 7fdc18f1a640 1 -- 172.21.15.16:0/2437912574 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040a5b20 con 0x7fdc140714b0 2023-11-29T03:15:19.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.813+0000 7fdc18f1a640 1 -- 172.21.15.16:0/2437912574 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040ad440 con 0x7fdc140714b0 2023-11-29T03:15:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 -- 172.21.15.16:0/2437912574 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 msgr2=0x7fdc1406d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/2437912574 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1406d890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdc04009d90 tx=0x7fdc0401c900 comp rx=0 tx=0).stop 2023-11-29T03:15:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 -- 172.21.15.16:0/2437912574 shutdown_connections 2023-11-29T03:15:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/2437912574 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1406d890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/2437912574 >> v2:172.21.15.64:3300/0 conn(0x7fdc1414af10 0x7fdc14070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:19.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 -- 172.21.15.16:0/2437912574 >> 172.21.15.16:0/2437912574 conn(0x7fdc140b0ca0 msgr2=0x7fdc140b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:19.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 -- 172.21.15.16:0/2437912574 shutdown_connections 2023-11-29T03:15:19.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.817+0000 7fdc1af1e640 1 -- 172.21.15.16:0/2437912574 wait complete. 2023-11-29T03:15:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 Processor -- start 2023-11-29T03:15:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 -- start start 2023-11-29T03:15:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1413f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc1414af10 0x7fdc14142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:19.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1414b2f0 0x7fdc1415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1971b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc1414af10 0x7fdc14142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14142620 con 0x7fdc1414b2f0 2023-11-29T03:15:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14159e30 con 0x7fdc1414af10 2023-11-29T03:15:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1971b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc1414af10 0x7fdc14142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:34722/0 (socket says 172.21.15.16:34722) 2023-11-29T03:15:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1971b640 1 -- 172.21.15.16:0/1382183281 learned_addr learned my addr 172.21.15.16:0/1382183281 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:19.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.833+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14141730 con 0x7fdc140714b0 2023-11-29T03:15:19.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1413f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 -- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc1414af10 msgr2=0x7fdc14142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc1414af10 0x7fdc14142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 -- 172.21.15.16:0/1382183281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1414b2f0 msgr2=0x7fdc1415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1414b2f0 0x7fdc1415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 -- 172.21.15.16:0/1382183281 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc04009a70 con 0x7fdc140714b0 2023-11-29T03:15:19.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.837+0000 7fdc19f1c640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1413f270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00b3f0 tx=0x7fdc0c00b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:19.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.841+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c011830 con 0x7fdc140714b0 2023-11-29T03:15:19.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.841+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc14141a10 con 0x7fdc140714b0 2023-11-29T03:15:19.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.841+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc14141fd0 con 0x7fdc140714b0 2023-11-29T03:15:19.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.845+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c011990 con 0x7fdc140714b0 2023-11-29T03:15:19.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.845+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c011d40 con 0x7fdc140714b0 2023-11-29T03:15:19.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.849+0000 7fdbfbfff640 1 -- 172.21.15.16:0/1382183281 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbf4005260 con 0x7fdc140714b0 2023-11-29T03:15:19.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.861+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fdc0c01a400 con 0x7fdc140714b0 2023-11-29T03:15:19.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.865+0000 7fdc127fc640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc000668d0 0x7fdc00068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:19.869 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.865+0000 7fdc1971b640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc000668d0 0x7fdc00068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:19.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.869+0000 7fdc1971b640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc000668d0 0x7fdc00068d90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401afb0 tx=0x7fdc040a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:19.889 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.885+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fdc0c055a70 con 0x7fdc140714b0 2023-11-29T03:15:19.927 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:19.925+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdc0c0516b0 con 0x7fdc140714b0 2023-11-29T03:15:20.467 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.465+0000 7fdbfbfff640 1 -- 172.21.15.16:0/1382183281 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbf4005510 con 0x7fdc140714b0 2023-11-29T03:15:20.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.861+0000 7fdc127fc640 1 -- 172.21.15.16:0/1382183281 <== mon.2 v2:172.21.15.64:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdc0c015030 con 0x7fdc140714b0 2023-11-29T03:15:20.867 INFO:teuthology.orchestra.run.smithi016.stderr:pool 'cephfs_data' removed 2023-11-29T03:15:20.871 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc000668d0 msgr2=0x7fdc00068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc000668d0 0x7fdc00068d90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fdc0401afb0 tx=0x7fdc040a7070 comp rx=0 tx=0).stop 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 msgr2=0x7fdc1413f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1413f270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c00b3f0 tx=0x7fdc0c00b8b0 comp rx=0 tx=0).stop 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 shutdown_connections 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fdc1414b2f0 0x7fdc1415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fdc000668d0 0x7fdc00068d90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdc1414af10 0x7fdc14142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:20.872 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 --2- 172.21.15.16:0/1382183281 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fdc140714b0 0x7fdc1413f270 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:20.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.865+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 >> 172.21.15.16:0/1382183281 conn(0x7fdc140b0ca0 msgr2=0x7fdc140cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:20.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.869+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 shutdown_connections 2023-11-29T03:15:20.873 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:20.869+0000 7fdc1af1e640 1 -- 172.21.15.16:0/1382183281 wait complete. 2023-11-29T03:15:20.918 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-29T03:15:21.800 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.797+0000 7f55898bb640 1 Processor -- start 2023-11-29T03:15:21.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.797+0000 7f55898bb640 1 -- start start 2023-11-29T03:15:21.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.809+0000 7f55898bb640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f558415d480 0x7f55840cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.809+0000 7f55898bb640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55840b3250 con 0x7f55840ce3b0 2023-11-29T03:15:21.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.809+0000 7f55898bb640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55840ce8f0 con 0x7f55840d3920 2023-11-29T03:15:21.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.809+0000 7f55898bb640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840cebd0 con 0x7f558415d480 2023-11-29T03:15:21.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55888b9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f558415d480 0x7f55840cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:21.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f5583fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f55840ce3b0 0x7f55840d3210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:54100/0 (socket says 172.21.15.16:54100) 2023-11-29T03:15:21.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f5583fff640 1 -- 172.21.15.16:0/373818627 learned_addr learned my addr 172.21.15.16:0/373818627 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:21.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 133543425 0 0) 0x7f55840b3250 con 0x7f55840ce3b0 2023-11-29T03:15:21.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f556c003530 con 0x7f55840ce3b0 2023-11-29T03:15:21.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 <== mon.0 v1:172.21.15.16:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3611062149 0 0) 0x7f556c003530 con 0x7f55840ce3b0 2023-11-29T03:15:21.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 >> v2:172.21.15.16:3300/0 conn(0x7f558415d480 msgr2=0x7f55840cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:21.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 --2- 172.21.15.16:0/373818627 >> v2:172.21.15.16:3300/0 conn(0x7f558415d480 0x7f55840cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:21.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 >> v1:172.21.15.64:6789/0 conn(0x7f55840d3920 legacy=0x7f55840b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:21.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 --> v1:172.21.15.16:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840ceeb0 con 0x7f55840ce3b0 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 <== mon.0 v1:172.21.15.16:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2024108244 0 0) 0x7f557c001a00 con 0x7f55840ce3b0 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 >> v1:172.21.15.16:6789/0 conn(0x7f55840ce3b0 legacy=0x7f55840d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f556c003a40 0x7f556c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f556c0047d0 0x7f556c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0053e0 0x7f556c014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840cebd0 con 0x7f556c003a40 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556c014b00 con 0x7f556c0053e0 2023-11-29T03:15:21.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.813+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556c014cc0 con 0x7f556c0047d0 2023-11-29T03:15:21.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.817+0000 7f5583fff640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f556c0047d0 0x7f556c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:21.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.817+0000 7f5583fff640 1 -- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0053e0 msgr2=0x7f556c014220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T03:15:21.821 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.817+0000 7f5583fff640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0053e0 0x7f556c014220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:21.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.817+0000 7f5583fff640 1 -- 172.21.15.16:0/373818627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f556c003a40 msgr2=0x7f556c003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T03:15:21.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.817+0000 7f5583fff640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f556c003a40 0x7f556c003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:21.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.817+0000 7f5583fff640 1 -- 172.21.15.16:0/373818627 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556c003530 con 0x7f556c0047d0 2023-11-29T03:15:21.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.821+0000 7f55890ba640 1 -- 172.21.15.16:0/373818627 reap_dead start 2023-11-29T03:15:21.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.825+0000 7f5583fff640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f556c0047d0 0x7f556c004c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f557c00a780 tx=0x7f557c01d240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65742f79c7e295ee server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:21.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.833+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0ad630 con 0x7f556c0047d0 2023-11-29T03:15:21.835 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.833+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c0a8070 con 0x7f556c0047d0 2023-11-29T03:15:21.836 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.833+0000 7f55837fe640 1 -- 172.21.15.16:0/373818627 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c0ada90 con 0x7f556c0047d0 2023-11-29T03:15:21.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.833+0000 7f55898bb640 1 -- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f556c0047d0 msgr2=0x7f556c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:21.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.833+0000 7f55898bb640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f556c0047d0 0x7f556c004c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f557c00a780 tx=0x7f557c01d240 comp rx=0 tx=0).stop 2023-11-29T03:15:21.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.837+0000 7f55898bb640 1 -- 172.21.15.16:0/373818627 shutdown_connections 2023-11-29T03:15:21.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.837+0000 7f55898bb640 1 --2- 172.21.15.16:0/373818627 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f556c0047d0 0x7f556c004c50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:21.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.837+0000 7f55898bb640 1 -- 172.21.15.16:0/373818627 >> 172.21.15.16:0/373818627 conn(0x7f558408cc90 msgr2=0x7f558409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:21.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.837+0000 7f55898bb640 1 -- 172.21.15.16:0/373818627 shutdown_connections 2023-11-29T03:15:21.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.837+0000 7f55898bb640 1 -- 172.21.15.16:0/373818627 wait complete. 2023-11-29T03:15:21.848 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.841+0000 7f55898bb640 1 Processor -- start 2023-11-29T03:15:21.854 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.849+0000 7f55898bb640 1 -- start start 2023-11-29T03:15:21.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.857+0000 7f55898bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 0x7f55840b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.861+0000 7f55888b9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 0x7f55840b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:21.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.861+0000 7f55888b9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 0x7f55840b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:34736/0 (socket says 172.21.15.16:34736) 2023-11-29T03:15:21.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.861+0000 7f55888b9640 1 -- 172.21.15.16:0/2880279427 learned_addr learned my addr 172.21.15.16:0/2880279427 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:21.866 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.861+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55840b6810 0x7f558415fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.865+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55840b6c90 0x7f55841603e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.867 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.865+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558415ee00 con 0x7f55840b6c90 2023-11-29T03:15:21.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.865+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558415f0e0 con 0x7f556c0047d0 2023-11-29T03:15:21.868 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.865+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558415f3c0 con 0x7f55840b6810 2023-11-29T03:15:21.876 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.873+0000 7f55890ba640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55840b6c90 0x7f55841603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:21.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.873+0000 7f5583fff640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55840b6810 0x7f558415fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.877+0000 7f55890ba640 1 -- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55840b6810 msgr2=0x7f558415fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.877+0000 7f55890ba640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55840b6810 0x7f558415fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:21.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.877+0000 7f55890ba640 1 -- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 msgr2=0x7f55840b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.877+0000 7f55890ba640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 0x7f55840b87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.877+0000 7f55890ba640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558415f6a0 con 0x7f55840b6c90 2023-11-29T03:15:21.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.877+0000 7f55890ba640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55840b6c90 0x7f55841603e0 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 crypto rx=0x7f55840d2db0 tx=0x7f557800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:21.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.881+0000 7f55888b9640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 0x7f55840b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:21.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.881+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780074e0 con 0x7f55840b6c90 2023-11-29T03:15:21.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.889+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5578007640 con 0x7f55840b6c90 2023-11-29T03:15:21.895 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.889+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780049c0 con 0x7f55840b6c90 2023-11-29T03:15:21.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.893+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558415f980 con 0x7f55840b6c90 2023-11-29T03:15:21.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.893+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5584160920 con 0x7f55840b6c90 2023-11-29T03:15:21.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.897+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558404e890 con 0x7f55840b6c90 2023-11-29T03:15:21.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.917+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5578004b20 con 0x7f55840b6c90 2023-11-29T03:15:21.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.921+0000 7f55817fa640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5570066900 0x7f5570068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:21.928 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.921+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5578083890 con 0x7f55840b6c90 2023-11-29T03:15:21.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.929+0000 7f55888b9640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5570066900 0x7f5570068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:21.933 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.929+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5578050db0 con 0x7f55840b6c90 2023-11-29T03:15:21.934 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:21.929+0000 7f55888b9640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5570066900 0x7f5570068dc0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f55840b5e50 tx=0x7f5574008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:22.428 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.425+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f55840b44f0 con 0x7f55840b6c90 2023-11-29T03:15:22.498 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.489+0000 7f55817fa640 1 -- 172.21.15.16:0/2880279427 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f55780543d0 con 0x7f55840b6c90 2023-11-29T03:15:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5570066900 msgr2=0x7f5570068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:22.510 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5570066900 0x7f5570068dc0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f55840b5e50 tx=0x7f5574008040 comp rx=0 tx=0).stop 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55840b6c90 msgr2=0x7f55841603e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55840b6c90 0x7f55841603e0 secure :-1 s=READY pgs=3291 cs=0 l=1 rev1=1 crypto rx=0x7f55840d2db0 tx=0x7f557800c820 comp rx=0 tx=0).stop 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 shutdown_connections 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f55840b6c90 0x7f55841603e0 unknown :-1 s=CLOSED pgs=3291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f55840b6810 0x7f558415fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5570066900 0x7f5570068dc0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 --2- 172.21.15.16:0/2880279427 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f556c0047d0 0x7f55840b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 >> 172.21.15.16:0/2880279427 conn(0x7f558408cc90 msgr2=0x7f5584071140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:22.511 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.505+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 shutdown_connections 2023-11-29T03:15:22.522 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:22.513+0000 7f55898bb640 1 -- 172.21.15.16:0/2880279427 wait complete. 2023-11-29T03:15:22.608 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-11-29T03:15:23.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.045+0000 7fa2de30f640 1 Processor -- start 2023-11-29T03:15:23.047 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.045+0000 7fa2de30f640 1 -- start start 2023-11-29T03:15:23.053 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.049+0000 7fa2de30f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d80b3840 0x7fa2d80cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:23.058 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2de30f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa2d80cf7d0 0x7fa2d815db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:23.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2d77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa2d80cf7d0 0x7fa2d815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:23.060 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2d77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa2d80cf7d0 0x7fa2d815db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:34744/0 (socket says 172.21.15.16:34744) 2023-11-29T03:15:23.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2de30f640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d80cfc30 con 0x7fa2d815e0b0 2023-11-29T03:15:23.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2de30f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d815e8e0 con 0x7fa2d80cf7d0 2023-11-29T03:15:23.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2de30f640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80b3c20 con 0x7fa2d80b3840 2023-11-29T03:15:23.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.057+0000 7fa2dc8ac640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa2d815e0b0 0x7fa2d8160f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:54110/0 (socket says 172.21.15.16:54110) 2023-11-29T03:15:23.063 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.061+0000 7fa2dc8ac640 1 -- 172.21.15.16:0/727245996 learned_addr learned my addr 172.21.15.16:0/727245996 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:23.069 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.061+0000 7fa2d7fff640 1 --2- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d80b3840 0x7fa2d80cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:23.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.065+0000 7fa2d77fe640 1 -- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d80b3840 msgr2=0x7fa2d80cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:23.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.065+0000 7fa2d77fe640 1 --2- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d80b3840 0x7fa2d80cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:23.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.065+0000 7fa2d77fe640 1 -- 172.21.15.16:0/727245996 >> v1:172.21.15.16:6789/0 conn(0x7fa2d815e0b0 legacy=0x7fa2d8160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:23.070 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.065+0000 7fa2d77fe640 1 -- 172.21.15.16:0/727245996 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d80b2ed0 con 0x7fa2d80cf7d0 2023-11-29T03:15:23.088 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.085+0000 7fa2d77fe640 1 --2- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d815db70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0097c0 tx=0x7fa2cc01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76d5addc31bdd961 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:23.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.089+0000 7fa2d6ffd640 1 -- 172.21.15.16:0/727245996 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0ab600 con 0x7fa2d80cf7d0 2023-11-29T03:15:23.091 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.089+0000 7fa2d6ffd640 1 -- 172.21.15.16:0/727245996 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2cc0a7050 con 0x7fa2d80cf7d0 2023-11-29T03:15:23.092 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.089+0000 7fa2d6ffd640 1 -- 172.21.15.16:0/727245996 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc0ab980 con 0x7fa2d80cf7d0 2023-11-29T03:15:23.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.089+0000 7fa2de30f640 1 -- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80cf7d0 msgr2=0x7fa2d815db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:23.094 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.089+0000 7fa2de30f640 1 --2- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d815db70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0097c0 tx=0x7fa2cc01c490 comp rx=0 tx=0).stop 2023-11-29T03:15:23.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.101+0000 7fa2de30f640 1 -- 172.21.15.16:0/727245996 shutdown_connections 2023-11-29T03:15:23.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.101+0000 7fa2de30f640 1 --2- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d815db70 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:23.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.101+0000 7fa2de30f640 1 --2- 172.21.15.16:0/727245996 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d80b3840 0x7fa2d80cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:23.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.101+0000 7fa2de30f640 1 -- 172.21.15.16:0/727245996 >> 172.21.15.16:0/727245996 conn(0x7fa2d806a5a0 msgr2=0x7fa2d806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:23.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.105+0000 7fa2de30f640 1 -- 172.21.15.16:0/727245996 shutdown_connections 2023-11-29T03:15:23.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.105+0000 7fa2de30f640 1 -- 172.21.15.16:0/727245996 wait complete. 2023-11-29T03:15:23.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.113+0000 7fa2de30f640 1 Processor -- start 2023-11-29T03:15:23.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.113+0000 7fa2de30f640 1 -- start start 2023-11-29T03:15:23.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.121+0000 7fa2de30f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 0x7fa2d8139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:23.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2de30f640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d8138e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:23.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 0x7fa2d8139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:23.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2d7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 0x7fa2d8139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:34750/0 (socket says 172.21.15.16:34750) 2023-11-29T03:15:23.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d8138e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:23.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2d77fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d8138e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:37790/0 (socket says 172.21.15.16:37790) 2023-11-29T03:15:23.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2de30f640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d815e0b0 0x7fa2d815f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:23.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2d77fe640 1 -- 172.21.15.16:0/1264859091 learned_addr learned my addr 172.21.15.16:0/1264859091 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:23.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d80aea70 con 0x7fa2d80cf7d0 2023-11-29T03:15:23.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8139380 con 0x7fa2d80b3840 2023-11-29T03:15:23.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.125+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d8145d70 con 0x7fa2d815e0b0 2023-11-29T03:15:23.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2dc8ac640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d815e0b0 0x7fa2d815f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:23.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2d7fff640 1 -- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d815e0b0 msgr2=0x7fa2d815f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:23.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2d7fff640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d815e0b0 0x7fa2d815f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:23.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2d7fff640 1 -- 172.21.15.16:0/1264859091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2d80cf7d0 msgr2=0x7fa2d8138e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:23.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2d7fff640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d8138e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:23.132 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2d7fff640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc009420 con 0x7fa2d80b3840 2023-11-29T03:15:23.133 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.129+0000 7fa2d7fff640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 0x7fa2d8139590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800d5d0 tx=0x7fa2c800da90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:23.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.137+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c80125f0 con 0x7fa2d80b3840 2023-11-29T03:15:23.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.137+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8012750 con 0x7fa2d80b3840 2023-11-29T03:15:23.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.137+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8012ae0 con 0x7fa2d80b3840 2023-11-29T03:15:23.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.141+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d8146050 con 0x7fa2d80b3840 2023-11-29T03:15:23.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.141+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d8146610 con 0x7fa2d80b3840 2023-11-29T03:15:23.158 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.153+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d80aebb0 con 0x7fa2d80b3840 2023-11-29T03:15:23.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.153+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa2c8012c40 con 0x7fa2d80b3840 2023-11-29T03:15:23.185 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.181+0000 7fa2d4ff9640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa2c4066920 0x7fa2c4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:23.186 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.181+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa2c8084460 con 0x7fa2d80b3840 2023-11-29T03:15:23.190 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.185+0000 7fa2d77fe640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa2c4066920 0x7fa2c4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:23.198 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.193+0000 7fa2d77fe640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa2c4066920 0x7fa2c4068de0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0097c0 tx=0x7fa2cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:23.214 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:23.209+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa2c8051a30 con 0x7fa2d80b3840 2023-11-29T03:15:24.131 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.125+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fa2d804e890 con 0x7fa2d80b3840 2023-11-29T03:15:24.514 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.509+0000 7fa2d4ff9640 1 -- 172.21.15.16:0/1264859091 <== mon.1 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v17353) v1 ==== 144+0+0 (secure 0 0 0) 0x7fa2c8055050 con 0x7fa2d80b3840 2023-11-29T03:15:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.537+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa2c4066920 msgr2=0x7fa2c4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.541+0000 7fa2de30f640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa2c4066920 0x7fa2c4068de0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc0097c0 tx=0x7fa2cc0a6000 comp rx=0 tx=0).stop 2023-11-29T03:15:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.541+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 msgr2=0x7fa2d8139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:24.544 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.541+0000 7fa2de30f640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 0x7fa2d8139590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa2c800d5d0 tx=0x7fa2c800da90 comp rx=0 tx=0).stop 2023-11-29T03:15:24.545 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.541+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 shutdown_connections 2023-11-29T03:15:24.546 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.541+0000 7fa2de30f640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa2d815e0b0 0x7fa2d815f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:24.550 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.541+0000 7fa2de30f640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa2d80cf7d0 0x7fa2d8138e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.545+0000 7fa2de30f640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa2c4066920 0x7fa2c4068de0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.545+0000 7fa2de30f640 1 --2- 172.21.15.16:0/1264859091 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa2d80b3840 0x7fa2d8139590 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:24.552 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.545+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 >> 172.21.15.16:0/1264859091 conn(0x7fa2d806a5a0 msgr2=0x7fa2d806a980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.549+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 shutdown_connections 2023-11-29T03:15:24.556 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:24.549+0000 7fa2de30f640 1 -- 172.21.15.16:0/1264859091 wait complete. 2023-11-29T03:15:24.722 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-11-29T03:15:24.723 INFO:tasks.cephfs_test_runner: 2023-11-29T03:15:24.723 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-29T03:15:24.723 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-29T03:15:24.724 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner: 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner:Ran 1 test in 34522.029s 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner: 2023-11-29T03:15:24.725 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner: 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-11-29T03:15:24.726 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-11-29T03:15:24.727 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-11-29T03:15:24.727 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-11-29T03:15:24.727 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-11-29T03:15:24.727 INFO:tasks.cephfs_test_runner:AssertionError: 1 != 0 2023-11-29T03:15:24.727 INFO:tasks.cephfs_test_runner: 2023-11-29T03:15:24.728 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T03:15:24.889 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=1e505c41250949faa9497e2a782da9bd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-11-29T03:15:24.891 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-29T03:15:24.900 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-29T03:15:24.918 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-29T03:15:24.919 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-29T03:15:24.919 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:24.988 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=855 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T03:15:24.988 DEBUG:teuthology.orchestra.run.smithi016:> set -ex 2023-11-29T03:15:24.988 DEBUG:teuthology.orchestra.run.smithi016:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:25.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357768k,nr_inodes=4089442,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=855 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276000k,nr_inodes=819000,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-11-29T03:15:25.148 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-29T03:15:25.148 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:25.158 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354692k,nr_inodes=4088673,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T03:15:25.158 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-11-29T03:15:25.158 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-29T03:15:25.212 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354692k,nr_inodes=4088673,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3171 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275388k,nr_inodes=818847,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275388k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-11-29T03:15:25.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:25.213 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-29T03:15:25.370 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-29T03:15:25.370 INFO:teuthology.orchestra.run.smithi016.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-29T03:15:25.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:25.371 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-29T03:15:25.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:25.644 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-29T03:15:25.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:25.894 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-11-29T03:15:26.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.292 DEBUG:teuthology.orchestra.run.smithi016:> ip netns list 2023-11-29T03:15:26.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.330 DEBUG:teuthology.orchestra.run.smithi016:> sudo ip link delete ceph-brx 2023-11-29T03:15:26.656 INFO:teuthology.orchestra.run.smithi016.stderr:Cannot find device "ceph-brx" 2023-11-29T03:15:26.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T03:15:26.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.662 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-11-29T03:15:26.672 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-29T03:15:26.673 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-29T03:15:26.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-29T03:15:26.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.736 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-29T03:15:26.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.832 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-11-29T03:15:26.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:26.993 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-11-29T03:15:27.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-29T03:15:27.004 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-11-29T03:15:27.991 INFO:teuthology.orchestra.run.smithi064.stderr:Cannot find device "ceph-brx" 2023-11-29T03:15:27.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T03:15:27.995 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-29T03:15:28.005 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-29T03:15:28.005 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T03:15:28.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.717+0000 7fb64fa32640 1 Processor -- start 2023-11-29T03:15:28.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.721+0000 7fb64fa32640 1 -- start start 2023-11-29T03:15:28.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.737+0000 7fb64fa32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb640007110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:28.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.737+0000 7fb64fa32640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb640038790 0x7fb6400e2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:28.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.737+0000 7fb64fa32640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb640006c80 con 0x7fb640007650 2023-11-29T03:15:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.737+0000 7fb64fa32640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6400df510 con 0x7fb640038790 2023-11-29T03:15:28.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.737+0000 7fb64fa32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb640006090 con 0x7fb6400df130 2023-11-29T03:15:28.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb640007110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:28.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb640007110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:36422/0 (socket says 172.21.15.16:36422) 2023-11-29T03:15:28.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 -- 172.21.15.16:0/1135558259 learned_addr learned my addr 172.21.15.16:0/1135558259 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:28.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64d7ce640 1 --2- 172.21.15.16:0/1135558259 >> v2:172.21.15.64:3300/0 conn(0x7fb640038790 0x7fb6400e2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:28.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 -- 172.21.15.16:0/1135558259 >> v2:172.21.15.64:3300/0 conn(0x7fb640038790 msgr2=0x7fb6400e2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:28.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 --2- 172.21.15.16:0/1135558259 >> v2:172.21.15.64:3300/0 conn(0x7fb640038790 0x7fb6400e2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:28.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 -- 172.21.15.16:0/1135558259 >> v1:172.21.15.64:6789/0 conn(0x7fb640007650 legacy=0x7fb640038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:28.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.745+0000 7fb64cfcd640 1 -- 172.21.15.16:0/1135558259 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb640006350 con 0x7fb6400df130 2023-11-29T03:15:28.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.793+0000 7fb64cfcd640 1 --2- 172.21.15.16:0/1135558259 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb640007110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb63800f9b0 tx=0x7fb63801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55eb37c433890b08 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:28.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.793+0000 7fb63ffff640 1 -- 172.21.15.16:0/1135558259 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380a9610 con 0x7fb6400df130 2023-11-29T03:15:28.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.793+0000 7fb63ffff640 1 -- 172.21.15.16:0/1135558259 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6380a9770 con 0x7fb6400df130 2023-11-29T03:15:28.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.793+0000 7fb63ffff640 1 -- 172.21.15.16:0/1135558259 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380a9b00 con 0x7fb6400df130 2023-11-29T03:15:28.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.805+0000 7fb64fa32640 1 -- 172.21.15.16:0/1135558259 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 msgr2=0x7fb640007110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.805+0000 7fb64fa32640 1 --2- 172.21.15.16:0/1135558259 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb640007110 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb63800f9b0 tx=0x7fb63801c440 comp rx=0 tx=0).stop 2023-11-29T03:15:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.805+0000 7fb64fa32640 1 -- 172.21.15.16:0/1135558259 shutdown_connections 2023-11-29T03:15:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.805+0000 7fb64fa32640 1 --2- 172.21.15.16:0/1135558259 >> v2:172.21.15.64:3300/0 conn(0x7fb640038790 0x7fb6400e2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.805+0000 7fb64fa32640 1 --2- 172.21.15.16:0/1135558259 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb640007110 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:28.811 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.805+0000 7fb64fa32640 1 -- 172.21.15.16:0/1135558259 >> 172.21.15.16:0/1135558259 conn(0x7fb640054c70 msgr2=0x7fb640055080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.809+0000 7fb64fa32640 1 -- 172.21.15.16:0/1135558259 shutdown_connections 2023-11-29T03:15:28.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.809+0000 7fb64fa32640 1 -- 172.21.15.16:0/1135558259 wait complete. 2023-11-29T03:15:28.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.813+0000 7fb64fa32640 1 Processor -- start 2023-11-29T03:15:28.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.817+0000 7fb64fa32640 1 -- start start 2023-11-29T03:15:28.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64fa32640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb640007650 0x7fb6400e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:28.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64fa32640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 0x7fb640034f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:28.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64fa32640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb6400d50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:28.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64fa32640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400e25f0 con 0x7fb640007650 2023-11-29T03:15:28.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64fa32640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb640035450 con 0x7fb640038790 2023-11-29T03:15:28.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64fa32640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6400e1d50 con 0x7fb6400df130 2023-11-29T03:15:28.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.821+0000 7fb64e7d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 0x7fb640034f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:28.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 0x7fb640034f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:37002/0 (socket says 172.21.15.16:37002) 2023-11-29T03:15:28.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 -- 172.21.15.16:0/2974048779 learned_addr learned my addr 172.21.15.16:0/2974048779 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:28.828 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64cfcd640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb640007650 0x7fb6400e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:28.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 -- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 msgr2=0x7fb6400d50e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T03:15:28.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb6400d50e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:28.829 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 -- 172.21.15.16:0/2974048779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb640007650 msgr2=0x7fb6400e16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:28.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb640007650 0x7fb6400e16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:28.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 -- 172.21.15.16:0/2974048779 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63800f610 con 0x7fb640038790 2023-11-29T03:15:28.830 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.825+0000 7fb64e7d0640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 0x7fb640034f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c500 tx=0x7fb64400c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:28.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.837+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644005220 con 0x7fb640038790 2023-11-29T03:15:28.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.837+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644005380 con 0x7fb640038790 2023-11-29T03:15:28.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.837+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644007230 con 0x7fb640038790 2023-11-29T03:15:28.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.837+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6400e2030 con 0x7fb640038790 2023-11-29T03:15:28.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.837+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6400d59d0 con 0x7fb640038790 2023-11-29T03:15:28.847 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.845+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb628005260 con 0x7fb640038790 2023-11-29T03:15:28.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.861+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fb644007390 con 0x7fb640038790 2023-11-29T03:15:28.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.861+0000 7fb63dffb640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb62c0668d0 0x7fb62c068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:28.870 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.865+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb644083890 con 0x7fb640038790 2023-11-29T03:15:28.874 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.873+0000 7fb64cfcd640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb62c0668d0 0x7fb62c068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:28.875 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.873+0000 7fb64cfcd640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb62c0668d0 0x7fb62c068d90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb6380ae000 tx=0x7fb6380a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:28.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:28.881+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb644050e20 con 0x7fb640038790 2023-11-29T03:15:30.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.761+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb628000bd0 con 0x7fb62c0668d0 2023-11-29T03:15:30.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.881+0000 7fb63dffb640 1 -- 172.21.15.16:0/2974048779 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49386 (secure 0 0 0) 0x7fb628000bd0 con 0x7fb62c0668d0 2023-11-29T03:15:30.896 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:30.897 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-29T03:15:30.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.901+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb62c0668d0 msgr2=0x7fb62c068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:30.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.901+0000 7fb64fa32640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb62c0668d0 0x7fb62c068d90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb6380ae000 tx=0x7fb6380a7000 comp rx=0 tx=0).stop 2023-11-29T03:15:30.907 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.905+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 msgr2=0x7fb640034f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:30.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.905+0000 7fb64fa32640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 0x7fb640034f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c500 tx=0x7fb64400c9c0 comp rx=0 tx=0).stop 2023-11-29T03:15:30.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 shutdown_connections 2023-11-29T03:15:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fb6400df130 0x7fb6400d50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fb62c0668d0 0x7fb62c068d90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:30.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb640038790 0x7fb640034f10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:30.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 --2- 172.21.15.16:0/2974048779 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fb640007650 0x7fb6400e16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:30.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 >> 172.21.15.16:0/2974048779 conn(0x7fb640054c70 msgr2=0x7fb6400d7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:30.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 shutdown_connections 2023-11-29T03:15:30.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:30.913+0000 7fb64fa32640 1 -- 172.21.15.16:0/2974048779 wait complete. 2023-11-29T03:15:31.025 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":17308,"stamp":"2023-11-29T03:15:30.741760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":31936588,"kb_used_data":19350480,"kb_used_omap":36860,"kb_used_meta":12384259,"kb_avail":723038132,"statfs":{"total":773094113280,"available":740391047168,"internally_reserved":0,"allocated":19814891520,"data_stored":19806384799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37745340,"internal_metadata":12681481540},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1379,"apply_latency_ms":1379,"commit_latency_ns":1379000000,"apply_latency_ns":1379000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-32947570411,"num_objects":-22809,"num_object_clones":0,"num_object_copies":-45618,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22809,"num_whiteouts":0,"num_read":-1495671,"num_read_kb":-416245134,"num_write":-2124476,"num_write_kb":-579188975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.006130"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":521,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-29T03:15:18.960057+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-29T03:15:18.960057+0000","last_peered":"2023-11-29T03:15:18.960057+0000","last_clean":"2023-11-29T03:15:18.960057+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-29T03:15:18.960057+0000","last_undegraded":"2023-11-29T03:15:18.960057+0000","last_fullsized":"2023-11-29T03:15:18.960057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516342,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2979348,"kb_used_data":1567740,"kb_used_omap":5738,"kb_used_meta":1347477,"kb_avail":91392492,"statfs":{"total":96636764160,"available":93585911808,"internally_reserved":0,"allocated":1605365760,"data_stored":1604504970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5876368,"internal_metadata":1379816816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":193,"apply_latency_ms":193,"commit_latency_ns":193000000,"apply_latency_ns":193000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.2669999999999999,"15min":1.248},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":6.3360000000000003,"5min":6.3360000000000003,"15min":6.665},"last":3.9500000000000002},{"interface":"front","average":{"1min":1.831,"5min":1.4019999999999999,"15min":1.4359999999999999},"min":{"1min":0.48399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":5.1829999999999998,"5min":5.1829999999999998,"15min":8.4800000000000004},"last":4.1539999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3779999999999999,"15min":1.4890000000000001},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.6069999999999993},"last":4.3319999999999999},{"interface":"front","average":{"1min":1.794,"5min":1.4690000000000001,"15min":1.4379999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":8.6630000000000003},"last":6.7770000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.6950000000000001,"15min":1.502},"min":{"1min":0.50700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":3.9409999999999998,"5min":8.1790000000000003,"15min":11.333},"last":13.279},{"interface":"front","average":{"1min":2.278,"5min":1.8220000000000001,"15min":1.6339999999999999},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":12.827,"5min":12.827,"15min":12.827},"last":13.237}]},{"osd":3,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":3.2749999999999999,"5min":1.9219999999999999,"15min":1.6799999999999999},"min":{"1min":0.67200000000000004,"5min":0.44600000000000001,"15min":0.439},"max":{"1min":25.420000000000002,"5min":25.420000000000002,"15min":25.420000000000002},"last":6.9889999999999999},{"interface":"front","average":{"1min":2.988,"5min":1.9139999999999999,"15min":1.7130000000000001},"min":{"1min":0.78200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":26.690000000000001,"5min":26.690000000000001,"15min":26.690000000000001},"last":6.1959999999999997}]},{"osd":4,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.83299999999999996,"15min":0.747},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":11.890000000000001,"5min":11.890000000000001,"15min":11.890000000000001},"last":7.3970000000000002},{"interface":"front","average":{"1min":2.3860000000000001,"5min":1.1379999999999999,"15min":0.878},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":32.695,"5min":32.695,"15min":32.695},"last":6.2450000000000001}]},{"osd":5,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":0.89700000000000002},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35999999999999999},"max":{"1min":1.909,"5min":3.637,"15min":6.8789999999999996},"last":6.3049999999999997},{"interface":"front","average":{"1min":1.109,"5min":0.97499999999999998,"15min":0.89900000000000002},"min":{"1min":0.502,"5min":0.45600000000000002,"15min":0.44500000000000001},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.8049999999999997},"last":7.194}]},{"osd":7,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.3250000000000002,"5min":4.6639999999999997,"15min":4.7270000000000003},"last":13.180999999999999},{"interface":"front","average":{"1min":1.117,"5min":0.95399999999999996,"15min":0.89700000000000002},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":5.4480000000000004}]}]},{"osd":5,"up_from":15,"seq":64424516345,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1436692,"kb_used_data":151372,"kb_used_omap":3640,"kb_used_meta":1281671,"kb_avail":92935148,"statfs":{"total":96636764160,"available":95165591552,"internally_reserved":0,"allocated":155004928,"data_stored":154688233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3727398,"internal_metadata":1312432090},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":111,"apply_latency_ms":111,"commit_latency_ns":111000000,"apply_latency_ns":111000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.413,"15min":1.3280000000000001},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":3.9180000000000001,"5min":12.811999999999999,"15min":12.811999999999999},"last":1.323},{"interface":"front","average":{"1min":1.742,"5min":1.3859999999999999,"15min":1.407},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35499999999999998},"max":{"1min":5.3259999999999996,"5min":7.3369999999999997,"15min":7.3369999999999997},"last":2.4649999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.641,"15min":1.55},"min":{"1min":0.60199999999999998,"5min":0.41799999999999998,"15min":0.37},"max":{"1min":11.077,"5min":11.077,"15min":11.077},"last":2.085},{"interface":"front","average":{"1min":2.073,"5min":1.554,"15min":1.4319999999999999},"min":{"1min":0.61599999999999999,"5min":0.38,"15min":0.38},"max":{"1min":8.2520000000000007,"5min":8.9410000000000007,"15min":8.9410000000000007},"last":1.6599999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":1.9119999999999999,"15min":1.6259999999999999},"min":{"1min":0.63100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.6790000000000003,"5min":12.478,"15min":12.478},"last":2.9609999999999999},{"interface":"front","average":{"1min":2.335,"5min":1.8819999999999999,"15min":1.776},"min":{"1min":0.66800000000000004,"5min":0.502,"15min":0.43099999999999999},"max":{"1min":8.7309999999999999,"5min":8.7309999999999999,"15min":8.7309999999999999},"last":13.722}]},{"osd":3,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.9299999999999999,"15min":1.7290000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"max":{"1min":7.3659999999999997,"5min":7.3659999999999997,"15min":7.3659999999999997},"last":2.3359999999999999},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.8859999999999999,"15min":1.7090000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55500000000000005},"max":{"1min":6.157,"5min":6.742,"15min":7.1379999999999999},"last":2.4430000000000001}]},{"osd":4,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.78200000000000003},"min":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.29799999999999999},"max":{"1min":2.581,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":1.708},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":0.84899999999999998},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":4.1500000000000004,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":1.8100000000000001}]},{"osd":6,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.86799999999999999,"15min":0.87},"min":{"1min":0.504,"5min":0.40200000000000002,"15min":0.34000000000000002},"max":{"1min":6.0129999999999999,"5min":6.0129999999999999,"15min":6.0129999999999999},"last":2.1320000000000001},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.88600000000000001,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.39100000000000001},"max":{"1min":2.54,"5min":7.8019999999999996,"15min":7.8019999999999996},"last":1.266}]},{"osd":7,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.93600000000000005,"15min":0.91100000000000003},"min":{"1min":0.47199999999999998,"5min":0.38,"15min":0.371},"max":{"1min":7.0780000000000003,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":1.7649999999999999},{"interface":"front","average":{"1min":1.115,"5min":0.98099999999999998,"15min":0.97099999999999997},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":2.4860000000000002}]}]},{"osd":4,"up_from":15,"seq":64424516340,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1876628,"kb_used_data":190412,"kb_used_omap":5001,"kb_used_meta":1681206,"kb_avail":92495212,"statfs":{"total":96636764160,"available":94715097088,"internally_reserved":0,"allocated":194981888,"data_stored":194638733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5121709,"internal_metadata":1721555283},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":207,"apply_latency_ms":207,"commit_latency_ns":207000000,"apply_latency_ns":207000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.2949999999999999,"15min":1.359},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":5.96,"5min":6.3280000000000003,"15min":12.282},"last":1.5389999999999999},{"interface":"front","average":{"1min":2.3100000000000001,"5min":1.665,"15min":1.5820000000000001},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":21.513000000000002,"5min":21.513000000000002,"15min":21.513000000000002},"last":11.977}]},{"osd":1,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.637,"15min":1.6850000000000001},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.46300000000000002},"max":{"1min":7.3650000000000002,"5min":7.3650000000000002,"15min":9.1530000000000005},"last":1.4770000000000001},{"interface":"front","average":{"1min":2.3980000000000001,"5min":1.675,"15min":1.7330000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.4059999999999997,"5min":7.4059999999999997,"15min":9.1859999999999999},"last":1.5169999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.351,"15min":1.5509999999999999},"min":{"1min":0.57799999999999996,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":3.448,"5min":4,"15min":10.791},"last":1.5549999999999999},{"interface":"front","average":{"1min":2.4409999999999998,"5min":1.752,"15min":1.649},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.40799999999999997},"max":{"1min":7.9189999999999996,"5min":7.9189999999999996,"15min":7.9189999999999996},"last":4.4729999999999999}]},{"osd":3,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6359999999999999,"15min":1.575},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":4.6390000000000002,"5min":6.4279999999999999,"15min":8.5470000000000006},"last":6.2770000000000001},{"interface":"front","average":{"1min":1.829,"5min":1.8049999999999999,"15min":1.6830000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":7.2489999999999997,"5min":7.2489999999999997,"15min":8.3309999999999995},"last":12.102}]},{"osd":5,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":7.2229999999999999,"5min":7.2229999999999999,"15min":7.2229999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":4.6799999999999997,"5min":4.6799999999999997,"15min":5.1890000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71999999999999997,"15min":0.77800000000000002},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":3.383,"5min":3.383,"15min":5.6660000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":0.90900000000000003,"15min":0.877},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.39500000000000002},"max":{"1min":7.2759999999999998,"5min":7.2759999999999998,"15min":7.2759999999999998},"last":1.3979999999999999}]},{"osd":7,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.432,"15min":0.376},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":0.98399999999999999,"15min":0.93999999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44400000000000001},"max":{"1min":7.319,"5min":7.319,"15min":7.319},"last":1.3520000000000001}]}]},{"osd":3,"up_from":15,"seq":64424516299,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6057072,"kb_used_data":4277280,"kb_used_omap":6687,"kb_used_meta":1773088,"kb_avail":88314768,"statfs":{"total":96636764160,"available":90434322432,"internally_reserved":0,"allocated":4379934720,"data_stored":4378307260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6847688,"internal_metadata":1815642936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":246,"apply_latency_ms":246,"commit_latency_ns":246000000,"apply_latency_ns":246000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2709999999999999,"5min":2.383,"15min":2.3530000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.41999999999999998},"max":{"1min":4.6719999999999997,"5min":9.8610000000000007,"15min":11.345000000000001},"last":7.569},{"interface":"front","average":{"1min":3.5859999999999999,"5min":2.6539999999999999,"15min":2.4940000000000002},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.31},"max":{"1min":9.6219999999999999,"5min":11.801,"15min":11.801},"last":10.186999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.6760000000000002,"15min":2.645},"min":{"1min":0.76300000000000001,"5min":0.53300000000000003,"15min":0.40100000000000002},"max":{"1min":4.867,"5min":11.289,"15min":11.289},"last":1.1910000000000001},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.931,"15min":2.8090000000000002},"min":{"1min":0.73899999999999999,"5min":0.57099999999999995,"15min":0.48799999999999999},"max":{"1min":5.8179999999999996,"5min":19.702999999999999,"15min":19.702999999999999},"last":2.1219999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.4020000000000001,"5min":3.1059999999999999,"15min":3.0049999999999999},"min":{"1min":0.73199999999999998,"5min":0.71099999999999997,"15min":0.51900000000000002},"max":{"1min":5.5039999999999996,"5min":12.75,"15min":12.75},"last":1.3049999999999999},{"interface":"front","average":{"1min":3.29,"5min":3.0950000000000002,"15min":2.948},"min":{"1min":0.93899999999999995,"5min":0.77900000000000003,"15min":0.46600000000000003},"max":{"1min":14.326000000000001,"5min":14.962,"15min":14.962},"last":2.2469999999999999}]},{"osd":4,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.165,"15min":2.21},"min":{"1min":0.73299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":8.5289999999999999,"5min":8.5289999999999999,"15min":9.1799999999999997},"last":4.5759999999999996},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.4529999999999998,"15min":2.3900000000000001},"min":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.55300000000000005},"max":{"1min":5.1840000000000002,"5min":7.5700000000000003,"15min":8.5679999999999996},"last":2.387}]},{"osd":5,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.5649999999999999,"15min":2.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.60799999999999998},"max":{"1min":5.2949999999999999,"5min":7.6280000000000001,"15min":8.6910000000000007},"last":2.4830000000000001},{"interface":"front","average":{"1min":2.0790000000000002,"5min":2.3420000000000001,"15min":2.3929999999999998},"min":{"1min":0.78700000000000003,"5min":0.624,"15min":0.52100000000000002},"max":{"1min":4.931,"5min":9.6920000000000002,"15min":10.722},"last":7.4459999999999997}]},{"osd":6,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":2.363,"15min":2.3879999999999999},"min":{"1min":0.81999999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":8.6440000000000001,"5min":8.6440000000000001,"15min":9.3770000000000007},"last":8.9209999999999994},{"interface":"front","average":{"1min":2.3610000000000002,"5min":2.694,"15min":2.6539999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.59599999999999997},"max":{"1min":5.4029999999999996,"5min":7.9139999999999997,"15min":8.7949999999999999},"last":10.250999999999999}]},{"osd":7,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2389999999999999,"5min":2.556,"15min":2.569},"min":{"1min":0.79400000000000004,"5min":0.66000000000000003,"15min":0.56000000000000005},"max":{"1min":5.0460000000000003,"5min":10.939,"15min":10.939},"last":21.25},{"interface":"front","average":{"1min":3.3279999999999998,"5min":2.5289999999999999,"15min":2.5609999999999999},"min":{"1min":0.77700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":8.7479999999999993,"5min":8.7479999999999993,"15min":9.5099999999999998},"last":17.382999999999999}]}]},{"osd":2,"up_from":15,"seq":64424516289,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7828248,"kb_used_data":6581584,"kb_used_omap":3496,"kb_used_meta":1243159,"kb_avail":86543592,"statfs":{"total":96636764160,"available":88620638208,"internally_reserved":0,"allocated":6739542016,"data_stored":6737258756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3580142,"internal_metadata":1272995602},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.1339999999999999,"5min":4.2690000000000001,"15min":2.98},"min":{"1min":0.58999999999999997,"5min":0.46200000000000002,"15min":0.309},"max":{"1min":28.393999999999998,"5min":158.864,"15min":158.864},"last":1.5469999999999999},{"interface":"front","average":{"1min":2.3610000000000002,"5min":4.1740000000000004,"15min":3.0990000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.48999999999999999},"max":{"1min":8.3040000000000003,"5min":156.66200000000001,"15min":156.66200000000001},"last":0.95899999999999996}]},{"osd":1,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0569999999999999,"5min":2.6669999999999998,"15min":2.6970000000000001},"min":{"1min":0.57299999999999995,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":12.154,"5min":17.699999999999999,"15min":17.699999999999999},"last":1.716},{"interface":"front","average":{"1min":2.7040000000000002,"5min":2.8610000000000002,"15min":2.706},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":6.8259999999999996,"5min":18.989999999999998,"15min":18.989999999999998},"last":1.8740000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1219999999999999,"5min":2.5590000000000002,"15min":2.5},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.48799999999999999},"max":{"1min":4.3499999999999996,"5min":11.087999999999999,"15min":11.087999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":3.5139999999999998,"5min":2.9169999999999998,"15min":2.887},"min":{"1min":0.67400000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.266,"5min":12.266,"15min":12.792999999999999},"last":2.2330000000000001}]},{"osd":4,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":2.2010000000000001,"15min":2.1899999999999999},"min":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.44500000000000001},"max":{"1min":5.7110000000000003,"5min":7.5780000000000003,"15min":7.5780000000000003},"last":1.4790000000000001},{"interface":"front","average":{"1min":2.04,"5min":2.105,"15min":2.137},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.3730000000000002,"5min":5.9770000000000003,"15min":9.3719999999999999},"last":1.131}]},{"osd":5,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.399,"5min":2.5920000000000001,"15min":2.3439999999999999},"min":{"1min":0.65400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":28.186,"5min":28.186,"15min":28.186},"last":1.214},{"interface":"front","average":{"1min":2.181,"5min":2.3439999999999999,"15min":2.3439999999999999},"min":{"1min":0.65100000000000002,"5min":0.54100000000000004,"15min":0.48299999999999998},"max":{"1min":5.9909999999999997,"5min":7.8209999999999997,"15min":9.5350000000000001},"last":1.6339999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1789999999999998,"5min":2.2599999999999998,"15min":2.343},"min":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.4850000000000003,"5min":6.181,"15min":9.5020000000000007},"last":2.1629999999999998},{"interface":"front","average":{"1min":3.5619999999999998,"5min":2.843,"15min":2.5720000000000001},"min":{"1min":0.83499999999999996,"5min":0.629,"15min":0.48699999999999999},"max":{"1min":28.300999999999998,"5min":28.300999999999998,"15min":28.300999999999998},"last":1.95}]},{"osd":7,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":2.5510000000000002,"15min":2.516},"min":{"1min":1.0369999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.6270000000000007,"5min":8.6270000000000007,"15min":9.3109999999999999},"last":2.089},{"interface":"front","average":{"1min":2.3959999999999999,"5min":2.3799999999999999,"15min":2.4990000000000001},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.5789999999999997,"5min":6.2759999999999998,"15min":9.5790000000000006},"last":2.306}]}]},{"osd":1,"up_from":15,"seq":64424516308,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4241372,"kb_used_data":2495184,"kb_used_omap":3411,"kb_used_meta":1685804,"kb_avail":90130468,"statfs":{"total":96636764160,"available":92293599232,"internally_reserved":0,"allocated":2555068416,"data_stored":2554002463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3493385,"internal_metadata":1726263799},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":177,"apply_latency_ms":177,"commit_latency_ns":177000000,"apply_latency_ns":177000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.5310000000000001,"15min":2.5489999999999999},"min":{"1min":0.52700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":11.449,"5min":11.505000000000001,"15min":14.603999999999999},"last":9.9190000000000005},{"interface":"front","average":{"1min":2.9489999999999998,"5min":2.5529999999999999,"15min":2.5739999999999998},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.41599999999999998},"max":{"1min":6.9420000000000002,"5min":11.196999999999999,"15min":12.343},"last":3.1349999999999998}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.7759999999999998,"15min":2.6499999999999999},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":25.795000000000002,"5min":25.795000000000002,"15min":25.795000000000002},"last":10.65},{"interface":"front","average":{"1min":3.8460000000000001,"5min":2.944,"15min":2.774},"min":{"1min":0.629,"5min":0.56799999999999995,"15min":0.41499999999999998},"max":{"1min":14.885,"5min":14.885,"15min":14.885},"last":2.3860000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2629999999999999,"5min":3.2330000000000001,"15min":3.024},"min":{"1min":0.91000000000000003,"5min":0.57899999999999996,"15min":0.42499999999999999},"max":{"1min":16.693999999999999,"5min":16.693999999999999,"15min":16.722999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":3.5489999999999999,"5min":3.1989999999999998,"15min":3.0270000000000001},"min":{"1min":0.98299999999999998,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":10.692,"5min":10.692,"15min":12.992000000000001},"last":9.1899999999999995}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.6139999999999999,"15min":2.3199999999999998},"min":{"1min":0.66100000000000003,"5min":0.58299999999999996,"15min":0.56799999999999995},"max":{"1min":27.562000000000001,"5min":27.562000000000001,"15min":27.562000000000001},"last":10.766999999999999},{"interface":"front","average":{"1min":2.5649999999999999,"5min":2.3900000000000001,"15min":2.327},"min":{"1min":0.67800000000000005,"5min":0.52000000000000002,"15min":0.505},"max":{"1min":9.8710000000000004,"5min":11.590999999999999,"15min":12.345000000000001},"last":9.7769999999999992}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.492,"5min":2.1720000000000002,"15min":2.3799999999999999},"min":{"1min":0.69699999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":6.758,"5min":6.8280000000000003,"15min":11.984},"last":3.3740000000000001},{"interface":"front","average":{"1min":2.7160000000000002,"5min":2.6059999999999999,"15min":2.46},"min":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.58999999999999997},"max":{"1min":25.920999999999999,"5min":25.920999999999999,"15min":25.920999999999999},"last":10.401}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.637,"5min":2.2599999999999998,"15min":2.5249999999999999},"min":{"1min":0.78500000000000003,"5min":0.65000000000000002,"15min":0.53400000000000003},"max":{"1min":7.1280000000000001,"5min":7.1280000000000001,"15min":12.113},"last":3.093},{"interface":"front","average":{"1min":2.8519999999999999,"5min":2.8620000000000001,"15min":2.6200000000000001},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.55400000000000005},"max":{"1min":26.326000000000001,"5min":26.326000000000001,"15min":26.326000000000001},"last":10.541}]},{"osd":7,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.7709999999999999,"5min":2.4769999999999999,"15min":2.4940000000000002},"min":{"1min":0.72399999999999998,"5min":0.55700000000000005,"15min":0.49199999999999999},"max":{"1min":10.005000000000001,"5min":11.557,"15min":12.457000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":2.7309999999999999,"5min":2.4489999999999998,"15min":2.637},"min":{"1min":1.0189999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.2300000000000004,"5min":7.2300000000000004,"15min":12.210000000000001},"last":3.1960000000000002}]}]},{"osd":0,"up_from":15,"seq":64424516302,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5774436,"kb_used_data":4086460,"kb_used_omap":5919,"kb_used_meta":1632480,"kb_avail":88597404,"statfs":{"total":96636764160,"available":90723741696,"internally_reserved":0,"allocated":4184535040,"data_stored":4182802805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6061868,"internal_metadata":1671659732},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":163,"apply_latency_ms":163,"commit_latency_ns":163000000,"apply_latency_ns":163000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.516,"5min":2.9329999999999998,"15min":2.4460000000000002},"min":{"1min":0.748,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":9.7439999999999998,"5min":15.596,"15min":15.596},"last":5.75},{"interface":"front","average":{"1min":2.6070000000000002,"5min":2.9740000000000002,"15min":2.7069999999999999},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.36699999999999999},"max":{"1min":6.6710000000000003,"5min":12.222,"15min":12.621},"last":2.5190000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.9060000000000001,"15min":3.0459999999999998},"min":{"1min":0.60599999999999998,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":5.085,"5min":12.913,"15min":61.551000000000002},"last":5.6500000000000004},{"interface":"front","average":{"1min":3.3260000000000001,"5min":3.2719999999999998,"15min":3.202},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.434},"max":{"1min":7.0350000000000001,"5min":12.842000000000001,"15min":61.359999999999999},"last":2.774}]},{"osd":3,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.6880000000000002,"15min":2.6280000000000001},"min":{"1min":0.74099999999999999,"5min":0.436,"15min":0.433},"max":{"1min":6.7919999999999998,"5min":12.379,"15min":12.379},"last":9.6880000000000006},{"interface":"front","average":{"1min":2.653,"5min":3.3759999999999999,"15min":3.0510000000000002},"min":{"1min":0.85699999999999998,"5min":0.60899999999999999,"15min":0.54300000000000004},"max":{"1min":9.1210000000000004,"5min":16.524999999999999,"15min":16.524999999999999},"last":12.052}]},{"osd":4,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.6869999999999998,"15min":2.3370000000000002},"min":{"1min":0.58099999999999996,"5min":0.53900000000000003,"15min":0.41199999999999998},"max":{"1min":6.3970000000000002,"5min":12.987,"15min":12.987},"last":11.141},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.4870000000000001,"15min":2.359},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.38400000000000001},"max":{"1min":5.6100000000000003,"5min":13.177,"15min":13.177},"last":10.994}]},{"osd":5,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":2.6179999999999999,"15min":2.4319999999999999},"min":{"1min":0.75800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.3079999999999998,"5min":16.318000000000001,"15min":16.318000000000001},"last":5.5369999999999999},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.8889999999999998,"15min":2.5249999999999999},"min":{"1min":0.65800000000000003,"5min":0.57999999999999996,"15min":0.44800000000000001},"max":{"1min":6.4870000000000001,"5min":15.59,"15min":15.59},"last":3.1499999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":2.5739999999999998,"15min":2.8479999999999999},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.434},"max":{"1min":5.6559999999999997,"5min":13.308,"15min":99.003},"last":6.7999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":2.702,"15min":2.9020000000000001},"min":{"1min":0.80600000000000005,"5min":0.59899999999999998,"15min":0.55500000000000005},"max":{"1min":5.3949999999999996,"5min":16.431999999999999,"15min":97.721000000000004},"last":5.4160000000000004}]},{"osd":7,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.9489999999999998,"15min":2.681},"min":{"1min":0.621,"5min":0.621,"15min":0.56200000000000006},"max":{"1min":6.5739999999999998,"5min":13.103,"15min":13.103},"last":3.1909999999999998},{"interface":"front","average":{"1min":2.3940000000000001,"5min":2.7349999999999999,"15min":2.6459999999999999},"min":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.47699999999999998},"max":{"1min":5.7300000000000004,"5min":13.397,"15min":13.397},"last":6.75}]}]},{"osd":7,"up_from":14,"seq":60129549052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1742792,"kb_used_data":448,"kb_used_omap":2965,"kb_used_meta":1739370,"kb_avail":92629048,"statfs":{"total":96636764160,"available":94852145152,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3036782,"internal_metadata":1781115282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":251,"apply_latency_ms":251,"commit_latency_ns":251000000,"apply_latency_ns":251000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.456,"15min":1.361},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":5.4039999999999999,"5min":10.583,"15min":10.583},"last":8.5169999999999995},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.7629999999999999,"15min":1.5980000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.317},"max":{"1min":4.3150000000000004,"5min":8.3100000000000005,"15min":8.3100000000000005},"last":1.877}]},{"osd":1,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.5,"15min":1.486},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":4.3410000000000002,"5min":8.2929999999999993,"15min":8.2929999999999993},"last":5.8339999999999996},{"interface":"front","average":{"1min":1.655,"5min":1.802,"15min":1.591},"min":{"1min":0.66600000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.4450000000000003,"5min":18.013000000000002,"15min":18.013000000000002},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.601,"15min":1.587},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.835,"5min":9.2279999999999998,"15min":9.2279999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.355,"5min":1.6910000000000001,"15min":1.585},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"max":{"1min":4.6219999999999999,"5min":8.7949999999999999,"15min":8.7949999999999999},"last":1.1020000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.532,"15min":1.651},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0979999999999999,"5min":6.0979999999999999,"15min":8.7189999999999994},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.903,"15min":1.7769999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.47399999999999998},"max":{"1min":4.5990000000000002,"5min":12.199,"15min":12.199},"last":4.5309999999999997}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.29999999999999999},"max":{"1min":3.7890000000000001,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":8.4649999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84799999999999998,"15min":0.79400000000000004},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.32200000000000001},"max":{"1min":3.1379999999999999,"5min":13.602,"15min":13.602},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.86499999999999999},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.32400000000000001},"max":{"1min":1.8779999999999999,"5min":13.058,"15min":13.058},"last":1.036},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.39800000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"max":{"1min":3.835,"5min":3.835,"15min":4.6399999999999997},"last":1.379}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.1399999999999999,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":5.3559999999999999,"5min":20.718,"15min":20.718},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.92400000000000004,"15min":0.872},"min":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.39700000000000002},"max":{"1min":0.91300000000000003,"5min":13.648,"15min":13.648},"last":1.446}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T03:15:31.028 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T03:15:32.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.113+0000 7fd1e5438640 1 Processor -- start 2023-11-29T03:15:32.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e5438640 1 -- start start 2023-11-29T03:15:32.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e5438640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd1e00cb410 0x7fd1e01651d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:32.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e5438640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1e0162860 0x7fd1e0144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:32.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e5438640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e00b1ec0 con 0x7fd1e00cb7f0 2023-11-29T03:15:32.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e5438640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e0165a60 con 0x7fd1e0162860 2023-11-29T03:15:32.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e5438640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e0165d40 con 0x7fd1e00cb410 2023-11-29T03:15:32.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1e0162860 0x7fd1e0144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:32.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fd1e0162860 0x7fd1e0144cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45958/0 (socket says 172.21.15.16:45958) 2023-11-29T03:15:32.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 -- 172.21.15.16:0/3033135326 learned_addr learned my addr 172.21.15.16:0/3033135326 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:32.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 -- 172.21.15.16:0/3033135326 >> v2:172.21.15.64:3300/0 conn(0x7fd1e00cb410 msgr2=0x7fd1e01651d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-29T03:15:32.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 --2- 172.21.15.16:0/3033135326 >> v2:172.21.15.64:3300/0 conn(0x7fd1e00cb410 0x7fd1e01651d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:32.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 -- 172.21.15.16:0/3033135326 >> v1:172.21.15.16:6789/0 conn(0x7fd1e00cb7f0 legacy=0x7fd1e00b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:32.130 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.121+0000 7fd1e4c37640 1 -- 172.21.15.16:0/3033135326 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0166020 con 0x7fd1e0162860 2023-11-29T03:15:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.137+0000 7fd1e4c37640 1 --2- 172.21.15.16:0/3033135326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0162860 0x7fd1e0144cd0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7fd1e006e0f0 tx=0x7fd1d001c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c059f1b4a0b29178 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.137+0000 7fd1deffd640 1 -- 172.21.15.16:0/3033135326 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00ab600 con 0x7fd1e0162860 2023-11-29T03:15:32.143 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.137+0000 7fd1deffd640 1 -- 172.21.15.16:0/3033135326 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00a7050 con 0x7fd1e0162860 2023-11-29T03:15:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.137+0000 7fd1deffd640 1 -- 172.21.15.16:0/3033135326 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00ab980 con 0x7fd1e0162860 2023-11-29T03:15:32.144 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.141+0000 7fd1e5438640 1 -- 172.21.15.16:0/3033135326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0162860 msgr2=0x7fd1e0144cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.141+0000 7fd1e5438640 1 --2- 172.21.15.16:0/3033135326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0162860 0x7fd1e0144cd0 secure :-1 s=READY pgs=3294 cs=0 l=1 rev1=1 crypto rx=0x7fd1e006e0f0 tx=0x7fd1d001c390 comp rx=0 tx=0).stop 2023-11-29T03:15:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.141+0000 7fd1e5438640 1 -- 172.21.15.16:0/3033135326 shutdown_connections 2023-11-29T03:15:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.141+0000 7fd1e5438640 1 --2- 172.21.15.16:0/3033135326 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e0162860 0x7fd1e0144cd0 unknown :-1 s=CLOSED pgs=3294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:32.145 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.141+0000 7fd1e5438640 1 --2- 172.21.15.16:0/3033135326 >> v2:172.21.15.64:3300/0 conn(0x7fd1e00cb410 0x7fd1e01651d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:32.146 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.141+0000 7fd1e5438640 1 -- 172.21.15.16:0/3033135326 >> 172.21.15.16:0/3033135326 conn(0x7fd1e006aba0 msgr2=0x7fd1e00b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:32.147 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.145+0000 7fd1e5438640 1 -- 172.21.15.16:0/3033135326 shutdown_connections 2023-11-29T03:15:32.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.145+0000 7fd1e5438640 1 -- 172.21.15.16:0/3033135326 wait complete. 2023-11-29T03:15:32.159 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.145+0000 7fd1e5438640 1 Processor -- start 2023-11-29T03:15:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.149+0000 7fd1e5438640 1 -- start start 2023-11-29T03:15:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.153+0000 7fd1e5438640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cb410 0x7fd1e013ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.153+0000 7fd1e5438640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e00cb7f0 0x7fd1e015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.153+0000 7fd1e5438640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0162860 0x7fd1e00afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:32.160 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.153+0000 7fd1dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cb410 0x7fd1e013ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.153+0000 7fd1dffff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cb410 0x7fd1e013ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45974/0 (socket says 172.21.15.16:45974) 2023-11-29T03:15:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e5438640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e015db00 con 0x7fd1e00cb410 2023-11-29T03:15:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e5438640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e013d350 con 0x7fd1e00cb7f0 2023-11-29T03:15:32.161 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e013d630 con 0x7fd1e0162860 2023-11-29T03:15:32.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1dffff640 1 -- 172.21.15.16:0/2091928006 learned_addr learned my addr 172.21.15.16:0/2091928006 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:32.162 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e4c37640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0162860 0x7fd1e00afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:32.165 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e4c37640 1 -- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e00cb7f0 msgr2=0x7fd1e015c020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-29T03:15:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e4c37640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e00cb7f0 0x7fd1e015c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:32.166 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.157+0000 7fd1e4c37640 1 -- 172.21.15.16:0/2091928006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cb410 msgr2=0x7fd1e013ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:32.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.161+0000 7fd1e4c37640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cb410 0x7fd1e013ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:32.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.161+0000 7fd1e4c37640 1 -- 172.21.15.16:0/2091928006 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d00094d0 con 0x7fd1e0162860 2023-11-29T03:15:32.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.161+0000 7fd1e4c37640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0162860 0x7fd1e00afc50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ab000 tx=0x7fd1d0019130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:32.167 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.161+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00b5600 con 0x7fd1e0162860 2023-11-29T03:15:32.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.161+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00b5760 con 0x7fd1e0162860 2023-11-29T03:15:32.168 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.161+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e013d910 con 0x7fd1e0162860 2023-11-29T03:15:32.171 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.165+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e013cfa0 con 0x7fd1e0162860 2023-11-29T03:15:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.173+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00b5ad0 con 0x7fd1e0162860 2023-11-29T03:15:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.173+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd1d00b5cf0 con 0x7fd1e0162860 2023-11-29T03:15:32.179 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.177+0000 7fd1dcff9640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1cc0668d0 0x7fd1cc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:32.180 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.177+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd1d0122170 con 0x7fd1e0162860 2023-11-29T03:15:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.177+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c0005260 con 0x7fd1e0162860 2023-11-29T03:15:32.181 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.177+0000 7fd1dffff640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1cc0668d0 0x7fd1cc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:32.182 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.177+0000 7fd1dffff640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1cc0668d0 0x7fd1cc068d90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e270 tx=0x7fd1d800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:32.187 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:32.185+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd1d0123060 con 0x7fd1e0162860 2023-11-29T03:15:33.052 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.045+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd1c0000bd0 con 0x7fd1cc0668d0 2023-11-29T03:15:33.054 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:33.055 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-29T03:15:33.055 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.049+0000 7fd1dcff9640 1 -- 172.21.15.16:0/2091928006 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49422 (secure 0 0 0) 0x7fd1c0000bd0 con 0x7fd1cc0668d0 2023-11-29T03:15:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.065+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1cc0668d0 msgr2=0x7fd1cc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.065+0000 7fd1e5438640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1cc0668d0 0x7fd1cc068d90 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e270 tx=0x7fd1d800b040 comp rx=0 tx=0).stop 2023-11-29T03:15:33.072 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.065+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0162860 msgr2=0x7fd1e00afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.065+0000 7fd1e5438640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0162860 0x7fd1e00afc50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00ab000 tx=0x7fd1d0019130 comp rx=0 tx=0).stop 2023-11-29T03:15:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 shutdown_connections 2023-11-29T03:15:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd1e0162860 0x7fd1e00afc50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.073 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd1cc0668d0 0x7fd1cc068d90 secure :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fd1d800e270 tx=0x7fd1d800b040 comp rx=0 tx=0).stop 2023-11-29T03:15:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd1e00cb7f0 0x7fd1e015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 --2- 172.21.15.16:0/2091928006 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd1e00cb410 0x7fd1e013ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 >> 172.21.15.16:0/2091928006 conn(0x7fd1e006aba0 msgr2=0x7fd1e00710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:33.074 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.069+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 shutdown_connections 2023-11-29T03:15:33.079 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.073+0000 7fd1e5438640 1 -- 172.21.15.16:0/2091928006 wait complete. 2023-11-29T03:15:33.198 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":17309,"stamp":"2023-11-29T03:15:32.742166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":23990608,"kb_used_data":11446320,"kb_used_omap":36860,"kb_used_meta":12384259,"kb_avail":730984112,"statfs":{"total":773094113280,"available":748527730688,"internally_reserved":0,"allocated":11721031680,"data_stored":11714934787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37745340,"internal_metadata":12681481540},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3544,"apply_latency_ms":3544,"commit_latency_ns":3544000000,"apply_latency_ns":3544000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.864221"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":521,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-29T03:15:18.960057+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-29T03:15:18.960057+0000","last_peered":"2023-11-29T03:15:18.960057+0000","last_clean":"2023-11-29T03:15:18.960057+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-29T03:15:18.960057+0000","last_undegraded":"2023-11-29T03:15:18.960057+0000","last_fullsized":"2023-11-29T03:15:18.960057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516342,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2979348,"kb_used_data":1567740,"kb_used_omap":5738,"kb_used_meta":1347477,"kb_avail":91392492,"statfs":{"total":96636764160,"available":93585911808,"internally_reserved":0,"allocated":1605365760,"data_stored":1604504970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5876368,"internal_metadata":1379816816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":193,"apply_latency_ms":193,"commit_latency_ns":193000000,"apply_latency_ns":193000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.2669999999999999,"15min":1.248},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":6.3360000000000003,"5min":6.3360000000000003,"15min":6.665},"last":3.9500000000000002},{"interface":"front","average":{"1min":1.831,"5min":1.4019999999999999,"15min":1.4359999999999999},"min":{"1min":0.48399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":5.1829999999999998,"5min":5.1829999999999998,"15min":8.4800000000000004},"last":4.1539999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3779999999999999,"15min":1.4890000000000001},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.6069999999999993},"last":4.3319999999999999},{"interface":"front","average":{"1min":1.794,"5min":1.4690000000000001,"15min":1.4379999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":8.6630000000000003},"last":6.7770000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.6950000000000001,"15min":1.502},"min":{"1min":0.50700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":3.9409999999999998,"5min":8.1790000000000003,"15min":11.333},"last":13.279},{"interface":"front","average":{"1min":2.278,"5min":1.8220000000000001,"15min":1.6339999999999999},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":12.827,"5min":12.827,"15min":12.827},"last":13.237}]},{"osd":3,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":3.2749999999999999,"5min":1.9219999999999999,"15min":1.6799999999999999},"min":{"1min":0.67200000000000004,"5min":0.44600000000000001,"15min":0.439},"max":{"1min":25.420000000000002,"5min":25.420000000000002,"15min":25.420000000000002},"last":6.9889999999999999},{"interface":"front","average":{"1min":2.988,"5min":1.9139999999999999,"15min":1.7130000000000001},"min":{"1min":0.78200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":26.690000000000001,"5min":26.690000000000001,"15min":26.690000000000001},"last":6.1959999999999997}]},{"osd":4,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.83299999999999996,"15min":0.747},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":11.890000000000001,"5min":11.890000000000001,"15min":11.890000000000001},"last":7.3970000000000002},{"interface":"front","average":{"1min":2.3860000000000001,"5min":1.1379999999999999,"15min":0.878},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":32.695,"5min":32.695,"15min":32.695},"last":6.2450000000000001}]},{"osd":5,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":0.89700000000000002},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35999999999999999},"max":{"1min":1.909,"5min":3.637,"15min":6.8789999999999996},"last":6.3049999999999997},{"interface":"front","average":{"1min":1.109,"5min":0.97499999999999998,"15min":0.89900000000000002},"min":{"1min":0.502,"5min":0.45600000000000002,"15min":0.44500000000000001},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.8049999999999997},"last":7.194}]},{"osd":7,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.3250000000000002,"5min":4.6639999999999997,"15min":4.7270000000000003},"last":13.180999999999999},{"interface":"front","average":{"1min":1.117,"5min":0.95399999999999996,"15min":0.89700000000000002},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":5.4480000000000004}]}]},{"osd":5,"up_from":15,"seq":64424516346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286348,"kb_used_data":1028,"kb_used_omap":3640,"kb_used_meta":1281671,"kb_avail":93085492,"statfs":{"total":96636764160,"available":95319543808,"internally_reserved":0,"allocated":1052672,"data_stored":771947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3727398,"internal_metadata":1312432090},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1563,"apply_latency_ms":1563,"commit_latency_ns":1563000000,"apply_latency_ns":1563000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.413,"15min":1.3280000000000001},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":3.9180000000000001,"5min":12.811999999999999,"15min":12.811999999999999},"last":1.385},{"interface":"front","average":{"1min":1.742,"5min":1.3859999999999999,"15min":1.407},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35499999999999998},"max":{"1min":5.3259999999999996,"5min":7.3369999999999997,"15min":7.3369999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.641,"15min":1.55},"min":{"1min":0.60199999999999998,"5min":0.41799999999999998,"15min":0.37},"max":{"1min":11.077,"5min":11.077,"15min":11.077},"last":0.97899999999999998},{"interface":"front","average":{"1min":2.073,"5min":1.554,"15min":1.4319999999999999},"min":{"1min":0.61599999999999999,"5min":0.38,"15min":0.38},"max":{"1min":8.2520000000000007,"5min":8.9410000000000007,"15min":8.9410000000000007},"last":1.2010000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":1.9119999999999999,"15min":1.6259999999999999},"min":{"1min":0.63100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.6790000000000003,"5min":12.478,"15min":12.478},"last":0.64100000000000001},{"interface":"front","average":{"1min":2.335,"5min":1.8819999999999999,"15min":1.776},"min":{"1min":0.66800000000000004,"5min":0.502,"15min":0.43099999999999999},"max":{"1min":8.7309999999999999,"5min":8.7309999999999999,"15min":8.7309999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.9299999999999999,"15min":1.7290000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"max":{"1min":7.3659999999999997,"5min":7.3659999999999997,"15min":7.3659999999999997},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.8859999999999999,"15min":1.7090000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55500000000000005},"max":{"1min":6.157,"5min":6.742,"15min":7.1379999999999999},"last":0.95099999999999996}]},{"osd":4,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.78200000000000003},"min":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.29799999999999999},"max":{"1min":2.581,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":0.84899999999999998},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":4.1500000000000004,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.86799999999999999,"15min":0.87},"min":{"1min":0.504,"5min":0.40200000000000002,"15min":0.34000000000000002},"max":{"1min":6.0129999999999999,"5min":6.0129999999999999,"15min":6.0129999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.88600000000000001,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.39100000000000001},"max":{"1min":2.54,"5min":7.8019999999999996,"15min":7.8019999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.93600000000000005,"15min":0.91100000000000003},"min":{"1min":0.47199999999999998,"5min":0.38,"15min":0.371},"max":{"1min":7.0780000000000003,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.115,"5min":0.98099999999999998,"15min":0.97099999999999997},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.52200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424516340,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1876628,"kb_used_data":190412,"kb_used_omap":5001,"kb_used_meta":1681206,"kb_avail":92495212,"statfs":{"total":96636764160,"available":94715097088,"internally_reserved":0,"allocated":194981888,"data_stored":194638733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5121709,"internal_metadata":1721555283},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":207,"apply_latency_ms":207,"commit_latency_ns":207000000,"apply_latency_ns":207000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.2949999999999999,"15min":1.359},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":5.96,"5min":6.3280000000000003,"15min":12.282},"last":1.5389999999999999},{"interface":"front","average":{"1min":2.3100000000000001,"5min":1.665,"15min":1.5820000000000001},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":21.513000000000002,"5min":21.513000000000002,"15min":21.513000000000002},"last":11.977}]},{"osd":1,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.637,"15min":1.6850000000000001},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.46300000000000002},"max":{"1min":7.3650000000000002,"5min":7.3650000000000002,"15min":9.1530000000000005},"last":1.4770000000000001},{"interface":"front","average":{"1min":2.3980000000000001,"5min":1.675,"15min":1.7330000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.4059999999999997,"5min":7.4059999999999997,"15min":9.1859999999999999},"last":1.5169999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.351,"15min":1.5509999999999999},"min":{"1min":0.57799999999999996,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":3.448,"5min":4,"15min":10.791},"last":1.5549999999999999},{"interface":"front","average":{"1min":2.4409999999999998,"5min":1.752,"15min":1.649},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.40799999999999997},"max":{"1min":7.9189999999999996,"5min":7.9189999999999996,"15min":7.9189999999999996},"last":4.4729999999999999}]},{"osd":3,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6359999999999999,"15min":1.575},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":4.6390000000000002,"5min":6.4279999999999999,"15min":8.5470000000000006},"last":6.2770000000000001},{"interface":"front","average":{"1min":1.829,"5min":1.8049999999999999,"15min":1.6830000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":7.2489999999999997,"5min":7.2489999999999997,"15min":8.3309999999999995},"last":12.102}]},{"osd":5,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":7.2229999999999999,"5min":7.2229999999999999,"15min":7.2229999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":4.6799999999999997,"5min":4.6799999999999997,"15min":5.1890000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71999999999999997,"15min":0.77800000000000002},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":3.383,"5min":3.383,"15min":5.6660000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":0.90900000000000003,"15min":0.877},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.39500000000000002},"max":{"1min":7.2759999999999998,"5min":7.2759999999999998,"15min":7.2759999999999998},"last":1.3979999999999999}]},{"osd":7,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.432,"15min":0.376},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":0.98399999999999999,"15min":0.93999999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44400000000000001},"max":{"1min":7.319,"5min":7.319,"15min":7.319},"last":1.3520000000000001}]}]},{"osd":3,"up_from":15,"seq":64424516299,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6057072,"kb_used_data":4277280,"kb_used_omap":6687,"kb_used_meta":1773088,"kb_avail":88314768,"statfs":{"total":96636764160,"available":90434322432,"internally_reserved":0,"allocated":4379934720,"data_stored":4378307260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6847688,"internal_metadata":1815642936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":246,"apply_latency_ms":246,"commit_latency_ns":246000000,"apply_latency_ns":246000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2709999999999999,"5min":2.383,"15min":2.3530000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.41999999999999998},"max":{"1min":4.6719999999999997,"5min":9.8610000000000007,"15min":11.345000000000001},"last":7.569},{"interface":"front","average":{"1min":3.5859999999999999,"5min":2.6539999999999999,"15min":2.4940000000000002},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.31},"max":{"1min":9.6219999999999999,"5min":11.801,"15min":11.801},"last":10.186999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.6760000000000002,"15min":2.645},"min":{"1min":0.76300000000000001,"5min":0.53300000000000003,"15min":0.40100000000000002},"max":{"1min":4.867,"5min":11.289,"15min":11.289},"last":1.1910000000000001},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.931,"15min":2.8090000000000002},"min":{"1min":0.73899999999999999,"5min":0.57099999999999995,"15min":0.48799999999999999},"max":{"1min":5.8179999999999996,"5min":19.702999999999999,"15min":19.702999999999999},"last":2.1219999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.4020000000000001,"5min":3.1059999999999999,"15min":3.0049999999999999},"min":{"1min":0.73199999999999998,"5min":0.71099999999999997,"15min":0.51900000000000002},"max":{"1min":5.5039999999999996,"5min":12.75,"15min":12.75},"last":1.3049999999999999},{"interface":"front","average":{"1min":3.29,"5min":3.0950000000000002,"15min":2.948},"min":{"1min":0.93899999999999995,"5min":0.77900000000000003,"15min":0.46600000000000003},"max":{"1min":14.326000000000001,"5min":14.962,"15min":14.962},"last":2.2469999999999999}]},{"osd":4,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.165,"15min":2.21},"min":{"1min":0.73299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":8.5289999999999999,"5min":8.5289999999999999,"15min":9.1799999999999997},"last":4.5759999999999996},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.4529999999999998,"15min":2.3900000000000001},"min":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.55300000000000005},"max":{"1min":5.1840000000000002,"5min":7.5700000000000003,"15min":8.5679999999999996},"last":2.387}]},{"osd":5,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.5649999999999999,"15min":2.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.60799999999999998},"max":{"1min":5.2949999999999999,"5min":7.6280000000000001,"15min":8.6910000000000007},"last":2.4830000000000001},{"interface":"front","average":{"1min":2.0790000000000002,"5min":2.3420000000000001,"15min":2.3929999999999998},"min":{"1min":0.78700000000000003,"5min":0.624,"15min":0.52100000000000002},"max":{"1min":4.931,"5min":9.6920000000000002,"15min":10.722},"last":7.4459999999999997}]},{"osd":6,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":2.363,"15min":2.3879999999999999},"min":{"1min":0.81999999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":8.6440000000000001,"5min":8.6440000000000001,"15min":9.3770000000000007},"last":8.9209999999999994},{"interface":"front","average":{"1min":2.3610000000000002,"5min":2.694,"15min":2.6539999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.59599999999999997},"max":{"1min":5.4029999999999996,"5min":7.9139999999999997,"15min":8.7949999999999999},"last":10.250999999999999}]},{"osd":7,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2389999999999999,"5min":2.556,"15min":2.569},"min":{"1min":0.79400000000000004,"5min":0.66000000000000003,"15min":0.56000000000000005},"max":{"1min":5.0460000000000003,"5min":10.939,"15min":10.939},"last":21.25},{"interface":"front","average":{"1min":3.3279999999999998,"5min":2.5289999999999999,"15min":2.5609999999999999},"min":{"1min":0.77700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":8.7479999999999993,"5min":8.7479999999999993,"15min":9.5099999999999998},"last":17.382999999999999}]}]},{"osd":2,"up_from":15,"seq":64424516290,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2041552,"kb_used_data":794888,"kb_used_omap":3496,"kb_used_meta":1243159,"kb_avail":92330288,"statfs":{"total":96636764160,"available":94546214912,"internally_reserved":0,"allocated":813965312,"data_stored":813452138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3580142,"internal_metadata":1272995602},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":259,"apply_latency_ms":259,"commit_latency_ns":259000000,"apply_latency_ns":259000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.1339999999999999,"5min":4.2690000000000001,"15min":2.98},"min":{"1min":0.58999999999999997,"5min":0.46200000000000002,"15min":0.309},"max":{"1min":28.393999999999998,"5min":158.864,"15min":158.864},"last":0.71799999999999997},{"interface":"front","average":{"1min":2.3610000000000002,"5min":4.1740000000000004,"15min":3.0990000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.48999999999999999},"max":{"1min":8.3040000000000003,"5min":156.66200000000001,"15min":156.66200000000001},"last":1.151}]},{"osd":1,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0569999999999999,"5min":2.6669999999999998,"15min":2.6970000000000001},"min":{"1min":0.57299999999999995,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":12.154,"5min":17.699999999999999,"15min":17.699999999999999},"last":6.3040000000000003},{"interface":"front","average":{"1min":2.7040000000000002,"5min":2.8610000000000002,"15min":2.706},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":6.8259999999999996,"5min":18.989999999999998,"15min":18.989999999999998},"last":2.399}]},{"osd":3,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1219999999999999,"5min":2.5590000000000002,"15min":2.5},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.48799999999999999},"max":{"1min":4.3499999999999996,"5min":11.087999999999999,"15min":11.087999999999999},"last":2.7610000000000001},{"interface":"front","average":{"1min":3.5139999999999998,"5min":2.9169999999999998,"15min":2.887},"min":{"1min":0.67400000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.266,"5min":12.266,"15min":12.792999999999999},"last":6.0700000000000003}]},{"osd":4,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":2.2010000000000001,"15min":2.1899999999999999},"min":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.44500000000000001},"max":{"1min":5.7110000000000003,"5min":7.5780000000000003,"15min":7.5780000000000003},"last":1.198},{"interface":"front","average":{"1min":2.04,"5min":2.105,"15min":2.137},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.3730000000000002,"5min":5.9770000000000003,"15min":9.3719999999999999},"last":1.917}]},{"osd":5,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.399,"5min":2.5920000000000001,"15min":2.3439999999999999},"min":{"1min":0.65400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":28.186,"5min":28.186,"15min":28.186},"last":5.9299999999999997},{"interface":"front","average":{"1min":2.181,"5min":2.3439999999999999,"15min":2.3439999999999999},"min":{"1min":0.65100000000000002,"5min":0.54100000000000004,"15min":0.48299999999999998},"max":{"1min":5.9909999999999997,"5min":7.8209999999999997,"15min":9.5350000000000001},"last":1.276}]},{"osd":6,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1789999999999998,"5min":2.2599999999999998,"15min":2.343},"min":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.4850000000000003,"5min":6.181,"15min":9.5020000000000007},"last":2.0649999999999999},{"interface":"front","average":{"1min":3.5619999999999998,"5min":2.843,"15min":2.5720000000000001},"min":{"1min":0.83499999999999996,"5min":0.629,"15min":0.48699999999999999},"max":{"1min":28.300999999999998,"5min":28.300999999999998,"15min":28.300999999999998},"last":6.1950000000000003}]},{"osd":7,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":2.5510000000000002,"15min":2.516},"min":{"1min":1.0369999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.6270000000000007,"5min":8.6270000000000007,"15min":9.3109999999999999},"last":1.236},{"interface":"front","average":{"1min":2.3959999999999999,"5min":2.3799999999999999,"15min":2.4990000000000001},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.5789999999999997,"5min":6.2759999999999998,"15min":9.5790000000000006},"last":2.1819999999999999}]}]},{"osd":1,"up_from":15,"seq":64424516309,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2232432,"kb_used_data":528064,"kb_used_omap":3411,"kb_used_meta":1685804,"kb_avail":92139408,"statfs":{"total":96636764160,"available":94350753792,"internally_reserved":0,"allocated":540737536,"data_stored":540275355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3493385,"internal_metadata":1726263799},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":662,"apply_latency_ms":662,"commit_latency_ns":662000000,"apply_latency_ns":662000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.5310000000000001,"15min":2.5489999999999999},"min":{"1min":0.52700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":11.449,"5min":11.505000000000001,"15min":14.603999999999999},"last":8.7639999999999993},{"interface":"front","average":{"1min":2.9489999999999998,"5min":2.5529999999999999,"15min":2.5739999999999998},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.41599999999999998},"max":{"1min":6.9420000000000002,"5min":11.196999999999999,"15min":12.343},"last":2.3980000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.7759999999999998,"15min":2.6499999999999999},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":25.795000000000002,"5min":25.795000000000002,"15min":25.795000000000002},"last":2.496},{"interface":"front","average":{"1min":3.8460000000000001,"5min":2.944,"15min":2.774},"min":{"1min":0.629,"5min":0.56799999999999995,"15min":0.41499999999999998},"max":{"1min":14.885,"5min":14.885,"15min":14.885},"last":8.5389999999999997}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2629999999999999,"5min":3.2330000000000001,"15min":3.024},"min":{"1min":0.91000000000000003,"5min":0.57899999999999996,"15min":0.42499999999999999},"max":{"1min":16.693999999999999,"5min":16.693999999999999,"15min":16.722999999999999},"last":8.6509999999999998},{"interface":"front","average":{"1min":3.5489999999999999,"5min":3.1989999999999998,"15min":3.0270000000000001},"min":{"1min":0.98299999999999998,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":10.692,"5min":10.692,"15min":12.992000000000001},"last":2.5600000000000001}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.6139999999999999,"15min":2.3199999999999998},"min":{"1min":0.66100000000000003,"5min":0.58299999999999996,"15min":0.56799999999999995},"max":{"1min":27.562000000000001,"5min":27.562000000000001,"15min":27.562000000000001},"last":2.3660000000000001},{"interface":"front","average":{"1min":2.5649999999999999,"5min":2.3900000000000001,"15min":2.327},"min":{"1min":0.67800000000000005,"5min":0.52000000000000002,"15min":0.505},"max":{"1min":9.8710000000000004,"5min":11.590999999999999,"15min":12.345000000000001},"last":8.3019999999999996}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.492,"5min":2.1720000000000002,"15min":2.3799999999999999},"min":{"1min":0.69699999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":6.758,"5min":6.8280000000000003,"15min":11.984},"last":0.90600000000000003},{"interface":"front","average":{"1min":2.7160000000000002,"5min":2.6059999999999999,"15min":2.46},"min":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.58999999999999997},"max":{"1min":25.920999999999999,"5min":25.920999999999999,"15min":25.920999999999999},"last":2.3069999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.637,"5min":2.2599999999999998,"15min":2.5249999999999999},"min":{"1min":0.78500000000000003,"5min":0.65000000000000002,"15min":0.53400000000000003},"max":{"1min":7.1280000000000001,"5min":7.1280000000000001,"15min":12.113},"last":0.85999999999999999},{"interface":"front","average":{"1min":2.8519999999999999,"5min":2.8620000000000001,"15min":2.6200000000000001},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.55400000000000005},"max":{"1min":26.326000000000001,"5min":26.326000000000001,"15min":26.326000000000001},"last":2.4550000000000001}]},{"osd":7,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.7709999999999999,"5min":2.4769999999999999,"15min":2.4940000000000002},"min":{"1min":0.72399999999999998,"5min":0.55700000000000005,"15min":0.49199999999999999},"max":{"1min":10.005000000000001,"5min":11.557,"15min":12.457000000000001},"last":8.4239999999999995},{"interface":"front","average":{"1min":2.7309999999999999,"5min":2.4489999999999998,"15min":2.637},"min":{"1min":1.0189999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.2300000000000004,"5min":7.2300000000000004,"15min":12.210000000000001},"last":0.94299999999999995}]}]},{"osd":0,"up_from":15,"seq":64424516302,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5774436,"kb_used_data":4086460,"kb_used_omap":5919,"kb_used_meta":1632480,"kb_avail":88597404,"statfs":{"total":96636764160,"available":90723741696,"internally_reserved":0,"allocated":4184535040,"data_stored":4182802805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6061868,"internal_metadata":1671659732},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":163,"apply_latency_ms":163,"commit_latency_ns":163000000,"apply_latency_ns":163000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.516,"5min":2.9329999999999998,"15min":2.4460000000000002},"min":{"1min":0.748,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":9.7439999999999998,"5min":15.596,"15min":15.596},"last":5.75},{"interface":"front","average":{"1min":2.6070000000000002,"5min":2.9740000000000002,"15min":2.7069999999999999},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.36699999999999999},"max":{"1min":6.6710000000000003,"5min":12.222,"15min":12.621},"last":2.5190000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.9060000000000001,"15min":3.0459999999999998},"min":{"1min":0.60599999999999998,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":5.085,"5min":12.913,"15min":61.551000000000002},"last":5.6500000000000004},{"interface":"front","average":{"1min":3.3260000000000001,"5min":3.2719999999999998,"15min":3.202},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.434},"max":{"1min":7.0350000000000001,"5min":12.842000000000001,"15min":61.359999999999999},"last":2.774}]},{"osd":3,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.6880000000000002,"15min":2.6280000000000001},"min":{"1min":0.74099999999999999,"5min":0.436,"15min":0.433},"max":{"1min":6.7919999999999998,"5min":12.379,"15min":12.379},"last":9.6880000000000006},{"interface":"front","average":{"1min":2.653,"5min":3.3759999999999999,"15min":3.0510000000000002},"min":{"1min":0.85699999999999998,"5min":0.60899999999999999,"15min":0.54300000000000004},"max":{"1min":9.1210000000000004,"5min":16.524999999999999,"15min":16.524999999999999},"last":12.052}]},{"osd":4,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.6869999999999998,"15min":2.3370000000000002},"min":{"1min":0.58099999999999996,"5min":0.53900000000000003,"15min":0.41199999999999998},"max":{"1min":6.3970000000000002,"5min":12.987,"15min":12.987},"last":11.141},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.4870000000000001,"15min":2.359},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.38400000000000001},"max":{"1min":5.6100000000000003,"5min":13.177,"15min":13.177},"last":10.994}]},{"osd":5,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":2.6179999999999999,"15min":2.4319999999999999},"min":{"1min":0.75800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.3079999999999998,"5min":16.318000000000001,"15min":16.318000000000001},"last":5.5369999999999999},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.8889999999999998,"15min":2.5249999999999999},"min":{"1min":0.65800000000000003,"5min":0.57999999999999996,"15min":0.44800000000000001},"max":{"1min":6.4870000000000001,"5min":15.59,"15min":15.59},"last":3.1499999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":2.5739999999999998,"15min":2.8479999999999999},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.434},"max":{"1min":5.6559999999999997,"5min":13.308,"15min":99.003},"last":6.7999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":2.702,"15min":2.9020000000000001},"min":{"1min":0.80600000000000005,"5min":0.59899999999999998,"15min":0.55500000000000005},"max":{"1min":5.3949999999999996,"5min":16.431999999999999,"15min":97.721000000000004},"last":5.4160000000000004}]},{"osd":7,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.9489999999999998,"15min":2.681},"min":{"1min":0.621,"5min":0.621,"15min":0.56200000000000006},"max":{"1min":6.5739999999999998,"5min":13.103,"15min":13.103},"last":3.1909999999999998},{"interface":"front","average":{"1min":2.3940000000000001,"5min":2.7349999999999999,"15min":2.6459999999999999},"min":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.47699999999999998},"max":{"1min":5.7300000000000004,"5min":13.397,"15min":13.397},"last":6.75}]}]},{"osd":7,"up_from":14,"seq":60129549052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1742792,"kb_used_data":448,"kb_used_omap":2965,"kb_used_meta":1739370,"kb_avail":92629048,"statfs":{"total":96636764160,"available":94852145152,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3036782,"internal_metadata":1781115282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":251,"apply_latency_ms":251,"commit_latency_ns":251000000,"apply_latency_ns":251000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.456,"15min":1.361},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":5.4039999999999999,"5min":10.583,"15min":10.583},"last":8.5169999999999995},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.7629999999999999,"15min":1.5980000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.317},"max":{"1min":4.3150000000000004,"5min":8.3100000000000005,"15min":8.3100000000000005},"last":1.877}]},{"osd":1,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.5,"15min":1.486},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":4.3410000000000002,"5min":8.2929999999999993,"15min":8.2929999999999993},"last":5.8339999999999996},{"interface":"front","average":{"1min":1.655,"5min":1.802,"15min":1.591},"min":{"1min":0.66600000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.4450000000000003,"5min":18.013000000000002,"15min":18.013000000000002},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.601,"15min":1.587},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.835,"5min":9.2279999999999998,"15min":9.2279999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.355,"5min":1.6910000000000001,"15min":1.585},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"max":{"1min":4.6219999999999999,"5min":8.7949999999999999,"15min":8.7949999999999999},"last":1.1020000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.532,"15min":1.651},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0979999999999999,"5min":6.0979999999999999,"15min":8.7189999999999994},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.903,"15min":1.7769999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.47399999999999998},"max":{"1min":4.5990000000000002,"5min":12.199,"15min":12.199},"last":4.5309999999999997}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.29999999999999999},"max":{"1min":3.7890000000000001,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":8.4649999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84799999999999998,"15min":0.79400000000000004},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.32200000000000001},"max":{"1min":3.1379999999999999,"5min":13.602,"15min":13.602},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.86499999999999999},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.32400000000000001},"max":{"1min":1.8779999999999999,"5min":13.058,"15min":13.058},"last":1.036},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.39800000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"max":{"1min":3.835,"5min":3.835,"15min":4.6399999999999997},"last":1.379}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.1399999999999999,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":5.3559999999999999,"5min":20.718,"15min":20.718},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.92400000000000004,"15min":0.872},"min":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.39700000000000002},"max":{"1min":0.91300000000000003,"5min":13.648,"15min":13.648},"last":1.446}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T03:15:33.201 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-29T03:15:33.202 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T03:15:33.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.889+0000 7fa143fff640 1 Processor -- start 2023-11-29T03:15:33.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.889+0000 7fa143fff640 1 -- start start 2023-11-29T03:15:33.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa143fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa14413d0c0 0x7fa1440ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:33.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa143fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1440713e0 0x7fa144071890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:33.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa143fff640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1440cd920 con 0x7fa14415a7c0 2023-11-29T03:15:33.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa143fff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa144140680 con 0x7fa14413d0c0 2023-11-29T03:15:33.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa143fff640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa144071dd0 con 0x7fa1440713e0 2023-11-29T03:15:33.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa1437fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fa14415a7c0 0x7fa14415ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:36172/0 (socket says 172.21.15.16:36172) 2023-11-29T03:15:33.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa142ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa14413d0c0 0x7fa1440ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:33.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa1437fe640 1 -- 172.21.15.16:0/4158496678 learned_addr learned my addr 172.21.15.16:0/4158496678 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:33.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.897+0000 7fa1427fc640 1 --2- 172.21.15.16:0/4158496678 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1440713e0 0x7fa144071890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:33.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.901+0000 7fa1427fc640 1 -- 172.21.15.16:0/4158496678 >> v2:172.21.15.64:3300/0 conn(0x7fa14413d0c0 msgr2=0x7fa1440ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:33.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.901+0000 7fa1427fc640 1 --2- 172.21.15.16:0/4158496678 >> v2:172.21.15.64:3300/0 conn(0x7fa14413d0c0 0x7fa1440ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.901+0000 7fa1427fc640 1 -- 172.21.15.16:0/4158496678 >> v1:172.21.15.16:6789/0 conn(0x7fa14415a7c0 legacy=0x7fa14415ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:33.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.901+0000 7fa1427fc640 1 -- 172.21.15.16:0/4158496678 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14415b510 con 0x7fa1440713e0 2023-11-29T03:15:33.908 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa1427fc640 1 --2- 172.21.15.16:0/4158496678 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1440713e0 0x7fa144071890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1380097c0 tx=0x7fa13801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b08cb087071bffe server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:33.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa141ffb640 1 -- 172.21.15.16:0/4158496678 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380ab600 con 0x7fa1440713e0 2023-11-29T03:15:33.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa141ffb640 1 -- 172.21.15.16:0/4158496678 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1380a7050 con 0x7fa1440713e0 2023-11-29T03:15:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 -- 172.21.15.16:0/4158496678 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1440713e0 msgr2=0x7fa144071890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa141ffb640 1 -- 172.21.15.16:0/4158496678 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380ab600 con 0x7fa1440713e0 2023-11-29T03:15:33.911 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 --2- 172.21.15.16:0/4158496678 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1440713e0 0x7fa144071890 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa1380097c0 tx=0x7fa13801c3f0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 -- 172.21.15.16:0/4158496678 shutdown_connections 2023-11-29T03:15:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 --2- 172.21.15.16:0/4158496678 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa1440713e0 0x7fa144071890 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 --2- 172.21.15.16:0/4158496678 >> v2:172.21.15.64:3300/0 conn(0x7fa14413d0c0 0x7fa1440ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 -- 172.21.15.16:0/4158496678 >> 172.21.15.16:0/4158496678 conn(0x7fa1440b0c30 msgr2=0x7fa1440b1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:33.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 -- 172.21.15.16:0/4158496678 shutdown_connections 2023-11-29T03:15:33.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.905+0000 7fa143fff640 1 -- 172.21.15.16:0/4158496678 wait complete. 2023-11-29T03:15:33.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.909+0000 7fa143fff640 1 Processor -- start 2023-11-29T03:15:33.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.909+0000 7fa143fff640 1 -- start start 2023-11-29T03:15:33.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa143fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 0x7fa14413a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa143fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa14413d0c0 0x7fa14413a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa143fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa14415a7c0 0x7fa1441363d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa143fff640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa144159b10 con 0x7fa1440713e0 2023-11-29T03:15:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa143fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa144159830 con 0x7fa14413d0c0 2023-11-29T03:15:33.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa142ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 0x7fa14413a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa142ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 0x7fa14413a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45976/0 (socket says 172.21.15.16:45976) 2023-11-29T03:15:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa142ffd640 1 -- 172.21.15.16:0/2442720107 learned_addr learned my addr 172.21.15.16:0/2442720107 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14406d820 con 0x7fa14415a7c0 2023-11-29T03:15:33.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1427fc640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa14413d0c0 0x7fa14413a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:33.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1437fe640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa14415a7c0 0x7fa1441363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:33.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1427fc640 1 -- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa14415a7c0 msgr2=0x7fa1441363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:33.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1427fc640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa14415a7c0 0x7fa1441363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1427fc640 1 -- 172.21.15.16:0/2442720107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 msgr2=0x7fa14413a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:33.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1427fc640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 0x7fa14413a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:33.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1427fc640 1 -- 172.21.15.16:0/2442720107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa138009420 con 0x7fa14413d0c0 2023-11-29T03:15:33.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa142ffd640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 0x7fa14413a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:33.921 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.913+0000 7fa1437fe640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa14415a7c0 0x7fa1441363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:33.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.917+0000 7fa1427fc640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa14413d0c0 0x7fa14413a7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1380ab000 tx=0x7fa138019190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:33.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.921+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1380b8070 con 0x7fa14413d0c0 2023-11-29T03:15:33.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.921+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa138003970 con 0x7fa14413d0c0 2023-11-29T03:15:33.923 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.921+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa14406db00 con 0x7fa14413d0c0 2023-11-29T03:15:33.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.921+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1441593e0 con 0x7fa14413d0c0 2023-11-29T03:15:33.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.921+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa138003d20 con 0x7fa14413d0c0 2023-11-29T03:15:33.929 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.925+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa14406d680 con 0x7fa14413d0c0 2023-11-29T03:15:33.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.937+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fa1380b2040 con 0x7fa14413d0c0 2023-11-29T03:15:33.940 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.937+0000 7fa12bfff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa1300668d0 0x7fa130068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:33.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.937+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa13811d550 con 0x7fa14413d0c0 2023-11-29T03:15:33.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.941+0000 7fa142ffd640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa1300668d0 0x7fa130068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:33.945 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.941+0000 7fa142ffd640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa1300668d0 0x7fa130068d90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa134011310 tx=0x7fa134009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:33.947 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:33.945+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa14406d680 con 0x7fa14413d0c0 2023-11-29T03:15:34.213 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.209+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa14406d990 con 0x7fa1300668d0 2023-11-29T03:15:34.216 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.213+0000 7fa12bfff640 1 -- 172.21.15.16:0/2442720107 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49422 (secure 0 0 0) 0x7fa14406d990 con 0x7fa1300668d0 2023-11-29T03:15:34.217 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:34.218 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-29T03:15:34.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.217+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa1300668d0 msgr2=0x7fa130068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.217+0000 7fa143fff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa1300668d0 0x7fa130068d90 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fa134011310 tx=0x7fa134009190 comp rx=0 tx=0).stop 2023-11-29T03:15:34.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.217+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa14413d0c0 msgr2=0x7fa14413a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.217+0000 7fa143fff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa14413d0c0 0x7fa14413a7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1380ab000 tx=0x7fa138019190 comp rx=0 tx=0).stop 2023-11-29T03:15:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 shutdown_connections 2023-11-29T03:15:34.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fa14415a7c0 0x7fa1441363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fa1300668d0 0x7fa130068d90 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa14413d0c0 0x7fa14413a7a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 --2- 172.21.15.16:0/2442720107 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fa1440713e0 0x7fa14413a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 >> 172.21.15.16:0/2442720107 conn(0x7fa1440b0c30 msgr2=0x7fa14415abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:34.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 shutdown_connections 2023-11-29T03:15:34.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.221+0000 7fa143fff640 1 -- 172.21.15.16:0/2442720107 wait complete. 2023-11-29T03:15:34.247 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":17309,"stamp":"2023-11-29T03:15:32.742166+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":23990608,"kb_used_data":11446320,"kb_used_omap":36860,"kb_used_meta":12384259,"kb_avail":730984112,"statfs":{"total":773094113280,"available":748527730688,"internally_reserved":0,"allocated":11721031680,"data_stored":11714934787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37745340,"internal_metadata":12681481540},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3544,"apply_latency_ms":3544,"commit_latency_ns":3544000000,"apply_latency_ns":3544000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.864221"},"pg_stats":[{"pgid":"1.0","version":"37'161","reported_seq":521,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-11-29T03:15:18.960057+0000","last_change":"2023-11-28T17:39:24.135543+0000","last_active":"2023-11-29T03:15:18.960057+0000","last_peered":"2023-11-29T03:15:18.960057+0000","last_clean":"2023-11-29T03:15:18.960057+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-29T03:15:18.960057+0000","last_undegraded":"2023-11-29T03:15:18.960057+0000","last_fullsized":"2023-11-29T03:15:18.960057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T17:39:22.830011+0000","last_clean_scrub_stamp":"2023-11-28T17:39:22.830011+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:00:26.953064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516342,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2979348,"kb_used_data":1567740,"kb_used_omap":5738,"kb_used_meta":1347477,"kb_avail":91392492,"statfs":{"total":96636764160,"available":93585911808,"internally_reserved":0,"allocated":1605365760,"data_stored":1604504970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5876368,"internal_metadata":1379816816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":193,"apply_latency_ms":193,"commit_latency_ns":193000000,"apply_latency_ns":193000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.2669999999999999,"15min":1.248},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":6.3360000000000003,"5min":6.3360000000000003,"15min":6.665},"last":3.9500000000000002},{"interface":"front","average":{"1min":1.831,"5min":1.4019999999999999,"15min":1.4359999999999999},"min":{"1min":0.48399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":5.1829999999999998,"5min":5.1829999999999998,"15min":8.4800000000000004},"last":4.1539999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3779999999999999,"15min":1.4890000000000001},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.6069999999999993},"last":4.3319999999999999},{"interface":"front","average":{"1min":1.794,"5min":1.4690000000000001,"15min":1.4379999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":8.6630000000000003},"last":6.7770000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.6950000000000001,"15min":1.502},"min":{"1min":0.50700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":3.9409999999999998,"5min":8.1790000000000003,"15min":11.333},"last":13.279},{"interface":"front","average":{"1min":2.278,"5min":1.8220000000000001,"15min":1.6339999999999999},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":12.827,"5min":12.827,"15min":12.827},"last":13.237}]},{"osd":3,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":3.2749999999999999,"5min":1.9219999999999999,"15min":1.6799999999999999},"min":{"1min":0.67200000000000004,"5min":0.44600000000000001,"15min":0.439},"max":{"1min":25.420000000000002,"5min":25.420000000000002,"15min":25.420000000000002},"last":6.9889999999999999},{"interface":"front","average":{"1min":2.988,"5min":1.9139999999999999,"15min":1.7130000000000001},"min":{"1min":0.78200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":26.690000000000001,"5min":26.690000000000001,"15min":26.690000000000001},"last":6.1959999999999997}]},{"osd":4,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.83299999999999996,"15min":0.747},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":11.890000000000001,"5min":11.890000000000001,"15min":11.890000000000001},"last":7.3970000000000002},{"interface":"front","average":{"1min":2.3860000000000001,"5min":1.1379999999999999,"15min":0.878},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":32.695,"5min":32.695,"15min":32.695},"last":6.2450000000000001}]},{"osd":5,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":0.89700000000000002},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35999999999999999},"max":{"1min":1.909,"5min":3.637,"15min":6.8789999999999996},"last":6.3049999999999997},{"interface":"front","average":{"1min":1.109,"5min":0.97499999999999998,"15min":0.89900000000000002},"min":{"1min":0.502,"5min":0.45600000000000002,"15min":0.44500000000000001},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.8049999999999997},"last":7.194}]},{"osd":7,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.3250000000000002,"5min":4.6639999999999997,"15min":4.7270000000000003},"last":13.180999999999999},{"interface":"front","average":{"1min":1.117,"5min":0.95399999999999996,"15min":0.89700000000000002},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":5.4480000000000004}]}]},{"osd":5,"up_from":15,"seq":64424516346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286348,"kb_used_data":1028,"kb_used_omap":3640,"kb_used_meta":1281671,"kb_avail":93085492,"statfs":{"total":96636764160,"available":95319543808,"internally_reserved":0,"allocated":1052672,"data_stored":771947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3727398,"internal_metadata":1312432090},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1563,"apply_latency_ms":1563,"commit_latency_ns":1563000000,"apply_latency_ns":1563000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.232,"5min":1.413,"15min":1.3280000000000001},"min":{"1min":0.40000000000000002,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":3.9180000000000001,"5min":12.811999999999999,"15min":12.811999999999999},"last":1.385},{"interface":"front","average":{"1min":1.742,"5min":1.3859999999999999,"15min":1.407},"min":{"1min":0.438,"5min":0.35799999999999998,"15min":0.35499999999999998},"max":{"1min":5.3259999999999996,"5min":7.3369999999999997,"15min":7.3369999999999997},"last":0.54600000000000004}]},{"osd":1,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":2.073,"5min":1.641,"15min":1.55},"min":{"1min":0.60199999999999998,"5min":0.41799999999999998,"15min":0.37},"max":{"1min":11.077,"5min":11.077,"15min":11.077},"last":0.97899999999999998},{"interface":"front","average":{"1min":2.073,"5min":1.554,"15min":1.4319999999999999},"min":{"1min":0.61599999999999999,"5min":0.38,"15min":0.38},"max":{"1min":8.2520000000000007,"5min":8.9410000000000007,"15min":8.9410000000000007},"last":1.2010000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":2.0800000000000001,"5min":1.9119999999999999,"15min":1.6259999999999999},"min":{"1min":0.63100000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":7.6790000000000003,"5min":12.478,"15min":12.478},"last":0.64100000000000001},{"interface":"front","average":{"1min":2.335,"5min":1.8819999999999999,"15min":1.776},"min":{"1min":0.66800000000000004,"5min":0.502,"15min":0.43099999999999999},"max":{"1min":8.7309999999999999,"5min":8.7309999999999999,"15min":8.7309999999999999},"last":0.72099999999999997}]},{"osd":3,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.9059999999999999,"5min":1.9299999999999999,"15min":1.7290000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.51300000000000001},"max":{"1min":7.3659999999999997,"5min":7.3659999999999997,"15min":7.3659999999999997},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.7909999999999999,"5min":1.8859999999999999,"15min":1.7090000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.55500000000000005},"max":{"1min":6.157,"5min":6.742,"15min":7.1379999999999999},"last":0.95099999999999996}]},{"osd":4,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.79200000000000004,"15min":0.78200000000000003},"min":{"1min":0.35099999999999998,"5min":0.34699999999999998,"15min":0.29799999999999999},"max":{"1min":2.581,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.90000000000000002,"15min":0.84899999999999998},"min":{"1min":0.47499999999999998,"5min":0.46100000000000002,"15min":0.41599999999999998},"max":{"1min":4.1500000000000004,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":0.48599999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.86799999999999999,"15min":0.87},"min":{"1min":0.504,"5min":0.40200000000000002,"15min":0.34000000000000002},"max":{"1min":6.0129999999999999,"5min":6.0129999999999999,"15min":6.0129999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.88600000000000001,"15min":0.873},"min":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.39100000000000001},"max":{"1min":2.54,"5min":7.8019999999999996,"15min":7.8019999999999996},"last":0.56299999999999994}]},{"osd":7,"last update":"Wed Nov 29 03:14:43 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":0.93600000000000005,"15min":0.91100000000000003},"min":{"1min":0.47199999999999998,"5min":0.38,"15min":0.371},"max":{"1min":7.0780000000000003,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":1.115,"5min":0.98099999999999998,"15min":0.97099999999999997},"min":{"1min":0.51000000000000001,"5min":0.42299999999999999,"15min":0.39400000000000002},"max":{"1min":6.0919999999999996,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.52200000000000002}]}]},{"osd":4,"up_from":15,"seq":64424516340,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1876628,"kb_used_data":190412,"kb_used_omap":5001,"kb_used_meta":1681206,"kb_avail":92495212,"statfs":{"total":96636764160,"available":94715097088,"internally_reserved":0,"allocated":194981888,"data_stored":194638733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5121709,"internal_metadata":1721555283},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":207,"apply_latency_ms":207,"commit_latency_ns":207000000,"apply_latency_ns":207000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.2949999999999999,"15min":1.359},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":5.96,"5min":6.3280000000000003,"15min":12.282},"last":1.5389999999999999},{"interface":"front","average":{"1min":2.3100000000000001,"5min":1.665,"15min":1.5820000000000001},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":21.513000000000002,"5min":21.513000000000002,"15min":21.513000000000002},"last":11.977}]},{"osd":1,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.637,"15min":1.6850000000000001},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.46300000000000002},"max":{"1min":7.3650000000000002,"5min":7.3650000000000002,"15min":9.1530000000000005},"last":1.4770000000000001},{"interface":"front","average":{"1min":2.3980000000000001,"5min":1.675,"15min":1.7330000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.4059999999999997,"5min":7.4059999999999997,"15min":9.1859999999999999},"last":1.5169999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.351,"15min":1.5509999999999999},"min":{"1min":0.57799999999999996,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":3.448,"5min":4,"15min":10.791},"last":1.5549999999999999},{"interface":"front","average":{"1min":2.4409999999999998,"5min":1.752,"15min":1.649},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.40799999999999997},"max":{"1min":7.9189999999999996,"5min":7.9189999999999996,"15min":7.9189999999999996},"last":4.4729999999999999}]},{"osd":3,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6359999999999999,"15min":1.575},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":4.6390000000000002,"5min":6.4279999999999999,"15min":8.5470000000000006},"last":6.2770000000000001},{"interface":"front","average":{"1min":1.829,"5min":1.8049999999999999,"15min":1.6830000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":7.2489999999999997,"5min":7.2489999999999997,"15min":8.3309999999999995},"last":12.102}]},{"osd":5,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":7.2229999999999999,"5min":7.2229999999999999,"15min":7.2229999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":4.6799999999999997,"5min":4.6799999999999997,"15min":5.1890000000000001},"last":0.59299999999999997}]},{"osd":6,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71999999999999997,"15min":0.77800000000000002},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":3.383,"5min":3.383,"15min":5.6660000000000004},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":0.90900000000000003,"15min":0.877},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.39500000000000002},"max":{"1min":7.2759999999999998,"5min":7.2759999999999998,"15min":7.2759999999999998},"last":1.3979999999999999}]},{"osd":7,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.432,"15min":0.376},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":0.98399999999999999,"15min":0.93999999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44400000000000001},"max":{"1min":7.319,"5min":7.319,"15min":7.319},"last":1.3520000000000001}]}]},{"osd":3,"up_from":15,"seq":64424516299,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6057072,"kb_used_data":4277280,"kb_used_omap":6687,"kb_used_meta":1773088,"kb_avail":88314768,"statfs":{"total":96636764160,"available":90434322432,"internally_reserved":0,"allocated":4379934720,"data_stored":4378307260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6847688,"internal_metadata":1815642936},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":246,"apply_latency_ms":246,"commit_latency_ns":246000000,"apply_latency_ns":246000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2709999999999999,"5min":2.383,"15min":2.3530000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.41999999999999998},"max":{"1min":4.6719999999999997,"5min":9.8610000000000007,"15min":11.345000000000001},"last":7.569},{"interface":"front","average":{"1min":3.5859999999999999,"5min":2.6539999999999999,"15min":2.4940000000000002},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.31},"max":{"1min":9.6219999999999999,"5min":11.801,"15min":11.801},"last":10.186999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.6760000000000002,"15min":2.645},"min":{"1min":0.76300000000000001,"5min":0.53300000000000003,"15min":0.40100000000000002},"max":{"1min":4.867,"5min":11.289,"15min":11.289},"last":1.1910000000000001},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.931,"15min":2.8090000000000002},"min":{"1min":0.73899999999999999,"5min":0.57099999999999995,"15min":0.48799999999999999},"max":{"1min":5.8179999999999996,"5min":19.702999999999999,"15min":19.702999999999999},"last":2.1219999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.4020000000000001,"5min":3.1059999999999999,"15min":3.0049999999999999},"min":{"1min":0.73199999999999998,"5min":0.71099999999999997,"15min":0.51900000000000002},"max":{"1min":5.5039999999999996,"5min":12.75,"15min":12.75},"last":1.3049999999999999},{"interface":"front","average":{"1min":3.29,"5min":3.0950000000000002,"15min":2.948},"min":{"1min":0.93899999999999995,"5min":0.77900000000000003,"15min":0.46600000000000003},"max":{"1min":14.326000000000001,"5min":14.962,"15min":14.962},"last":2.2469999999999999}]},{"osd":4,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.165,"15min":2.21},"min":{"1min":0.73299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":8.5289999999999999,"5min":8.5289999999999999,"15min":9.1799999999999997},"last":4.5759999999999996},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.4529999999999998,"15min":2.3900000000000001},"min":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.55300000000000005},"max":{"1min":5.1840000000000002,"5min":7.5700000000000003,"15min":8.5679999999999996},"last":2.387}]},{"osd":5,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.5649999999999999,"15min":2.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.60799999999999998},"max":{"1min":5.2949999999999999,"5min":7.6280000000000001,"15min":8.6910000000000007},"last":2.4830000000000001},{"interface":"front","average":{"1min":2.0790000000000002,"5min":2.3420000000000001,"15min":2.3929999999999998},"min":{"1min":0.78700000000000003,"5min":0.624,"15min":0.52100000000000002},"max":{"1min":4.931,"5min":9.6920000000000002,"15min":10.722},"last":7.4459999999999997}]},{"osd":6,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":2.363,"15min":2.3879999999999999},"min":{"1min":0.81999999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":8.6440000000000001,"5min":8.6440000000000001,"15min":9.3770000000000007},"last":8.9209999999999994},{"interface":"front","average":{"1min":2.3610000000000002,"5min":2.694,"15min":2.6539999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.59599999999999997},"max":{"1min":5.4029999999999996,"5min":7.9139999999999997,"15min":8.7949999999999999},"last":10.250999999999999}]},{"osd":7,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2389999999999999,"5min":2.556,"15min":2.569},"min":{"1min":0.79400000000000004,"5min":0.66000000000000003,"15min":0.56000000000000005},"max":{"1min":5.0460000000000003,"5min":10.939,"15min":10.939},"last":21.25},{"interface":"front","average":{"1min":3.3279999999999998,"5min":2.5289999999999999,"15min":2.5609999999999999},"min":{"1min":0.77700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":8.7479999999999993,"5min":8.7479999999999993,"15min":9.5099999999999998},"last":17.382999999999999}]}]},{"osd":2,"up_from":15,"seq":64424516290,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2041552,"kb_used_data":794888,"kb_used_omap":3496,"kb_used_meta":1243159,"kb_avail":92330288,"statfs":{"total":96636764160,"available":94546214912,"internally_reserved":0,"allocated":813965312,"data_stored":813452138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3580142,"internal_metadata":1272995602},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":259,"apply_latency_ms":259,"commit_latency_ns":259000000,"apply_latency_ns":259000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.1339999999999999,"5min":4.2690000000000001,"15min":2.98},"min":{"1min":0.58999999999999997,"5min":0.46200000000000002,"15min":0.309},"max":{"1min":28.393999999999998,"5min":158.864,"15min":158.864},"last":0.71799999999999997},{"interface":"front","average":{"1min":2.3610000000000002,"5min":4.1740000000000004,"15min":3.0990000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.48999999999999999},"max":{"1min":8.3040000000000003,"5min":156.66200000000001,"15min":156.66200000000001},"last":1.151}]},{"osd":1,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0569999999999999,"5min":2.6669999999999998,"15min":2.6970000000000001},"min":{"1min":0.57299999999999995,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":12.154,"5min":17.699999999999999,"15min":17.699999999999999},"last":6.3040000000000003},{"interface":"front","average":{"1min":2.7040000000000002,"5min":2.8610000000000002,"15min":2.706},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":6.8259999999999996,"5min":18.989999999999998,"15min":18.989999999999998},"last":2.399}]},{"osd":3,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1219999999999999,"5min":2.5590000000000002,"15min":2.5},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.48799999999999999},"max":{"1min":4.3499999999999996,"5min":11.087999999999999,"15min":11.087999999999999},"last":2.7610000000000001},{"interface":"front","average":{"1min":3.5139999999999998,"5min":2.9169999999999998,"15min":2.887},"min":{"1min":0.67400000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.266,"5min":12.266,"15min":12.792999999999999},"last":6.0700000000000003}]},{"osd":4,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":2.2010000000000001,"15min":2.1899999999999999},"min":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.44500000000000001},"max":{"1min":5.7110000000000003,"5min":7.5780000000000003,"15min":7.5780000000000003},"last":1.198},{"interface":"front","average":{"1min":2.04,"5min":2.105,"15min":2.137},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.3730000000000002,"5min":5.9770000000000003,"15min":9.3719999999999999},"last":1.917}]},{"osd":5,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.399,"5min":2.5920000000000001,"15min":2.3439999999999999},"min":{"1min":0.65400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":28.186,"5min":28.186,"15min":28.186},"last":5.9299999999999997},{"interface":"front","average":{"1min":2.181,"5min":2.3439999999999999,"15min":2.3439999999999999},"min":{"1min":0.65100000000000002,"5min":0.54100000000000004,"15min":0.48299999999999998},"max":{"1min":5.9909999999999997,"5min":7.8209999999999997,"15min":9.5350000000000001},"last":1.276}]},{"osd":6,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1789999999999998,"5min":2.2599999999999998,"15min":2.343},"min":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.4850000000000003,"5min":6.181,"15min":9.5020000000000007},"last":2.0649999999999999},{"interface":"front","average":{"1min":3.5619999999999998,"5min":2.843,"15min":2.5720000000000001},"min":{"1min":0.83499999999999996,"5min":0.629,"15min":0.48699999999999999},"max":{"1min":28.300999999999998,"5min":28.300999999999998,"15min":28.300999999999998},"last":6.1950000000000003}]},{"osd":7,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":2.5510000000000002,"15min":2.516},"min":{"1min":1.0369999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.6270000000000007,"5min":8.6270000000000007,"15min":9.3109999999999999},"last":1.236},{"interface":"front","average":{"1min":2.3959999999999999,"5min":2.3799999999999999,"15min":2.4990000000000001},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.5789999999999997,"5min":6.2759999999999998,"15min":9.5790000000000006},"last":2.1819999999999999}]}]},{"osd":1,"up_from":15,"seq":64424516309,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2232432,"kb_used_data":528064,"kb_used_omap":3411,"kb_used_meta":1685804,"kb_avail":92139408,"statfs":{"total":96636764160,"available":94350753792,"internally_reserved":0,"allocated":540737536,"data_stored":540275355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3493385,"internal_metadata":1726263799},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":662,"apply_latency_ms":662,"commit_latency_ns":662000000,"apply_latency_ns":662000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.5310000000000001,"15min":2.5489999999999999},"min":{"1min":0.52700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":11.449,"5min":11.505000000000001,"15min":14.603999999999999},"last":8.7639999999999993},{"interface":"front","average":{"1min":2.9489999999999998,"5min":2.5529999999999999,"15min":2.5739999999999998},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.41599999999999998},"max":{"1min":6.9420000000000002,"5min":11.196999999999999,"15min":12.343},"last":2.3980000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.7759999999999998,"15min":2.6499999999999999},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":25.795000000000002,"5min":25.795000000000002,"15min":25.795000000000002},"last":2.496},{"interface":"front","average":{"1min":3.8460000000000001,"5min":2.944,"15min":2.774},"min":{"1min":0.629,"5min":0.56799999999999995,"15min":0.41499999999999998},"max":{"1min":14.885,"5min":14.885,"15min":14.885},"last":8.5389999999999997}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2629999999999999,"5min":3.2330000000000001,"15min":3.024},"min":{"1min":0.91000000000000003,"5min":0.57899999999999996,"15min":0.42499999999999999},"max":{"1min":16.693999999999999,"5min":16.693999999999999,"15min":16.722999999999999},"last":8.6509999999999998},{"interface":"front","average":{"1min":3.5489999999999999,"5min":3.1989999999999998,"15min":3.0270000000000001},"min":{"1min":0.98299999999999998,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":10.692,"5min":10.692,"15min":12.992000000000001},"last":2.5600000000000001}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.6139999999999999,"15min":2.3199999999999998},"min":{"1min":0.66100000000000003,"5min":0.58299999999999996,"15min":0.56799999999999995},"max":{"1min":27.562000000000001,"5min":27.562000000000001,"15min":27.562000000000001},"last":2.3660000000000001},{"interface":"front","average":{"1min":2.5649999999999999,"5min":2.3900000000000001,"15min":2.327},"min":{"1min":0.67800000000000005,"5min":0.52000000000000002,"15min":0.505},"max":{"1min":9.8710000000000004,"5min":11.590999999999999,"15min":12.345000000000001},"last":8.3019999999999996}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.492,"5min":2.1720000000000002,"15min":2.3799999999999999},"min":{"1min":0.69699999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":6.758,"5min":6.8280000000000003,"15min":11.984},"last":0.90600000000000003},{"interface":"front","average":{"1min":2.7160000000000002,"5min":2.6059999999999999,"15min":2.46},"min":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.58999999999999997},"max":{"1min":25.920999999999999,"5min":25.920999999999999,"15min":25.920999999999999},"last":2.3069999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.637,"5min":2.2599999999999998,"15min":2.5249999999999999},"min":{"1min":0.78500000000000003,"5min":0.65000000000000002,"15min":0.53400000000000003},"max":{"1min":7.1280000000000001,"5min":7.1280000000000001,"15min":12.113},"last":0.85999999999999999},{"interface":"front","average":{"1min":2.8519999999999999,"5min":2.8620000000000001,"15min":2.6200000000000001},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.55400000000000005},"max":{"1min":26.326000000000001,"5min":26.326000000000001,"15min":26.326000000000001},"last":2.4550000000000001}]},{"osd":7,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.7709999999999999,"5min":2.4769999999999999,"15min":2.4940000000000002},"min":{"1min":0.72399999999999998,"5min":0.55700000000000005,"15min":0.49199999999999999},"max":{"1min":10.005000000000001,"5min":11.557,"15min":12.457000000000001},"last":8.4239999999999995},{"interface":"front","average":{"1min":2.7309999999999999,"5min":2.4489999999999998,"15min":2.637},"min":{"1min":1.0189999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.2300000000000004,"5min":7.2300000000000004,"15min":12.210000000000001},"last":0.94299999999999995}]}]},{"osd":0,"up_from":15,"seq":64424516302,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5774436,"kb_used_data":4086460,"kb_used_omap":5919,"kb_used_meta":1632480,"kb_avail":88597404,"statfs":{"total":96636764160,"available":90723741696,"internally_reserved":0,"allocated":4184535040,"data_stored":4182802805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6061868,"internal_metadata":1671659732},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":163,"apply_latency_ms":163,"commit_latency_ns":163000000,"apply_latency_ns":163000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.516,"5min":2.9329999999999998,"15min":2.4460000000000002},"min":{"1min":0.748,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":9.7439999999999998,"5min":15.596,"15min":15.596},"last":5.75},{"interface":"front","average":{"1min":2.6070000000000002,"5min":2.9740000000000002,"15min":2.7069999999999999},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.36699999999999999},"max":{"1min":6.6710000000000003,"5min":12.222,"15min":12.621},"last":2.5190000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.9060000000000001,"15min":3.0459999999999998},"min":{"1min":0.60599999999999998,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":5.085,"5min":12.913,"15min":61.551000000000002},"last":5.6500000000000004},{"interface":"front","average":{"1min":3.3260000000000001,"5min":3.2719999999999998,"15min":3.202},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.434},"max":{"1min":7.0350000000000001,"5min":12.842000000000001,"15min":61.359999999999999},"last":2.774}]},{"osd":3,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.6880000000000002,"15min":2.6280000000000001},"min":{"1min":0.74099999999999999,"5min":0.436,"15min":0.433},"max":{"1min":6.7919999999999998,"5min":12.379,"15min":12.379},"last":9.6880000000000006},{"interface":"front","average":{"1min":2.653,"5min":3.3759999999999999,"15min":3.0510000000000002},"min":{"1min":0.85699999999999998,"5min":0.60899999999999999,"15min":0.54300000000000004},"max":{"1min":9.1210000000000004,"5min":16.524999999999999,"15min":16.524999999999999},"last":12.052}]},{"osd":4,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.6869999999999998,"15min":2.3370000000000002},"min":{"1min":0.58099999999999996,"5min":0.53900000000000003,"15min":0.41199999999999998},"max":{"1min":6.3970000000000002,"5min":12.987,"15min":12.987},"last":11.141},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.4870000000000001,"15min":2.359},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.38400000000000001},"max":{"1min":5.6100000000000003,"5min":13.177,"15min":13.177},"last":10.994}]},{"osd":5,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":2.6179999999999999,"15min":2.4319999999999999},"min":{"1min":0.75800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.3079999999999998,"5min":16.318000000000001,"15min":16.318000000000001},"last":5.5369999999999999},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.8889999999999998,"15min":2.5249999999999999},"min":{"1min":0.65800000000000003,"5min":0.57999999999999996,"15min":0.44800000000000001},"max":{"1min":6.4870000000000001,"5min":15.59,"15min":15.59},"last":3.1499999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":2.5739999999999998,"15min":2.8479999999999999},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.434},"max":{"1min":5.6559999999999997,"5min":13.308,"15min":99.003},"last":6.7999999999999998},{"interface":"front","average":{"1min":1.9339999999999999,"5min":2.702,"15min":2.9020000000000001},"min":{"1min":0.80600000000000005,"5min":0.59899999999999998,"15min":0.55500000000000005},"max":{"1min":5.3949999999999996,"5min":16.431999999999999,"15min":97.721000000000004},"last":5.4160000000000004}]},{"osd":7,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.9489999999999998,"15min":2.681},"min":{"1min":0.621,"5min":0.621,"15min":0.56200000000000006},"max":{"1min":6.5739999999999998,"5min":13.103,"15min":13.103},"last":3.1909999999999998},{"interface":"front","average":{"1min":2.3940000000000001,"5min":2.7349999999999999,"15min":2.6459999999999999},"min":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.47699999999999998},"max":{"1min":5.7300000000000004,"5min":13.397,"15min":13.397},"last":6.75}]}]},{"osd":7,"up_from":14,"seq":60129549052,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1742792,"kb_used_data":448,"kb_used_omap":2965,"kb_used_meta":1739370,"kb_avail":92629048,"statfs":{"total":96636764160,"available":94852145152,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3036782,"internal_metadata":1781115282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":251,"apply_latency_ms":251,"commit_latency_ns":251000000,"apply_latency_ns":251000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.456,"15min":1.361},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":5.4039999999999999,"5min":10.583,"15min":10.583},"last":8.5169999999999995},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.7629999999999999,"15min":1.5980000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.317},"max":{"1min":4.3150000000000004,"5min":8.3100000000000005,"15min":8.3100000000000005},"last":1.877}]},{"osd":1,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.5,"15min":1.486},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":4.3410000000000002,"5min":8.2929999999999993,"15min":8.2929999999999993},"last":5.8339999999999996},{"interface":"front","average":{"1min":1.655,"5min":1.802,"15min":1.591},"min":{"1min":0.66600000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.4450000000000003,"5min":18.013000000000002,"15min":18.013000000000002},"last":0.67000000000000004}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.601,"15min":1.587},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.835,"5min":9.2279999999999998,"15min":9.2279999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.355,"5min":1.6910000000000001,"15min":1.585},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"max":{"1min":4.6219999999999999,"5min":8.7949999999999999,"15min":8.7949999999999999},"last":1.1020000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.532,"15min":1.651},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0979999999999999,"5min":6.0979999999999999,"15min":8.7189999999999994},"last":2.1040000000000001},{"interface":"front","average":{"1min":1.647,"5min":1.903,"15min":1.7769999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.47399999999999998},"max":{"1min":4.5990000000000002,"5min":12.199,"15min":12.199},"last":4.5309999999999997}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.29999999999999999},"max":{"1min":3.7890000000000001,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":8.4649999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84799999999999998,"15min":0.79400000000000004},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.32200000000000001},"max":{"1min":3.1379999999999999,"5min":13.602,"15min":13.602},"last":0.73799999999999999}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.86499999999999999},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.32400000000000001},"max":{"1min":1.8779999999999999,"5min":13.058,"15min":13.058},"last":1.036},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.39800000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"max":{"1min":3.835,"5min":3.835,"15min":4.6399999999999997},"last":1.379}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.1399999999999999,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":5.3559999999999999,"5min":20.718,"15min":20.718},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.92400000000000004,"15min":0.872},"min":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.39700000000000002},"max":{"1min":0.91300000000000003,"5min":13.648,"15min":13.648},"last":1.446}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T03:15:34.250 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-29T03:15:34.665 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.661+0000 7f8a4a046640 1 Processor -- start 2023-11-29T03:15:34.666 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.661+0000 7f8a4a046640 1 -- start start 2023-11-29T03:15:34.669 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a4a046640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8a4415d540 0x7f8a440b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:34.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a4a046640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a440d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:34.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a4a046640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a440b32c0 con 0x7f8a440d34c0 2023-11-29T03:15:34.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a4a046640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4415d920 con 0x7f8a4415d540 2023-11-29T03:15:34.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a4a046640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a440b35a0 con 0x7f8a440d1f50 2023-11-29T03:15:34.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a42ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a440d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:34.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a42ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a440d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:36466/0 (socket says 172.21.15.16:36466) 2023-11-29T03:15:34.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a437fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8a4415d540 0x7f8a440b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:34.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a42ffd640 1 -- 172.21.15.16:0/2817275778 learned_addr learned my addr 172.21.15.16:0/2817275778 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:34.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a42ffd640 1 -- 172.21.15.16:0/2817275778 >> v2:172.21.15.64:3300/0 conn(0x7f8a4415d540 msgr2=0x7f8a440b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:34.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.665+0000 7f8a42ffd640 1 --2- 172.21.15.16:0/2817275778 >> v2:172.21.15.64:3300/0 conn(0x7f8a4415d540 0x7f8a440b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.669+0000 7f8a42ffd640 1 -- 172.21.15.16:0/2817275778 >> v1:172.21.15.64:6789/0 conn(0x7f8a440d34c0 legacy=0x7f8a440cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.673 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.669+0000 7f8a42ffd640 1 -- 172.21.15.16:0/2817275778 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a440b3880 con 0x7f8a440d1f50 2023-11-29T03:15:34.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a42ffd640 1 --2- 172.21.15.16:0/2817275778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a440d2f80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009870 tx=0x7f8a3801c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d2fc34c00bf099e server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:34.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a427fc640 1 -- 172.21.15.16:0/2817275778 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380aa670 con 0x7f8a440d1f50 2023-11-29T03:15:34.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a427fc640 1 -- 172.21.15.16:0/2817275778 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a380aa7d0 con 0x7f8a440d1f50 2023-11-29T03:15:34.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a427fc640 1 -- 172.21.15.16:0/2817275778 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a380aab60 con 0x7f8a440d1f50 2023-11-29T03:15:34.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 -- 172.21.15.16:0/2817275778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 msgr2=0x7f8a440d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 --2- 172.21.15.16:0/2817275778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a440d2f80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009870 tx=0x7f8a3801c510 comp rx=0 tx=0).stop 2023-11-29T03:15:34.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 -- 172.21.15.16:0/2817275778 shutdown_connections 2023-11-29T03:15:34.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 --2- 172.21.15.16:0/2817275778 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a440d2f80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 --2- 172.21.15.16:0/2817275778 >> v2:172.21.15.64:3300/0 conn(0x7f8a4415d540 0x7f8a440b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 -- 172.21.15.16:0/2817275778 >> 172.21.15.16:0/2817275778 conn(0x7f8a4408ccf0 msgr2=0x7f8a4409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:34.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.677+0000 7f8a4a046640 1 -- 172.21.15.16:0/2817275778 shutdown_connections 2023-11-29T03:15:34.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 -- 172.21.15.16:0/2817275778 wait complete. 2023-11-29T03:15:34.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 Processor -- start 2023-11-29T03:15:34.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 -- start start 2023-11-29T03:15:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a44150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a440d34c0 0x7f8a44152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:34.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 0x7f8a44152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44153cb0 con 0x7f8a4415d540 2023-11-29T03:15:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a44154140 con 0x7f8a440d34c0 2023-11-29T03:15:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a4a046640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a4415ed10 con 0x7f8a440d1f50 2023-11-29T03:15:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.681+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 0x7f8a44152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:34.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 0x7f8a44152a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:45992/0 (socket says 172.21.15.16:45992) 2023-11-29T03:15:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 -- 172.21.15.16:0/3465766042 learned_addr learned my addr 172.21.15.16:0/3465766042 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a437fe640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a44150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:34.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a42ffd640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a440d34c0 0x7f8a44152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 -- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 msgr2=0x7f8a44150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a44150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 -- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a440d34c0 msgr2=0x7f8a44152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a440d34c0 0x7f8a44152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 -- 172.21.15.16:0/3465766042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380094d0 con 0x7f8a4415d540 2023-11-29T03:15:34.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a42ffd640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a440d34c0 0x7f8a44152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:34.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a43fff640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 0x7f8a44152a90 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c770 tx=0x7f8a3c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:34.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c003b80 con 0x7f8a4415d540 2023-11-29T03:15:34.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a441530a0 con 0x7f8a4415d540 2023-11-29T03:15:34.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c003ce0 con 0x7f8a4415d540 2023-11-29T03:15:34.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c00aa90 con 0x7f8a4415d540 2023-11-29T03:15:34.692 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.685+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a44153660 con 0x7f8a4415d540 2023-11-29T03:15:34.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.689+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a44153e20 con 0x7f8a4415d540 2023-11-29T03:15:34.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.693+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f8a3c00abf0 con 0x7f8a4415d540 2023-11-29T03:15:34.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.697+0000 7f8a2bfff640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8a300668d0 0x7f8a30068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:34.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.697+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8a3c084a10 con 0x7f8a4415d540 2023-11-29T03:15:34.700 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.697+0000 7f8a437fe640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8a300668d0 0x7f8a30068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:34.701 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.697+0000 7f8a437fe640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8a300668d0 0x7f8a30068d90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009ac0 tx=0x7f8a34009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:34.702 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.697+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a3c051f70 con 0x7f8a4415d540 2023-11-29T03:15:34.860 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.857+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a44068860 con 0x7f8a4415d540 2023-11-29T03:15:34.879 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.873+0000 7f8a2bfff640 1 -- 172.21.15.16:0/3465766042 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+12938 (secure 0 0 0) 0x7f8a3c055590 con 0x7f8a4415d540 2023-11-29T03:15:34.879 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:34.879 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":40,"fsid":"412d3c1b-e5e1-47ba-972b-0544ebc8f3e9","created":"2023-11-28T17:39:09.591920+0000","modified":"2023-11-29T03:15:20.832360+0000","last_up_change":"2023-11-28T17:39:21.731862+0000","last_in_change":"2023-11-28T17:39:12.188910+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T17:39:22.827431+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8f568087-e081-4769-848d-db1d71d2e010","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6804","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6807","nonce":4085033533}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6810","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6813","nonce":4085033533}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6821","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6823","nonce":4085033533}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6816","nonce":4085033533},{"type":"v1","addr":"172.21.15.16:6818","nonce":4085033533}]},"public_addr":"172.21.15.16:6807/4085033533","cluster_addr":"172.21.15.16:6813/4085033533","heartbeat_back_addr":"172.21.15.16:6823/4085033533","heartbeat_front_addr":"172.21.15.16:6818/4085033533","state":["exists","up"]},{"osd":1,"uuid":"af5a292a-f288-45ad-b757-67e537bd8d3f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6805","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6808","nonce":1338459427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6811","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6814","nonce":1338459427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6820","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6822","nonce":1338459427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6817","nonce":1338459427},{"type":"v1","addr":"172.21.15.16:6819","nonce":1338459427}]},"public_addr":"172.21.15.16:6808/1338459427","cluster_addr":"172.21.15.16:6814/1338459427","heartbeat_back_addr":"172.21.15.16:6822/1338459427","heartbeat_front_addr":"172.21.15.16:6819/1338459427","state":["exists","up"]},{"osd":2,"uuid":"3215bd2e-926a-43ca-bc5b-05f939f42753","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6800","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6801","nonce":1740423870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6802","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6803","nonce":1740423870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6812","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6815","nonce":1740423870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6806","nonce":1740423870},{"type":"v1","addr":"172.21.15.16:6809","nonce":1740423870}]},"public_addr":"172.21.15.16:6801/1740423870","cluster_addr":"172.21.15.16:6803/1740423870","heartbeat_back_addr":"172.21.15.16:6815/1740423870","heartbeat_front_addr":"172.21.15.16:6809/1740423870","state":["exists","up"]},{"osd":3,"uuid":"9b6d4fe2-2277-4a73-b11f-edd776e4160e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6824","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6825","nonce":2069307542}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6826","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6827","nonce":2069307542}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6830","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6831","nonce":2069307542}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6828","nonce":2069307542},{"type":"v1","addr":"172.21.15.16:6829","nonce":2069307542}]},"public_addr":"172.21.15.16:6825/2069307542","cluster_addr":"172.21.15.16:6827/2069307542","heartbeat_back_addr":"172.21.15.16:6831/2069307542","heartbeat_front_addr":"172.21.15.16:6829/2069307542","state":["exists","up"]},{"osd":4,"uuid":"c465cb78-8f4b-4459-82dd-e88cc2133159","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6808","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6809","nonce":2542652674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6811","nonce":2542652674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6814","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6815","nonce":2542652674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":2542652674},{"type":"v1","addr":"172.21.15.64:6813","nonce":2542652674}]},"public_addr":"172.21.15.64:6809/2542652674","cluster_addr":"172.21.15.64:6811/2542652674","heartbeat_back_addr":"172.21.15.64:6815/2542652674","heartbeat_front_addr":"172.21.15.64:6813/2542652674","state":["exists","up"]},{"osd":5,"uuid":"021b203b-53fe-4900-8ba8-04484048259d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6816","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6817","nonce":1005985598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6819","nonce":1005985598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6823","nonce":1005985598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":1005985598},{"type":"v1","addr":"172.21.15.64:6821","nonce":1005985598}]},"public_addr":"172.21.15.64:6817/1005985598","cluster_addr":"172.21.15.64:6819/1005985598","heartbeat_back_addr":"172.21.15.64:6823/1005985598","heartbeat_front_addr":"172.21.15.64:6821/1005985598","state":["exists","up"]},{"osd":6,"uuid":"bf3d817c-92bc-4766-b6ac-9744af07da37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6824","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6825","nonce":4135110643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6827","nonce":4135110643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6830","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6831","nonce":4135110643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":4135110643},{"type":"v1","addr":"172.21.15.64:6829","nonce":4135110643}]},"public_addr":"172.21.15.64:6825/4135110643","cluster_addr":"172.21.15.64:6827/4135110643","heartbeat_back_addr":"172.21.15.64:6831/4135110643","heartbeat_front_addr":"172.21.15.64:6829/4135110643","state":["exists","up"]},{"osd":7,"uuid":"16dfc0d6-76a7-4073-9451-0df56a576ab2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6801","nonce":946925986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6803","nonce":946925986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6807","nonce":946925986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6804","nonce":946925986},{"type":"v1","addr":"172.21.15.64:6805","nonce":946925986}]},"public_addr":"172.21.15.64:6801/946925986","cluster_addr":"172.21.15.64:6803/946925986","heartbeat_back_addr":"172.21.15.64:6807/946925986","heartbeat_front_addr":"172.21.15.64:6805/946925986","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.880543+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.737475+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.065105+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.117113+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.846594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:18.107523+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.904138+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T17:39:17.724959+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6836/2775576031":"2023-11-30T03:15:15.819757+0000","172.21.15.64:6834/2775576031":"2023-11-30T03:15:15.819757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-29T03:15:34.880 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8a300668d0 msgr2=0x7f8a30068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8a300668d0 0x7f8a30068d90 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009ac0 tx=0x7f8a34009190 comp rx=0 tx=0).stop 2023-11-29T03:15:34.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 msgr2=0x7f8a44152a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:34.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 0x7f8a44152a90 secure :-1 s=READY pgs=3296 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c770 tx=0x7f8a3c00cc30 comp rx=0 tx=0).stop 2023-11-29T03:15:34.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 shutdown_connections 2023-11-29T03:15:34.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f8a4415d540 0x7f8a44152a90 unknown :-1 s=CLOSED pgs=3296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f8a300668d0 0x7f8a30068d90 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a440d34c0 0x7f8a44152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 --2- 172.21.15.16:0/3465766042 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f8a440d1f50 0x7f8a44150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:34.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 >> 172.21.15.16:0/3465766042 conn(0x7f8a4408ccf0 msgr2=0x7f8a44155ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:34.883 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 shutdown_connections 2023-11-29T03:15:34.884 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:34.877+0000 7f8a4a046640 1 -- 172.21.15.16:0/3465766042 wait complete. 2023-11-29T03:15:35.909 INFO:tasks.ceph:Scrubbing osd.0 2023-11-29T03:15:35.909 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:36.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.337+0000 7f5e6e6c9640 1 Processor -- start 2023-11-29T03:15:36.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.337+0000 7f5e6e6c9640 1 -- start start 2023-11-29T03:15:36.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e6e6c9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5e6815d4b0 0x7f5e680b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e6e6c9640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f5e680b6880 0x7f5e6806bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e6e6c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680d23f0 con 0x7f5e6806bff0 2023-11-29T03:15:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e6e6c9640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6806c480 con 0x7f5e680b6880 2023-11-29T03:15:36.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e6e6c9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6815d890 con 0x7f5e6815d4b0 2023-11-29T03:15:36.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5e6815d4b0 0x7f5e680b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5e6815d4b0 0x7f5e680b6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:37056/0 (socket says 172.21.15.16:37056) 2023-11-29T03:15:36.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 -- 172.21.15.16:0/47370922 learned_addr learned my addr 172.21.15.16:0/47370922 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:36.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e677fe640 1 --2- 172.21.15.16:0/47370922 >> v2:172.21.15.16:3300/0 conn(0x7f5e680b6880 0x7f5e6806bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 -- 172.21.15.16:0/47370922 >> v2:172.21.15.16:3300/0 conn(0x7f5e680b6880 msgr2=0x7f5e6806bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 --2- 172.21.15.16:0/47370922 >> v2:172.21.15.16:3300/0 conn(0x7f5e680b6880 0x7f5e6806bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 -- 172.21.15.16:0/47370922 >> v1:172.21.15.16:6789/0 conn(0x7f5e6806bff0 legacy=0x7f5e680d36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e67fff640 1 -- 172.21.15.16:0/47370922 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680d2920 con 0x7f5e6815d4b0 2023-11-29T03:15:36.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.341+0000 7f5e677fe640 1 --2- 172.21.15.16:0/47370922 >> v2:172.21.15.16:3300/0 conn(0x7f5e680b6880 0x7f5e6806bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:36.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e67fff640 1 --2- 172.21.15.16:0/47370922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 0x7f5e680b6340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5e680d0e30 tx=0x7f5e5801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4b6d33d2af3fcc7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e66ffd640 1 -- 172.21.15.16:0/47370922 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580ab640 con 0x7f5e6815d4b0 2023-11-29T03:15:36.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e66ffd640 1 -- 172.21.15.16:0/47370922 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580a7070 con 0x7f5e6815d4b0 2023-11-29T03:15:36.356 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e66ffd640 1 -- 172.21.15.16:0/47370922 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580ab9c0 con 0x7f5e6815d4b0 2023-11-29T03:15:36.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/47370922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 msgr2=0x7f5e680b6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 --2- 172.21.15.16:0/47370922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 0x7f5e680b6340 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5e680d0e30 tx=0x7f5e5801c440 comp rx=0 tx=0).stop 2023-11-29T03:15:36.358 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/47370922 shutdown_connections 2023-11-29T03:15:36.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 --2- 172.21.15.16:0/47370922 >> v2:172.21.15.16:3300/0 conn(0x7f5e680b6880 0x7f5e6806bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 --2- 172.21.15.16:0/47370922 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 0x7f5e680b6340 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/47370922 >> 172.21.15.16:0/47370922 conn(0x7f5e680720d0 msgr2=0x7f5e680724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:36.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/47370922 shutdown_connections 2023-11-29T03:15:36.359 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.353+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/47370922 wait complete. 2023-11-29T03:15:36.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 Processor -- start 2023-11-29T03:15:36.363 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 -- start start 2023-11-29T03:15:36.366 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6806bff0 0x7f5e68149370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e680b6880 0x7f5e6815ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 0x7f5e6814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680c7c50 con 0x7f5e6806bff0 2023-11-29T03:15:36.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680c7f30 con 0x7f5e6815d4b0 2023-11-29T03:15:36.367 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e6e6c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68149c40 con 0x7f5e680b6880 2023-11-29T03:15:36.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6806bff0 0x7f5e68149370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e67fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6806bff0 0x7f5e68149370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:46018/0 (socket says 172.21.15.16:46018) 2023-11-29T03:15:36.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.361+0000 7f5e67fff640 1 -- 172.21.15.16:0/578263980 learned_addr learned my addr 172.21.15.16:0/578263980 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:36.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e677fe640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e680b6880 0x7f5e6815ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.368 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e6cc66640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 0x7f5e6814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e67fff640 1 -- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e680b6880 msgr2=0x7f5e6815ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.370 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e67fff640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e680b6880 0x7f5e6815ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e67fff640 1 -- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 msgr2=0x7f5e6814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e67fff640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5e6815d4b0 0x7f5e6814f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e67fff640 1 -- 172.21.15.16:0/578263980 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c009420 con 0x7f5e6806bff0 2023-11-29T03:15:36.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e677fe640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5e680b6880 0x7f5e6815ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:36.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e67fff640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6806bff0 0x7f5e68149370 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ad040 tx=0x7f5e5801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.371 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580be3f0 con 0x7f5e6806bff0 2023-11-29T03:15:36.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580be570 con 0x7f5e6806bff0 2023-11-29T03:15:36.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580be920 con 0x7f5e6806bff0 2023-11-29T03:15:36.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e580094d0 con 0x7f5e6806bff0 2023-11-29T03:15:36.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.365+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e681498b0 con 0x7f5e6806bff0 2023-11-29T03:15:36.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.369+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e68068860 con 0x7f5e6806bff0 2023-11-29T03:15:36.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.369+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f5e580c7440 con 0x7f5e6806bff0 2023-11-29T03:15:36.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e64ff9640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5e540668d0 0x7f5e54068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.375 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5e5811ed40 con 0x7f5e6806bff0 2023-11-29T03:15:36.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e64ff9640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f5e5406c730 0x7f5e5406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 --> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e5406f200 con 0x7f5e5406c730 2023-11-29T03:15:36.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e5811f190 con 0x7f5e6806bff0 2023-11-29T03:15:36.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e677fe640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5e540668d0 0x7f5e54068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e6cc66640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f5e5406c730 0x7f5e5406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e677fe640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5e540668d0 0x7f5e54068d90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5e68150b80 tx=0x7f5e5c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.373+0000 7f5e6cc66640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f5e5406c730 0x7f5e5406eb50 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.401+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== osd.0 v2:172.21.15.16:6804/4085033533 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5e5406f200 con 0x7f5e5406c730 2023-11-29T03:15:36.419 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.417+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 --> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5e680c9df0 con 0x7f5e5406c730 2023-11-29T03:15:36.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.429+0000 7f5e64ff9640 1 -- 172.21.15.16:0/578263980 <== osd.0 v2:172.21.15.16:6804/4085033533 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5e680c9df0 con 0x7f5e5406c730 2023-11-29T03:15:36.434 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:36.435 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:36.435 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:36.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.429+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f5e5406c730 msgr2=0x7f5e5406eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.429+0000 7f5e6e6c9640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:6804/4085033533,v1:172.21.15.16:6807/4085033533] conn(0x7f5e5406c730 0x7f5e5406eb50 crc :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5e540668d0 msgr2=0x7f5e54068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f5e540668d0 0x7f5e54068d90 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f5e68150b80 tx=0x7f5e5c008040 comp rx=0 tx=0).stop 2023-11-29T03:15:36.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6806bff0 msgr2=0x7f5e68149370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 --2- 172.21.15.16:0/578263980 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5e6806bff0 0x7f5e68149370 secure :-1 s=READY pgs=3298 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ad040 tx=0x7f5e5801ac80 comp rx=0 tx=0).stop 2023-11-29T03:15:36.437 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6cc66640 1 -- 172.21.15.16:0/578263980 reap_dead start 2023-11-29T03:15:36.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 shutdown_connections 2023-11-29T03:15:36.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 >> 172.21.15.16:0/578263980 conn(0x7f5e680720d0 msgr2=0x7f5e6815d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:36.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 shutdown_connections 2023-11-29T03:15:36.438 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.433+0000 7f5e6e6c9640 1 -- 172.21.15.16:0/578263980 wait complete. 2023-11-29T03:15:36.470 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-29T03:15:36.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.889+0000 7f3c5e365640 1 Processor -- start 2023-11-29T03:15:36.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.889+0000 7f3c5e365640 1 -- start start 2023-11-29T03:15:36.896 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c5e365640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3c58143ab0 0x7f3c580ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c5e365640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c580cc930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c5e365640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c58143e90 con 0x7f3c580cce70 2023-11-29T03:15:36.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c5e365640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c580cd2c0 con 0x7f3c58143ab0 2023-11-29T03:15:36.897 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c5e365640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c580cf210 con 0x7f3c58071fd0 2023-11-29T03:15:36.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c580cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c57fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3c58143ab0 0x7f3c580ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c580cc930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:36484/0 (socket says 172.21.15.16:36484) 2023-11-29T03:15:36.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 -- 172.21.15.16:0/1824576240 learned_addr learned my addr 172.21.15.16:0/1824576240 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:36.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 -- 172.21.15.16:0/1824576240 >> v2:172.21.15.64:3300/0 conn(0x7f3c58143ab0 msgr2=0x7f3c580ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:36.899 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 --2- 172.21.15.16:0/1824576240 >> v2:172.21.15.64:3300/0 conn(0x7f3c58143ab0 0x7f3c580ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 -- 172.21.15.16:0/1824576240 >> v1:172.21.15.16:6789/0 conn(0x7f3c580cce70 legacy=0x7f3c5806ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:36.900 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.893+0000 7f3c4ffff640 1 -- 172.21.15.16:0/1824576240 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580714f0 con 0x7f3c58071fd0 2023-11-29T03:15:36.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.897+0000 7f3c4ffff640 1 --2- 172.21.15.16:0/1824576240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c580cc930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009870 tx=0x7f3c4001c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8ef74e55e667c server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.897+0000 7f3c577fe640 1 -- 172.21.15.16:0/1824576240 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400ab600 con 0x7f3c58071fd0 2023-11-29T03:15:36.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.897+0000 7f3c577fe640 1 -- 172.21.15.16:0/1824576240 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400ab760 con 0x7f3c58071fd0 2023-11-29T03:15:36.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.897+0000 7f3c577fe640 1 -- 172.21.15.16:0/1824576240 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400abaf0 con 0x7f3c58071fd0 2023-11-29T03:15:36.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 -- 172.21.15.16:0/1824576240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 msgr2=0x7f3c580cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 --2- 172.21.15.16:0/1824576240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c580cc930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009870 tx=0x7f3c4001c440 comp rx=0 tx=0).stop 2023-11-29T03:15:36.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 -- 172.21.15.16:0/1824576240 shutdown_connections 2023-11-29T03:15:36.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 --2- 172.21.15.16:0/1824576240 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c580cc930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 --2- 172.21.15.16:0/1824576240 >> v2:172.21.15.64:3300/0 conn(0x7f3c58143ab0 0x7f3c580ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 -- 172.21.15.16:0/1824576240 >> 172.21.15.16:0/1824576240 conn(0x7f3c580cff80 msgr2=0x7f3c580d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:36.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 -- 172.21.15.16:0/1824576240 shutdown_connections 2023-11-29T03:15:36.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.901+0000 7f3c5e365640 1 -- 172.21.15.16:0/1824576240 wait complete. 2023-11-29T03:15:36.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.905+0000 7f3c5e365640 1 Processor -- start 2023-11-29T03:15:36.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.905+0000 7f3c5e365640 1 -- start start 2023-11-29T03:15:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5e365640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c58139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5e365640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 0x7f3c58156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5e365640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c58143ab0 0x7f3c58156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5e365640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58139f70 con 0x7f3c58143ab0 2023-11-29T03:15:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5e365640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58155f70 con 0x7f3c580cce70 2023-11-29T03:15:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5e365640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c58156940 con 0x7f3c58071fd0 2023-11-29T03:15:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 0x7f3c58156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c57fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c58139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 0x7f3c58156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56320/0 (socket says 172.21.15.16:56320) 2023-11-29T03:15:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 -- 172.21.15.16:0/3513454238 learned_addr learned my addr 172.21.15.16:0/3513454238 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:36.915 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c5c902640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c58143ab0 0x7f3c58156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 -- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 msgr2=0x7f3c58139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c58139a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 -- 172.21.15.16:0/3513454238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c58143ab0 msgr2=0x7f3c58156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:36.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c58143ab0 0x7f3c58156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:36.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 -- 172.21.15.16:0/3513454238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c400094d0 con 0x7f3c580cce70 2023-11-29T03:15:36.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c57fff640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c58139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:36.917 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.909+0000 7f3c4ffff640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 0x7f3c58156400 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c4001aaf0 tx=0x7f3c400191e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400b4800 con 0x7f3c580cce70 2023-11-29T03:15:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400b4960 con 0x7f3c580cce70 2023-11-29T03:15:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400b4d10 con 0x7f3c580cce70 2023-11-29T03:15:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c58155680 con 0x7f3c580cce70 2023-11-29T03:15:36.918 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c58155920 con 0x7f3c580cce70 2023-11-29T03:15:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3c400b3380 con 0x7f3c580cce70 2023-11-29T03:15:36.919 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.913+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c58066c30 con 0x7f3c580cce70 2023-11-29T03:15:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.917+0000 7f3c557fa640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3c38066900 0x7f3c38068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.917+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c4011e640 con 0x7f3c580cce70 2023-11-29T03:15:36.920 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.917+0000 7f3c57fff640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3c38066900 0x7f3c38068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:36.922 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.917+0000 7f3c57fff640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3c38066900 0x7f3c38068dc0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009b10 tx=0x7f3c48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:36.924 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:36.921+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3c400ebb90 con 0x7f3c580cce70 2023-11-29T03:15:37.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.397+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c58067530 con 0x7f3c38066900 2023-11-29T03:15:37.427 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.425+0000 7f3c557fa640 1 -- 172.21.15.16:0/3513454238 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c58067530 con 0x7f3c38066900 2023-11-29T03:15:37.427 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 0 to deep-scrub 2023-11-29T03:15:37.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3c38066900 msgr2=0x7f3c38068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3c38066900 0x7f3c38068dc0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009b10 tx=0x7f3c48008040 comp rx=0 tx=0).stop 2023-11-29T03:15:37.432 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 msgr2=0x7f3c58156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 0x7f3c58156400 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3c4001aaf0 tx=0x7f3c400191e0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 shutdown_connections 2023-11-29T03:15:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3c58143ab0 0x7f3c58156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3c38066900 0x7f3c38068dc0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c580cce70 0x7f3c58156400 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 --2- 172.21.15.16:0/3513454238 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3c58071fd0 0x7f3c58139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 >> 172.21.15.16:0/3513454238 conn(0x7f3c580cff80 msgr2=0x7f3c5813e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:37.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 shutdown_connections 2023-11-29T03:15:37.434 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.429+0000 7f3c5e365640 1 -- 172.21.15.16:0/3513454238 wait complete. 2023-11-29T03:15:37.483 INFO:tasks.ceph:Scrubbing osd.1 2023-11-29T03:15:37.483 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:37.710 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.705+0000 7f3fece79640 1 Processor -- start 2023-11-29T03:15:37.711 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.709+0000 7f3fece79640 1 -- start start 2023-11-29T03:15:37.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.709+0000 7f3fece79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 0x7f3fe80cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.715 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.709+0000 7f3fece79640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fe80cdf00 0x7f3fe80cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fece79640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80ce4f0 con 0x7f3fe80cf470 2023-11-29T03:15:37.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fece79640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe80709b0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fece79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8145060 con 0x7f3fe8144c80 2023-11-29T03:15:37.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 0x7f3fe80cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe5d9b640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f3fe80cdf00 0x7f3fe80cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.716 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 0x7f3fe80cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:43530/0 (socket says 172.21.15.16:43530) 2023-11-29T03:15:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 -- 172.21.15.16:0/1585969060 learned_addr learned my addr 172.21.15.16:0/1585969060 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:37.717 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 -- 172.21.15.16:0/1585969060 >> v2:172.21.15.16:3300/0 conn(0x7f3fe80cdf00 msgr2=0x7f3fe80cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 --2- 172.21.15.16:0/1585969060 >> v2:172.21.15.16:3300/0 conn(0x7f3fe80cdf00 0x7f3fe80cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 -- 172.21.15.16:0/1585969060 >> v1:172.21.15.16:6789/0 conn(0x7f3fe80cf470 legacy=0x7f3fe806c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:37.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.713+0000 7f3fe659c640 1 -- 172.21.15.16:0/1585969060 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80ce7d0 con 0x7f3fe8144c80 2023-11-29T03:15:37.724 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.721+0000 7f3fe659c640 1 --2- 172.21.15.16:0/1585969060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 0x7f3fe80cd9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009870 tx=0x7f3fd801c500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f0f34cc826bb330 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:37.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.721+0000 7f3fe559a640 1 -- 172.21.15.16:0/1585969060 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80ab600 con 0x7f3fe8144c80 2023-11-29T03:15:37.725 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.721+0000 7f3fe559a640 1 -- 172.21.15.16:0/1585969060 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd80a7050 con 0x7f3fe8144c80 2023-11-29T03:15:37.726 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.721+0000 7f3fe559a640 1 -- 172.21.15.16:0/1585969060 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80ab980 con 0x7f3fe8144c80 2023-11-29T03:15:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.721+0000 7f3fece79640 1 -- 172.21.15.16:0/1585969060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 msgr2=0x7f3fe80cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.727 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.721+0000 7f3fece79640 1 --2- 172.21.15.16:0/1585969060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 0x7f3fe80cd9c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8009870 tx=0x7f3fd801c500 comp rx=0 tx=0).stop 2023-11-29T03:15:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.725+0000 7f3fece79640 1 -- 172.21.15.16:0/1585969060 shutdown_connections 2023-11-29T03:15:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.725+0000 7f3fece79640 1 --2- 172.21.15.16:0/1585969060 >> v2:172.21.15.16:3300/0 conn(0x7f3fe80cdf00 0x7f3fe80cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.725+0000 7f3fece79640 1 --2- 172.21.15.16:0/1585969060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe8144c80 0x7f3fe80cd9c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.725+0000 7f3fece79640 1 -- 172.21.15.16:0/1585969060 >> 172.21.15.16:0/1585969060 conn(0x7f3fe806a5a0 msgr2=0x7f3fe806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.725+0000 7f3fece79640 1 -- 172.21.15.16:0/1585969060 shutdown_connections 2023-11-29T03:15:37.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.725+0000 7f3fece79640 1 -- 172.21.15.16:0/1585969060 wait complete. 2023-11-29T03:15:37.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.729+0000 7f3fece79640 1 Processor -- start 2023-11-29T03:15:37.732 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.729+0000 7f3fece79640 1 -- start start 2023-11-29T03:15:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe80cdf00 0x7f3fe813ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fe80cf470 0x7f3fe814fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe8144c80 0x7f3fe80ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81516d0 con 0x7f3fe8144c80 2023-11-29T03:15:37.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8150630 con 0x7f3fe80cf470 2023-11-29T03:15:37.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8150910 con 0x7f3fe80cdf00 2023-11-29T03:15:37.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fe80cf470 0x7f3fe814fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.738 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fe80cf470 0x7f3fe814fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56328/0 (socket says 172.21.15.16:56328) 2023-11-29T03:15:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe80cdf00 0x7f3fe813ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe5d9b640 1 -- 172.21.15.16:0/2984363359 learned_addr learned my addr 172.21.15.16:0/2984363359 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe6d9d640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe8144c80 0x7f3fe80ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 -- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fe80cf470 msgr2=0x7f3fe814fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.739 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fe80cf470 0x7f3fe814fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 -- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe8144c80 msgr2=0x7f3fe80ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f3fe8144c80 0x7f3fe80ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 -- 172.21.15.16:0/2984363359 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd80094d0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe5d9b640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3fe80cf470 0x7f3fe814fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fe659c640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe80cdf00 0x7f3fe813ad10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80680f0 tx=0x7f3fd80192a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:37.740 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80b37d0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd80b3930 con 0x7f3fe80cdf00 2023-11-29T03:15:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd80b3ce0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe8150bf0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.741 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.733+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe81511b0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.737+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fe8071ff0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.742 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.737+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f3fd80b2070 con 0x7f3fe80cdf00 2023-11-29T03:15:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.741+0000 7f3fd6ffd640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fc80668d0 0x7f3fc8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.745 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.741+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3fd811e1d0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.741+0000 7f3fe5d9b640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fc80668d0 0x7f3fc8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.741+0000 7f3fd6ffd640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7f3fc806c730 0x7f3fc806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.741+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 --> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fc806f200 con 0x7f3fc806c730 2023-11-29T03:15:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.741+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fd81207b0 con 0x7f3fe80cdf00 2023-11-29T03:15:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.745+0000 7f3fe6d9d640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7f3fc806c730 0x7f3fc806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:37.747 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.745+0000 7f3fe5d9b640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fc80668d0 0x7f3fc8068d90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3fe813bb80 tx=0x7f3fdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:37.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.745+0000 7f3fe6d9d640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7f3fc806c730 0x7f3fc806eb50 crc :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:37.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.773+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== osd.1 v2:172.21.15.16:6805/1338459427 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3fc806f200 con 0x7f3fc806c730 2023-11-29T03:15:37.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.813+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 --> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fe81513a0 con 0x7f3fc806c730 2023-11-29T03:15:37.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.833+0000 7f3fd6ffd640 1 -- 172.21.15.16:0/2984363359 <== osd.1 v2:172.21.15.16:6805/1338459427 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3fe81513a0 con 0x7f3fc806c730 2023-11-29T03:15:37.839 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:37.839 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:37.840 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:37.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7f3fc806c730 msgr2=0x7f3fc806eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.16:6805/1338459427,v1:172.21.15.16:6808/1338459427] conn(0x7f3fc806c730 0x7f3fc806eb50 crc :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fc80668d0 msgr2=0x7f3fc8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f3fc80668d0 0x7f3fc8068d90 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3fe813bb80 tx=0x7f3fdc008040 comp rx=0 tx=0).stop 2023-11-29T03:15:37.841 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe80cdf00 msgr2=0x7f3fe813ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:37.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 --2- 172.21.15.16:0/2984363359 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f3fe80cdf00 0x7f3fe813ad10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3fe80680f0 tx=0x7f3fd80192a0 comp rx=0 tx=0).stop 2023-11-29T03:15:37.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fe6d9d640 1 -- 172.21.15.16:0/2984363359 reap_dead start 2023-11-29T03:15:37.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 shutdown_connections 2023-11-29T03:15:37.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 >> 172.21.15.16:0/2984363359 conn(0x7f3fe806a5a0 msgr2=0x7f3fe80b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:37.842 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 shutdown_connections 2023-11-29T03:15:37.843 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:37.837+0000 7f3fece79640 1 -- 172.21.15.16:0/2984363359 wait complete. 2023-11-29T03:15:37.888 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-29T03:15:38.110 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.105+0000 7f123c31d640 1 Processor -- start 2023-11-29T03:15:38.111 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123c31d640 1 -- start start 2023-11-29T03:15:38.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123c31d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12340b4380 0x7f1234168150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123c31d640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340b2be0 con 0x7f123415d5a0 2023-11-29T03:15:38.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123c31d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340d1c90 con 0x7f12340d1fd0 2023-11-29T03:15:38.112 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123c31d640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340d0c10 con 0x7f12340b4380 2023-11-29T03:15:38.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123a8ba640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12340b4380 0x7f1234168150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123a8ba640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f12340b4380 0x7f1234168150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35214/0 (socket says 172.21.15.16:35214) 2023-11-29T03:15:38.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123a8ba640 1 -- 172.21.15.16:0/1946534526 learned_addr learned my addr 172.21.15.16:0/1946534526 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:38.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123a8ba640 1 -- 172.21.15.16:0/1946534526 >> v1:172.21.15.64:6789/0 conn(0x7f12340d1fd0 legacy=0x7f12340d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:38.114 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123a8ba640 1 -- 172.21.15.16:0/1946534526 >> v1:172.21.15.16:6789/0 conn(0x7f123415d5a0 legacy=0x7f12340d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:38.115 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.109+0000 7f123a8ba640 1 -- 172.21.15.16:0/1946534526 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340cec30 con 0x7f12340b4380 2023-11-29T03:15:38.116 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123a8ba640 1 --2- 172.21.15.16:0/1946534526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12340b4380 0x7f1234168150 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f122c009e50 tx=0x7f122c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5275aabe0c8aeab server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f12390b7640 1 -- 172.21.15.16:0/1946534526 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0a5820 con 0x7f12340b4380 2023-11-29T03:15:38.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f12390b7640 1 -- 172.21.15.16:0/1946534526 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c0a5980 con 0x7f12340b4380 2023-11-29T03:15:38.117 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f12390b7640 1 -- 172.21.15.16:0/1946534526 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0a5d10 con 0x7f12340b4380 2023-11-29T03:15:38.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 -- 172.21.15.16:0/1946534526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12340b4380 msgr2=0x7f1234168150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.118 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 --2- 172.21.15.16:0/1946534526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12340b4380 0x7f1234168150 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f122c009e50 tx=0x7f122c01c960 comp rx=0 tx=0).stop 2023-11-29T03:15:38.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 -- 172.21.15.16:0/1946534526 shutdown_connections 2023-11-29T03:15:38.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 --2- 172.21.15.16:0/1946534526 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f12340b4380 0x7f1234168150 unknown :-1 s=CLOSED pgs=3302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 -- 172.21.15.16:0/1946534526 >> 172.21.15.16:0/1946534526 conn(0x7f123409c570 msgr2=0x7f12340d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:38.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 -- 172.21.15.16:0/1946534526 shutdown_connections 2023-11-29T03:15:38.119 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.113+0000 7f123c31d640 1 -- 172.21.15.16:0/1946534526 wait complete. 2023-11-29T03:15:38.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 Processor -- start 2023-11-29T03:15:38.120 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 -- start start 2023-11-29T03:15:38.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12340b4380 0x7f12341549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12340d1fd0 0x7f12340c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 0x7f123415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.122 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c7980 con 0x7f123415d5a0 2023-11-29T03:15:38.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c7c60 con 0x7f12340b4380 2023-11-29T03:15:38.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340c7f40 con 0x7f12340d1fd0 2023-11-29T03:15:38.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 0x7f123415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 0x7f123415fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35218/0 (socket says 172.21.15.16:35218) 2023-11-29T03:15:38.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 -- 172.21.15.16:0/843422122 learned_addr learned my addr 172.21.15.16:0/843422122 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:38.123 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 -- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12340d1fd0 msgr2=0x7f12340c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12340d1fd0 0x7f12340c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 -- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12340b4380 msgr2=0x7f12341549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12340b4380 0x7f12341549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 -- 172.21.15.16:0/843422122 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c009b30 con 0x7f123415d5a0 2023-11-29T03:15:38.124 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123a8ba640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 0x7f123415fcd0 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 crypto rx=0x7f122c0af040 tx=0x7f122c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.125 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0b8880 con 0x7f123415d5a0 2023-11-29T03:15:38.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c0b89e0 con 0x7f123415d5a0 2023-11-29T03:15:38.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340c8220 con 0x7f123415d5a0 2023-11-29T03:15:38.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.117+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c0b8d50 con 0x7f123415d5a0 2023-11-29T03:15:38.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.121+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1234154f10 con 0x7f123415d5a0 2023-11-29T03:15:38.126 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.121+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1234154f10 con 0x7f123415d5a0 2023-11-29T03:15:38.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.121+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f122c0c3460 con 0x7f123415d5a0 2023-11-29T03:15:38.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.125+0000 7f122affd640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1218066900 0x7f1218068dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.127 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.125+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f122c11fa20 con 0x7f123415d5a0 2023-11-29T03:15:38.128 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.125+0000 7f123a0b9640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1218066900 0x7f1218068dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.129 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.125+0000 7f123a0b9640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1218066900 0x7f1218068dc0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f12340d2dc0 tx=0x7f1230006bd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.140 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.137+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f122c0ecfe0 con 0x7f123415d5a0 2023-11-29T03:15:38.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.297+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f12340ce8c0 con 0x7f1218066900 2023-11-29T03:15:38.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.297+0000 7f122affd640 1 -- 172.21.15.16:0/843422122 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1230004020 con 0x7f1218066900 2023-11-29T03:15:38.302 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 1 to deep-scrub 2023-11-29T03:15:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1218066900 msgr2=0x7f1218068dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1218066900 0x7f1218068dc0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f12340d2dc0 tx=0x7f1230006bd0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.306 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 msgr2=0x7f123415fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 0x7f123415fcd0 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 crypto rx=0x7f122c0af040 tx=0x7f122c019700 comp rx=0 tx=0).stop 2023-11-29T03:15:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 shutdown_connections 2023-11-29T03:15:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f123415d5a0 0x7f123415fcd0 unknown :-1 s=CLOSED pgs=3303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f12340d1fd0 0x7f12340c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1218066900 0x7f1218068dc0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.307 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 --2- 172.21.15.16:0/843422122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f12340b4380 0x7f12341549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 >> 172.21.15.16:0/843422122 conn(0x7f123409c570 msgr2=0x7f123406c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 shutdown_connections 2023-11-29T03:15:38.308 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.301+0000 7f123c31d640 1 -- 172.21.15.16:0/843422122 wait complete. 2023-11-29T03:15:38.352 INFO:tasks.ceph:Scrubbing osd.2 2023-11-29T03:15:38.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:38.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.741+0000 7ffbcb3d1640 1 Processor -- start 2023-11-29T03:15:38.743 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.741+0000 7ffbcb3d1640 1 -- start start 2023-11-29T03:15:38.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbcb3d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc41548e0 0x7ffbc40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbcb3d1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffbc4072090 0x7ffbc40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbcb3d1640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbc415a8b0 con 0x7ffbc415b350 2023-11-29T03:15:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbcb3d1640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbc415a6a0 con 0x7ffbc4072090 2023-11-29T03:15:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbcb3d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc40ced30 con 0x7ffbc41548e0 2023-11-29T03:15:38.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc996e640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffbc415b350 0x7ffbc4070460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58262/0 (socket says 172.21.15.16:58262) 2023-11-29T03:15:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc996e640 1 -- 172.21.15.16:0/414738804 learned_addr learned my addr 172.21.15.16:0/414738804 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc916d640 1 --2- 172.21.15.16:0/414738804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc41548e0 0x7ffbc40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.750 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc896c640 1 --2- 172.21.15.16:0/414738804 >> v2:172.21.15.64:3300/0 conn(0x7ffbc4072090 0x7ffbc40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc916d640 1 -- 172.21.15.16:0/414738804 >> v2:172.21.15.64:3300/0 conn(0x7ffbc4072090 msgr2=0x7ffbc40cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc916d640 1 --2- 172.21.15.16:0/414738804 >> v2:172.21.15.64:3300/0 conn(0x7ffbc4072090 0x7ffbc40cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc916d640 1 -- 172.21.15.16:0/414738804 >> v1:172.21.15.16:6789/0 conn(0x7ffbc415b350 legacy=0x7ffbc4070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.751 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.745+0000 7ffbc916d640 1 -- 172.21.15.16:0/414738804 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc40cea50 con 0x7ffbc41548e0 2023-11-29T03:15:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.753+0000 7ffbc916d640 1 --2- 172.21.15.16:0/414738804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc41548e0 0x7ffbc40ce150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00097c0 tx=0x7ffbc001c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=663e40fde942748b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.753+0000 7ffbbbfff640 1 -- 172.21.15.16:0/414738804 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00ab600 con 0x7ffbc41548e0 2023-11-29T03:15:38.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbbbfff640 1 -- 172.21.15.16:0/414738804 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00a7050 con 0x7ffbc41548e0 2023-11-29T03:15:38.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbbbfff640 1 -- 172.21.15.16:0/414738804 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00ab980 con 0x7ffbc41548e0 2023-11-29T03:15:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/414738804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc41548e0 msgr2=0x7ffbc40ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 --2- 172.21.15.16:0/414738804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc41548e0 0x7ffbc40ce150 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffbc00097c0 tx=0x7ffbc001c480 comp rx=0 tx=0).stop 2023-11-29T03:15:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/414738804 shutdown_connections 2023-11-29T03:15:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 --2- 172.21.15.16:0/414738804 >> v2:172.21.15.64:3300/0 conn(0x7ffbc4072090 0x7ffbc40cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 --2- 172.21.15.16:0/414738804 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc41548e0 0x7ffbc40ce150 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/414738804 >> 172.21.15.16:0/414738804 conn(0x7ffbc406a5a0 msgr2=0x7ffbc406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/414738804 shutdown_connections 2023-11-29T03:15:38.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.757+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/414738804 wait complete. 2023-11-29T03:15:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.761+0000 7ffbcb3d1640 1 Processor -- start 2023-11-29T03:15:38.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.761+0000 7ffbcb3d1640 1 -- start start 2023-11-29T03:15:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbcb3d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4072090 0x7ffbc4148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbcb3d1640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc41548e0 0x7ffbc4140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbcb3d1640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc415b350 0x7ffbc4141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.769 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbcb3d1640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc415d630 con 0x7ffbc41548e0 2023-11-29T03:15:38.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbcb3d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4147ef0 con 0x7ffbc4072090 2023-11-29T03:15:38.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbcb3d1640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbc4147550 con 0x7ffbc415b350 2023-11-29T03:15:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4072090 0x7ffbc4148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc996e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc415b350 0x7ffbc4141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4072090 0x7ffbc4148660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56350/0 (socket says 172.21.15.16:56350) 2023-11-29T03:15:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 -- 172.21.15.16:0/192351846 learned_addr learned my addr 172.21.15.16:0/192351846 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc896c640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc41548e0 0x7ffbc4140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 -- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc415b350 msgr2=0x7ffbc4141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.772 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc415b350 0x7ffbc4141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 -- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc41548e0 msgr2=0x7ffbc4140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffbc41548e0 0x7ffbc4140e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc916d640 1 -- 172.21.15.16:0/192351846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbc0009420 con 0x7ffbc4072090 2023-11-29T03:15:38.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.765+0000 7ffbc996e640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffbc415b350 0x7ffbc4141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:38.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbc916d640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4072090 0x7ffbc4148660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffbc001a0b0 tx=0x7ffbc001acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00b7450 con 0x7ffbc4072090 2023-11-29T03:15:38.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc00b75b0 con 0x7ffbc4072090 2023-11-29T03:15:38.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc00b7960 con 0x7ffbc4072090 2023-11-29T03:15:38.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbc4147830 con 0x7ffbc4072090 2023-11-29T03:15:38.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbc4141c00 con 0x7ffbc4072090 2023-11-29T03:15:38.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.769+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffbc41476c0 con 0x7ffbc4072090 2023-11-29T03:15:38.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.773+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffbc00b7ac0 con 0x7ffbc4072090 2023-11-29T03:15:38.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbb9ffb640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffba8066920 0x7ffba8068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffbc011e7a0 con 0x7ffbc4072090 2023-11-29T03:15:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbc896c640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffba8066920 0x7ffba8068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbb9ffb640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7ffba806c780 0x7ffba806eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 --> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffba806f250 con 0x7ffba806c780 2023-11-29T03:15:38.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbc0120d20 con 0x7ffbc4072090 2023-11-29T03:15:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbc996e640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7ffba806c780 0x7ffba806eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:38.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbc896c640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffba8066920 0x7ffba8068de0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40cbdd0 tx=0x7ffbb4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.777+0000 7ffbc996e640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7ffba806c780 0x7ffba806eba0 crc :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:38.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.793+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== osd.2 v2:172.21.15.16:6800/1740423870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffba806f250 con 0x7ffba806c780 2023-11-29T03:15:38.812 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.809+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 --> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffbc4066680 con 0x7ffba806c780 2023-11-29T03:15:38.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbb9ffb640 1 -- 172.21.15.16:0/192351846 <== osd.2 v2:172.21.15.16:6800/1740423870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffbc4066680 con 0x7ffba806c780 2023-11-29T03:15:38.824 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:38.824 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:38.824 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:38.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7ffba806c780 msgr2=0x7ffba806eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.825 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.16:6800/1740423870,v1:172.21.15.16:6801/1740423870] conn(0x7ffba806c780 0x7ffba806eba0 crc :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffba8066920 msgr2=0x7ffba8068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffba8066920 0x7ffba8068de0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7ffbc40cbdd0 tx=0x7ffbb4009190 comp rx=0 tx=0).stop 2023-11-29T03:15:38.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4072090 msgr2=0x7ffbc4148660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:38.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 --2- 172.21.15.16:0/192351846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffbc4072090 0x7ffbc4148660 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffbc001a0b0 tx=0x7ffbc001acc0 comp rx=0 tx=0).stop 2023-11-29T03:15:38.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbc996e640 1 -- 172.21.15.16:0/192351846 reap_dead start 2023-11-29T03:15:38.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 shutdown_connections 2023-11-29T03:15:38.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 >> 172.21.15.16:0/192351846 conn(0x7ffbc406a5a0 msgr2=0x7ffbc40b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:38.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 shutdown_connections 2023-11-29T03:15:38.827 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:38.821+0000 7ffbcb3d1640 1 -- 172.21.15.16:0/192351846 wait complete. 2023-11-29T03:15:38.852 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-29T03:15:39.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.261+0000 7f61fbd2a640 1 Processor -- start 2023-11-29T03:15:39.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.265+0000 7f61fbd2a640 1 -- start start 2023-11-29T03:15:39.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.265+0000 7f61fbd2a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f61f415d540 0x7f61f40b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:39.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.265+0000 7f61fbd2a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40b32c0 con 0x7f61f40d3690 2023-11-29T03:15:39.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.265+0000 7f61fbd2a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f40b35a0 con 0x7f61f40d1f50 2023-11-29T03:15:39.271 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.265+0000 7f61fbd2a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f415d920 con 0x7f61f415d540 2023-11-29T03:15:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61fa2c7640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f61f40d3690 0x7f61f40cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58268/0 (socket says 172.21.15.16:58268) 2023-11-29T03:15:39.272 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61fa2c7640 1 -- 172.21.15.16:0/1949093892 learned_addr learned my addr 172.21.15.16:0/1949093892 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f9ac6640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f61f415d540 0x7f61f40b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f8ac4640 1 -- 172.21.15.16:0/1949093892 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 760103322 0 0) 0x7f61f40b32c0 con 0x7f61f40d3690 2023-11-29T03:15:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f8ac4640 1 -- 172.21.15.16:0/1949093892 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61e0003530 con 0x7f61f40d3690 2023-11-29T03:15:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f8ac4640 1 -- 172.21.15.16:0/1949093892 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071888458 0 0) 0x7f61f40b35a0 con 0x7f61f40d1f50 2023-11-29T03:15:39.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f9ac6640 1 -- 172.21.15.16:0/1949093892 >> v1:172.21.15.64:6789/0 conn(0x7f61f40d1f50 legacy=0x7f61f40d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f9ac6640 1 -- 172.21.15.16:0/1949093892 >> v1:172.21.15.16:6789/0 conn(0x7f61f40d3690 legacy=0x7f61f40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.269+0000 7f61f9ac6640 1 -- 172.21.15.16:0/1949093892 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f40b3880 con 0x7f61f415d540 2023-11-29T03:15:39.280 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.277+0000 7f61f9ac6640 1 --2- 172.21.15.16:0/1949093892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f415d540 0x7f61f40b29c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097c0 tx=0x7f61f001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac928753dd9dd87d server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.277+0000 7f61f8ac4640 1 -- 172.21.15.16:0/1949093892 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00ac620 con 0x7f61f415d540 2023-11-29T03:15:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.277+0000 7f61f8ac4640 1 -- 172.21.15.16:0/1949093892 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00ac780 con 0x7f61f415d540 2023-11-29T03:15:39.281 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.277+0000 7f61f8ac4640 1 -- 172.21.15.16:0/1949093892 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00acb10 con 0x7f61f415d540 2023-11-29T03:15:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 -- 172.21.15.16:0/1949093892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f415d540 msgr2=0x7f61f40b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/1949093892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f415d540 0x7f61f40b29c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f61f00097c0 tx=0x7f61f001c3c0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 -- 172.21.15.16:0/1949093892 shutdown_connections 2023-11-29T03:15:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/1949093892 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f415d540 0x7f61f40b29c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.283 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 -- 172.21.15.16:0/1949093892 >> 172.21.15.16:0/1949093892 conn(0x7f61f408ccf0 msgr2=0x7f61f409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 -- 172.21.15.16:0/1949093892 shutdown_connections 2023-11-29T03:15:39.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.281+0000 7f61fbd2a640 1 -- 172.21.15.16:0/1949093892 wait complete. 2023-11-29T03:15:39.288 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.285+0000 7f61fbd2a640 1 Processor -- start 2023-11-29T03:15:39.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.285+0000 7f61fbd2a640 1 -- start start 2023-11-29T03:15:39.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61f40d1f50 0x7f61f406b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:39.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 0x7f61f4152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:39.292 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f415d540 0x7f61f414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:39.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f40d3330 con 0x7f61f415d540 2023-11-29T03:15:39.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f4152ba0 con 0x7f61f40d3690 2023-11-29T03:15:39.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f414f620 con 0x7f61f40d1f50 2023-11-29T03:15:39.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 0x7f61f4152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:39.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f9ac6640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61f40d1f50 0x7f61f406b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:39.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 0x7f61f4152270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56370/0 (socket says 172.21.15.16:56370) 2023-11-29T03:15:39.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 -- 172.21.15.16:0/2069731947 learned_addr learned my addr 172.21.15.16:0/2069731947 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:39.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fa2c7640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f415d540 0x7f61f414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:39.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 -- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61f40d1f50 msgr2=0x7f61f406b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.295 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61f40d1f50 0x7f61f406b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 -- 172.21.15.16:0/2069731947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f415d540 msgr2=0x7f61f414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f415d540 0x7f61f414b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 -- 172.21.15.16:0/2069731947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009420 con 0x7f61f40d3690 2023-11-29T03:15:39.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fa2c7640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f415d540 0x7f61f414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:39.296 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61f92c5640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 0x7f61f4152270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c3f0 tx=0x7f61e400c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:39.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e40054e0 con 0x7f61f40d3690 2023-11-29T03:15:39.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e4003600 con 0x7f61f40d3690 2023-11-29T03:15:39.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4003990 con 0x7f61f40d3690 2023-11-29T03:15:39.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.289+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f406ba40 con 0x7f61f40d3690 2023-11-29T03:15:39.297 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.293+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f406c000 con 0x7f61f40d3690 2023-11-29T03:15:39.298 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.293+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f406c1f0 con 0x7f61f40d3690 2023-11-29T03:15:39.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.297+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f61e4003af0 con 0x7f61f40d3690 2023-11-29T03:15:39.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.297+0000 7f61ea7fc640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f61d80668d0 0x7f61d8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:39.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.297+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f61e40836c0 con 0x7f61f40d3690 2023-11-29T03:15:39.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.297+0000 7f61f9ac6640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f61d80668d0 0x7f61d8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:39.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.297+0000 7f61f9ac6640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f61d80668d0 0x7f61d8068d90 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ae000 tx=0x7f61f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:39.305 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.301+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61e4050cb0 con 0x7f61f40d3690 2023-11-29T03:15:39.780 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.777+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f61f406b830 con 0x7f61d80668d0 2023-11-29T03:15:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.777+0000 7f61ea7fc640 1 -- 172.21.15.16:0/2069731947 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f61f406b830 con 0x7f61d80668d0 2023-11-29T03:15:39.781 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 2 to deep-scrub 2023-11-29T03:15:39.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f61d80668d0 msgr2=0x7f61d8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f61d80668d0 0x7f61d8068d90 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f61f00ae000 tx=0x7f61f0008040 comp rx=0 tx=0).stop 2023-11-29T03:15:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 msgr2=0x7f61f4152270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 0x7f61f4152270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c3f0 tx=0x7f61e400c8b0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 shutdown_connections 2023-11-29T03:15:39.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f61f415d540 0x7f61f414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f61d80668d0 0x7f61d8068d90 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f61f40d3690 0x7f61f4152270 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 --2- 172.21.15.16:0/2069731947 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f61f40d1f50 0x7f61f406b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 >> 172.21.15.16:0/2069731947 conn(0x7f61f408ccf0 msgr2=0x7f61f4158370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:39.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 shutdown_connections 2023-11-29T03:15:39.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:39.781+0000 7f61fbd2a640 1 -- 172.21.15.16:0/2069731947 wait complete. 2023-11-29T03:15:39.833 INFO:tasks.ceph:Scrubbing osd.3 2023-11-29T03:15:39.834 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.241+0000 7fd3da7b8640 1 Processor -- start 2023-11-29T03:15:40.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.241+0000 7fd3da7b8640 1 -- start start 2023-11-29T03:15:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3da7b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd3d40d09f0 0x7fd3d40d1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3da7b8640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40cdaf0 con 0x7fd3d415eee0 2023-11-29T03:15:40.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3da7b8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d40cbba0 con 0x7fd3d406e880 2023-11-29T03:15:40.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3da7b8640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d40d1ff0 con 0x7fd3d40d09f0 2023-11-29T03:15:40.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3cbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd3d40d09f0 0x7fd3d40d1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3d3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd3d406e880 0x7fd3d406ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:35600/0 (socket says 172.21.15.16:35600) 2023-11-29T03:15:40.250 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3d3fff640 1 -- 172.21.15.16:0/3296900719 learned_addr learned my addr 172.21.15.16:0/3296900719 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:40.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3d37fe640 1 -- 172.21.15.16:0/3296900719 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274345196 0 0) 0x7fd3d40cbba0 con 0x7fd3d406e880 2023-11-29T03:15:40.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3d37fe640 1 -- 172.21.15.16:0/3296900719 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3c0003530 con 0x7fd3d406e880 2023-11-29T03:15:40.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3cbfff640 1 -- 172.21.15.16:0/3296900719 >> v1:172.21.15.64:6789/0 conn(0x7fd3d406e880 legacy=0x7fd3d406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3cbfff640 1 -- 172.21.15.16:0/3296900719 >> v1:172.21.15.16:6789/0 conn(0x7fd3d415eee0 legacy=0x7fd3d415f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:40.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.245+0000 7fd3cbfff640 1 -- 172.21.15.16:0/3296900719 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d40cd530 con 0x7fd3d40d09f0 2023-11-29T03:15:40.258 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.253+0000 7fd3cbfff640 1 --2- 172.21.15.16:0/3296900719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d40d09f0 0x7fd3d40d1ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0097c0 tx=0x7fd3bc01c380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a07214d1c1a3ead3 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3d37fe640 1 -- 172.21.15.16:0/3296900719 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0ab600 con 0x7fd3d40d09f0 2023-11-29T03:15:40.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3d37fe640 1 -- 172.21.15.16:0/3296900719 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3bc0a7050 con 0x7fd3d40d09f0 2023-11-29T03:15:40.259 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3d37fe640 1 -- 172.21.15.16:0/3296900719 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc0ab980 con 0x7fd3d40d09f0 2023-11-29T03:15:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 -- 172.21.15.16:0/3296900719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d40d09f0 msgr2=0x7fd3d40d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.260 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 --2- 172.21.15.16:0/3296900719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d40d09f0 0x7fd3d40d1ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0097c0 tx=0x7fd3bc01c380 comp rx=0 tx=0).stop 2023-11-29T03:15:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 -- 172.21.15.16:0/3296900719 shutdown_connections 2023-11-29T03:15:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 --2- 172.21.15.16:0/3296900719 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d40d09f0 0x7fd3d40d1ab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 -- 172.21.15.16:0/3296900719 >> 172.21.15.16:0/3296900719 conn(0x7fd3d406a5a0 msgr2=0x7fd3d406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 -- 172.21.15.16:0/3296900719 shutdown_connections 2023-11-29T03:15:40.261 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 -- 172.21.15.16:0/3296900719 wait complete. 2023-11-29T03:15:40.262 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 Processor -- start 2023-11-29T03:15:40.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.257+0000 7fd3da7b8640 1 -- start start 2023-11-29T03:15:40.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d406e880 0x7fd3d40b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3d40d09f0 0x7fd3d415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d415eee0 0x7fd3d40cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d40b61d0 con 0x7fd3d415eee0 2023-11-29T03:15:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d415e720 con 0x7fd3d406e880 2023-11-29T03:15:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d415cee0 con 0x7fd3d40d09f0 2023-11-29T03:15:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d406e880 0x7fd3d40b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.265 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d406e880 0x7fd3d40b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56386/0 (socket says 172.21.15.16:56386) 2023-11-29T03:15:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 -- 172.21.15.16:0/1628255901 learned_addr learned my addr 172.21.15.16:0/1628255901 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3cbfff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3d40d09f0 0x7fd3d415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d8d55640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d415eee0 0x7fd3d40cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 -- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3d40d09f0 msgr2=0x7fd3d415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.266 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3d40d09f0 0x7fd3d415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 -- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d415eee0 msgr2=0x7fd3d40cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fd3d415eee0 0x7fd3d40cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 -- 172.21.15.16:0/1628255901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc009420 con 0x7fd3d406e880 2023-11-29T03:15:40.267 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3cbfff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fd3d40d09f0 0x7fd3d415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:40.268 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d3fff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d406e880 0x7fd3d40b5c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c4d0 tx=0x7fd3c400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4005cf0 con 0x7fd3d406e880 2023-11-29T03:15:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4005e50 con 0x7fd3d406e880 2023-11-29T03:15:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d415d1c0 con 0x7fd3d406e880 2023-11-29T03:15:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4007270 con 0x7fd3d406e880 2023-11-29T03:15:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.261+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d415d780 con 0x7fd3d406e880 2023-11-29T03:15:40.269 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.265+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3d40d1e80 con 0x7fd3d406e880 2023-11-29T03:15:40.270 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.265+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fd3c40073d0 con 0x7fd3d406e880 2023-11-29T03:15:40.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3d17fa640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3b4066920 0x7fd3b4068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd3c4083700 con 0x7fd3d406e880 2023-11-29T03:15:40.273 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3cbfff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3b4066920 0x7fd3b4068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.274 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3d17fa640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7fd3b406c780 0x7fd3b406eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 --> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3b406f250 con 0x7fd3b406c780 2023-11-29T03:15:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3c4085ce0 con 0x7fd3d406e880 2023-11-29T03:15:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3cbfff640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3b4066920 0x7fd3b4068de0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0ad000 tx=0x7fd3bc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.275 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.269+0000 7fd3d8d55640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7fd3b406c780 0x7fd3b406eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.276 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.273+0000 7fd3d8d55640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7fd3b406c780 0x7fd3b406eba0 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.286 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.285+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== osd.3 v2:172.21.15.16:6824/2069307542 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd3b406f250 con 0x7fd3b406c780 2023-11-29T03:15:40.326 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.321+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 --> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd3d40b4030 con 0x7fd3b406c780 2023-11-29T03:15:40.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3d17fa640 1 -- 172.21.15.16:0/1628255901 <== osd.3 v2:172.21.15.16:6824/2069307542 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd3cc013040 con 0x7fd3b406c780 2023-11-29T03:15:40.335 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:40.335 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:40.335 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:40.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7fd3b406c780 msgr2=0x7fd3b406eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.16:6824/2069307542,v1:172.21.15.16:6825/2069307542] conn(0x7fd3b406c780 0x7fd3b406eba0 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3b4066920 msgr2=0x7fd3b4068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fd3b4066920 0x7fd3b4068de0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0ad000 tx=0x7fd3bc0a6000 comp rx=0 tx=0).stop 2023-11-29T03:15:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d406e880 msgr2=0x7fd3d40b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.337 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 --2- 172.21.15.16:0/1628255901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd3d406e880 0x7fd3d40b5c90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c4d0 tx=0x7fd3c400c990 comp rx=0 tx=0).stop 2023-11-29T03:15:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3d8d55640 1 -- 172.21.15.16:0/1628255901 reap_dead start 2023-11-29T03:15:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 shutdown_connections 2023-11-29T03:15:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 >> 172.21.15.16:0/1628255901 conn(0x7fd3d406a5a0 msgr2=0x7fd3d40b0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 shutdown_connections 2023-11-29T03:15:40.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.333+0000 7fd3da7b8640 1 -- 172.21.15.16:0/1628255901 wait complete. 2023-11-29T03:15:40.381 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-29T03:15:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.785+0000 7f9f68888640 1 Processor -- start 2023-11-29T03:15:40.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.785+0000 7f9f68888640 1 -- start start 2023-11-29T03:15:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f68888640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f6415d480 0x7f9f640cde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f68888640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f68888640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f640b3250 con 0x7f9f640ce3b0 2023-11-29T03:15:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f68888640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f640ce8f0 con 0x7f9f6415d480 2023-11-29T03:15:40.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f68888640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f640cebd0 con 0x7f9f640d3920 2023-11-29T03:15:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f637fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f6415d480 0x7f9f640cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f63fff640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f637fe640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f9f6415d480 0x7f9f640cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35258/0 (socket says 172.21.15.16:35258) 2023-11-29T03:15:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f637fe640 1 -- 172.21.15.16:0/1558981374 learned_addr learned my addr 172.21.15.16:0/1558981374 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:40.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f63fff640 1 -- 172.21.15.16:0/1558981374 >> v2:172.21.15.16:3300/0 conn(0x7f9f6415d480 msgr2=0x7f9f640cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f63fff640 1 --2- 172.21.15.16:0/1558981374 >> v2:172.21.15.16:3300/0 conn(0x7f9f6415d480 0x7f9f640cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f63fff640 1 -- 172.21.15.16:0/1558981374 >> v1:172.21.15.16:6789/0 conn(0x7f9f640ce3b0 legacy=0x7f9f640d3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:40.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.789+0000 7f9f63fff640 1 -- 172.21.15.16:0/1558981374 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f640ceeb0 con 0x7f9f640d3920 2023-11-29T03:15:40.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.797+0000 7f9f63fff640 1 --2- 172.21.15.16:0/1558981374 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b3700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009d90 tx=0x7f9f5c01c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cd02f195c4a1644 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.802 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.797+0000 7f9f627fc640 1 -- 172.21.15.16:0/1558981374 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0a59a0 con 0x7f9f640d3920 2023-11-29T03:15:40.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f627fc640 1 -- 172.21.15.16:0/1558981374 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c0a5b00 con 0x7f9f640d3920 2023-11-29T03:15:40.803 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f627fc640 1 -- 172.21.15.16:0/1558981374 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0a5e90 con 0x7f9f640d3920 2023-11-29T03:15:40.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 -- 172.21.15.16:0/1558981374 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 msgr2=0x7f9f640b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.804 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 --2- 172.21.15.16:0/1558981374 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b3700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f5c009d90 tx=0x7f9f5c01c8c0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 -- 172.21.15.16:0/1558981374 shutdown_connections 2023-11-29T03:15:40.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 --2- 172.21.15.16:0/1558981374 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b3700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 --2- 172.21.15.16:0/1558981374 >> v2:172.21.15.16:3300/0 conn(0x7f9f6415d480 0x7f9f640cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 -- 172.21.15.16:0/1558981374 >> 172.21.15.16:0/1558981374 conn(0x7f9f6408cc90 msgr2=0x7f9f6409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:40.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 -- 172.21.15.16:0/1558981374 shutdown_connections 2023-11-29T03:15:40.805 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.801+0000 7f9f68888640 1 -- 172.21.15.16:0/1558981374 wait complete. 2023-11-29T03:15:40.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.805+0000 7f9f68888640 1 Processor -- start 2023-11-29T03:15:40.810 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.805+0000 7f9f68888640 1 -- start start 2023-11-29T03:15:40.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f68888640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f640ce3b0 0x7f9f640c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f68888640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.814 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f68888640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6415d480 0x7f9f640cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f68888640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f640c6e50 con 0x7f9f6415d480 2023-11-29T03:15:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f68888640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f641605b0 con 0x7f9f640ce3b0 2023-11-29T03:15:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f68888640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f64160830 con 0x7f9f640d3920 2023-11-29T03:15:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f637fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f640ce3b0 0x7f9f640c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6415d480 0x7f9f640cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.815 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f637fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f640ce3b0 0x7f9f640c6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56400/0 (socket says 172.21.15.16:56400) 2023-11-29T03:15:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f637fe640 1 -- 172.21.15.16:0/580337142 learned_addr learned my addr 172.21.15.16:0/580337142 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f62ffd640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 -- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 msgr2=0x7f9f640b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 -- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f640ce3b0 msgr2=0x7f9f640c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:40.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f640ce3b0 0x7f9f640c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:40.817 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 -- 172.21.15.16:0/580337142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c009a70 con 0x7f9f6415d480 2023-11-29T03:15:40.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.809+0000 7f9f63fff640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6415d480 0x7f9f640cb6e0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ced10 tx=0x7f9f5c019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.818 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.813+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0addd0 con 0x7f9f6415d480 2023-11-29T03:15:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.813+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5c009450 con 0x7f9f6415d480 2023-11-29T03:15:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.813+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f64160b10 con 0x7f9f6415d480 2023-11-29T03:15:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.813+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f5c0b9650 con 0x7f9f6415d480 2023-11-29T03:15:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.813+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f640cc140 con 0x7f9f6415d480 2023-11-29T03:15:40.819 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.813+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f6404e890 con 0x7f9f6415d480 2023-11-29T03:15:40.820 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.817+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f9f5c0b97b0 con 0x7f9f6415d480 2023-11-29T03:15:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.817+0000 7f9f4bfff640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9f500668d0 0x7f9f50068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:40.822 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.817+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9f5c11f690 con 0x7f9f6415d480 2023-11-29T03:15:40.823 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.821+0000 7f9f637fe640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9f500668d0 0x7f9f50068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:40.824 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.821+0000 7f9f637fe640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9f500668d0 0x7f9f50068d90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ca010 tx=0x7f9f54009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:40.826 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:40.821+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9f5c0ecbc0 con 0x7f9f6415d480 2023-11-29T03:15:41.293 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.289+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f6408d320 con 0x7f9f500668d0 2023-11-29T03:15:41.294 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.289+0000 7f9f4bfff640 1 -- 172.21.15.16:0/580337142 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9f6408d320 con 0x7f9f500668d0 2023-11-29T03:15:41.295 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 3 to deep-scrub 2023-11-29T03:15:41.299 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.293+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9f500668d0 msgr2=0x7f9f50068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.293+0000 7f9f68888640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9f500668d0 0x7f9f50068d90 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ca010 tx=0x7f9f54009240 comp rx=0 tx=0).stop 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6415d480 msgr2=0x7f9f640cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6415d480 0x7f9f640cb6e0 secure :-1 s=READY pgs=3308 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ced10 tx=0x7f9f5c019660 comp rx=0 tx=0).stop 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 shutdown_connections 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f9f6415d480 0x7f9f640cb6e0 unknown :-1 s=CLOSED pgs=3308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f9f640d3920 0x7f9f640b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.300 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f9f500668d0 0x7f9f50068d90 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 --2- 172.21.15.16:0/580337142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9f640ce3b0 0x7f9f640c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 >> 172.21.15.16:0/580337142 conn(0x7f9f6408cc90 msgr2=0x7f9f640d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 shutdown_connections 2023-11-29T03:15:41.301 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.297+0000 7f9f68888640 1 -- 172.21.15.16:0/580337142 wait complete. 2023-11-29T03:15:41.351 INFO:tasks.ceph:Scrubbing osd.4 2023-11-29T03:15:41.352 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.757+0000 7ffacc09a640 1 Processor -- start 2023-11-29T03:15:41.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffacc09a640 1 -- start start 2023-11-29T03:15:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffacc09a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffac415d4b0 0x7ffac40b6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffacc09a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac406c1c0 0x7ffac40d36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffacc09a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac40d23f0 con 0x7ffac40b6880 2023-11-29T03:15:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffacc09a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac415d890 con 0x7ffac415d4b0 2023-11-29T03:15:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffacc09a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40d2920 con 0x7ffac406c1c0 2023-11-29T03:15:41.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffac9635640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7ffac40b6880 0x7ffac406bab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58292/0 (socket says 172.21.15.16:58292) 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffac9e36640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffac415d4b0 0x7ffac40b6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffaca637640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac406c1c0 0x7ffac40d36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.761+0000 7ffac9635640 1 -- 172.21.15.16:0/4047436278 learned_addr learned my addr 172.21.15.16:0/4047436278 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.765+0000 7ffaca637640 1 -- 172.21.15.16:0/4047436278 >> v2:172.21.15.64:3300/0 conn(0x7ffac415d4b0 msgr2=0x7ffac40b6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.765+0000 7ffaca637640 1 --2- 172.21.15.16:0/4047436278 >> v2:172.21.15.64:3300/0 conn(0x7ffac415d4b0 0x7ffac40b6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.765+0000 7ffaca637640 1 -- 172.21.15.16:0/4047436278 >> v1:172.21.15.16:6789/0 conn(0x7ffac40b6880 legacy=0x7ffac406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.765+0000 7ffaca637640 1 -- 172.21.15.16:0/4047436278 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40d2bc0 con 0x7ffac406c1c0 2023-11-29T03:15:41.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffaca637640 1 --2- 172.21.15.16:0/4047436278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac406c1c0 0x7ffac40d36a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009d90 tx=0x7ffabc01c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b069c1de1cc96651 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffac8e34640 1 -- 172.21.15.16:0/4047436278 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a5950 con 0x7ffac406c1c0 2023-11-29T03:15:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffac8e34640 1 -- 172.21.15.16:0/4047436278 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0a5ab0 con 0x7ffac406c1c0 2023-11-29T03:15:41.771 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffac8e34640 1 -- 172.21.15.16:0/4047436278 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a5e40 con 0x7ffac406c1c0 2023-11-29T03:15:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 -- 172.21.15.16:0/4047436278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac406c1c0 msgr2=0x7ffac40d36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 --2- 172.21.15.16:0/4047436278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac406c1c0 0x7ffac40d36a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009d90 tx=0x7ffabc01c890 comp rx=0 tx=0).stop 2023-11-29T03:15:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 -- 172.21.15.16:0/4047436278 shutdown_connections 2023-11-29T03:15:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 --2- 172.21.15.16:0/4047436278 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac406c1c0 0x7ffac40d36a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 --2- 172.21.15.16:0/4047436278 >> v2:172.21.15.64:3300/0 conn(0x7ffac415d4b0 0x7ffac40b6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 -- 172.21.15.16:0/4047436278 >> 172.21.15.16:0/4047436278 conn(0x7ffac40720d0 msgr2=0x7ffac40724e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:41.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 -- 172.21.15.16:0/4047436278 shutdown_connections 2023-11-29T03:15:41.774 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.769+0000 7ffacc09a640 1 -- 172.21.15.16:0/4047436278 wait complete. 2023-11-29T03:15:41.778 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 Processor -- start 2023-11-29T03:15:41.779 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 -- start start 2023-11-29T03:15:41.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffac406c1c0 0x7ffac4152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac40b6880 0x7ffac40c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac415d4b0 0x7ffac41592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40c97b0 con 0x7ffac406c1c0 2023-11-29T03:15:41.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40c8820 con 0x7ffac415d4b0 2023-11-29T03:15:41.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffacc09a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac41f6ed0 con 0x7ffac40b6880 2023-11-29T03:15:41.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.777+0000 7ffac9e36640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffac406c1c0 0x7ffac4152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.783 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac40b6880 0x7ffac40c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac40b6880 0x7ffac40c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:43624/0 (socket says 172.21.15.16:43624) 2023-11-29T03:15:41.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 -- 172.21.15.16:0/1267869053 learned_addr learned my addr 172.21.15.16:0/1267869053 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:41.784 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffaca637640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac415d4b0 0x7ffac41592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 -- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac415d4b0 msgr2=0x7ffac41592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac415d4b0 0x7ffac41592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 -- 172.21.15.16:0/1267869053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffac406c1c0 msgr2=0x7ffac4152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7ffac406c1c0 0x7ffac4152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 -- 172.21.15.16:0/1267869053 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009a70 con 0x7ffac40b6880 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffac9635640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac40b6880 0x7ffac40c9270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c4d0 tx=0x7ffab400c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4005cf0 con 0x7ffac40b6880 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4005e50 con 0x7ffac40b6880 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac41f71b0 con 0x7ffac40b6880 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4007270 con 0x7ffac40b6880 2023-11-29T03:15:41.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac40c8d50 con 0x7ffac40b6880 2023-11-29T03:15:41.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.781+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffac4068860 con 0x7ffac40b6880 2023-11-29T03:15:41.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.785+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7ffab40073d0 con 0x7ffac40b6880 2023-11-29T03:15:41.791 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffaba7fc640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffaa80668d0 0x7ffaa8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffab40834d0 con 0x7ffac40b6880 2023-11-29T03:15:41.792 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffaba7fc640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7ffaa806c730 0x7ffaa806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 --> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffaa806f200 con 0x7ffaa806c730 2023-11-29T03:15:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab4085ab0 con 0x7ffac40b6880 2023-11-29T03:15:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffac9e36640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffaa80668d0 0x7ffaa8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.793 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffaca637640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7ffaa806c730 0x7ffaa806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:41.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.789+0000 7ffac9e36640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffaa80668d0 0x7ffaa8068d90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009ac0 tx=0x7ffac0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:41.795 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.793+0000 7ffaca637640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7ffaa806c730 0x7ffaa806eb50 crc :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:41.816 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.813+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== osd.4 v2:172.21.15.64:6808/2542652674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ffaa806f200 con 0x7ffaa806c730 2023-11-29T03:15:41.831 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.829+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 --> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffac40d0f10 con 0x7ffaa806c730 2023-11-29T03:15:41.862 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.857+0000 7ffaba7fc640 1 -- 172.21.15.16:0/1267869053 <== osd.4 v2:172.21.15.64:6808/2542652674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffac40d0f10 con 0x7ffaa806c730 2023-11-29T03:15:41.863 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:41.863 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:41.863 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:41.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7ffaa806c730 msgr2=0x7ffaa806eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6808/2542652674,v1:172.21.15.64:6809/2542652674] conn(0x7ffaa806c730 0x7ffaa806eb50 crc :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:41.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffaa80668d0 msgr2=0x7ffaa8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7ffaa80668d0 0x7ffaa8068d90 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ffac0009ac0 tx=0x7ffac0009190 comp rx=0 tx=0).stop 2023-11-29T03:15:41.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac40b6880 msgr2=0x7ffac40c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:41.864 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 --2- 172.21.15.16:0/1267869053 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7ffac40b6880 0x7ffac40c9270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c4d0 tx=0x7ffab400c990 comp rx=0 tx=0).stop 2023-11-29T03:15:41.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffaca637640 1 -- 172.21.15.16:0/1267869053 reap_dead start 2023-11-29T03:15:41.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 shutdown_connections 2023-11-29T03:15:41.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 >> 172.21.15.16:0/1267869053 conn(0x7ffac40720d0 msgr2=0x7ffac40b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:41.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 shutdown_connections 2023-11-29T03:15:41.865 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:41.861+0000 7ffacc09a640 1 -- 172.21.15.16:0/1267869053 wait complete. 2023-11-29T03:15:41.892 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-29T03:15:42.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.309+0000 7f198a49a640 1 Processor -- start 2023-11-29T03:15:42.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.309+0000 7f198a49a640 1 -- start start 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f198a49a640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f198415d540 0x7f19840b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f198a49a640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b32c0 con 0x7f19840d3690 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f198a49a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19840b35a0 con 0x7f19840d1f50 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f198a49a640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198415d920 con 0x7f198415d540 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f1983fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f198415d540 0x7f19840b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f1983fff640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f198415d540 0x7f19840b29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35294/0 (socket says 172.21.15.16:35294) 2023-11-29T03:15:42.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f1983fff640 1 -- 172.21.15.16:0/2889556818 learned_addr learned my addr 172.21.15.16:0/2889556818 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:42.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f1983fff640 1 -- 172.21.15.16:0/2889556818 >> v1:172.21.15.64:6789/0 conn(0x7f19840d1f50 legacy=0x7f19840d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f1983fff640 1 -- 172.21.15.16:0/2889556818 >> v1:172.21.15.16:6789/0 conn(0x7f19840d3690 legacy=0x7f19840cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.318 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.313+0000 7f1983fff640 1 -- 172.21.15.16:0/2889556818 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19840b3880 con 0x7f198415d540 2023-11-29T03:15:42.327 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f1983fff640 1 --2- 172.21.15.16:0/2889556818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f198415d540 0x7f19840b29c0 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7f1974009e50 tx=0x7f197401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7d78d0fb19a861 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:42.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f1982ffd640 1 -- 172.21.15.16:0/2889556818 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740a5810 con 0x7f198415d540 2023-11-29T03:15:42.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f1982ffd640 1 -- 172.21.15.16:0/2889556818 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19740a5970 con 0x7f198415d540 2023-11-29T03:15:42.328 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f1982ffd640 1 -- 172.21.15.16:0/2889556818 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740a5d00 con 0x7f198415d540 2023-11-29T03:15:42.329 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 -- 172.21.15.16:0/2889556818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f198415d540 msgr2=0x7f19840b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 --2- 172.21.15.16:0/2889556818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f198415d540 0x7f19840b29c0 secure :-1 s=READY pgs=3311 cs=0 l=1 rev1=1 crypto rx=0x7f1974009e50 tx=0x7f197401c950 comp rx=0 tx=0).stop 2023-11-29T03:15:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 -- 172.21.15.16:0/2889556818 shutdown_connections 2023-11-29T03:15:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 --2- 172.21.15.16:0/2889556818 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f198415d540 0x7f19840b29c0 unknown :-1 s=CLOSED pgs=3311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 -- 172.21.15.16:0/2889556818 >> 172.21.15.16:0/2889556818 conn(0x7f198408ccf0 msgr2=0x7f198409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 -- 172.21.15.16:0/2889556818 shutdown_connections 2023-11-29T03:15:42.330 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.325+0000 7f198a49a640 1 -- 172.21.15.16:0/2889556818 wait complete. 2023-11-29T03:15:42.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.329+0000 7f198a49a640 1 Processor -- start 2023-11-29T03:15:42.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 -- start start 2023-11-29T03:15:42.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 0x7f198406c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:42.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19840d3690 0x7f19840cb460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:42.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f198415d540 0x7f19840cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:42.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198406cdc0 con 0x7f19840d3690 2023-11-29T03:15:42.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198415c470 con 0x7f19840d1f50 2023-11-29T03:15:42.338 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.333+0000 7f198a49a640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198415dc40 con 0x7f198415d540 2023-11-29T03:15:42.339 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 0x7f198406c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 0x7f198406c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56438/0 (socket says 172.21.15.16:56438) 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f19837fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19840d3690 0x7f19840cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 -- 172.21.15.16:0/2001697554 learned_addr learned my addr 172.21.15.16:0/2001697554 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1988a37640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f198415d540 0x7f19840cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 -- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f198415d540 msgr2=0x7f19840cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f198415d540 0x7f19840cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 -- 172.21.15.16:0/2001697554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19840d3690 msgr2=0x7f19840cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19840d3690 0x7f19840cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 -- 172.21.15.16:0/2001697554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1974009b30 con 0x7f19840d1f50 2023-11-29T03:15:42.341 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1983fff640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 0x7f198406c880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1974019560 tx=0x7f19740196f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:42.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740b8670 con 0x7f19840d1f50 2023-11-29T03:15:42.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19740b87d0 con 0x7f19840d1f50 2023-11-29T03:15:42.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19740b8b80 con 0x7f19840d1f50 2023-11-29T03:15:42.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198415c190 con 0x7f19840d1f50 2023-11-29T03:15:42.342 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.337+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198415e1c0 con 0x7f19840d1f50 2023-11-29T03:15:42.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.341+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198415da60 con 0x7f19840d1f50 2023-11-29T03:15:42.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.341+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mon.1 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f19740b8ce0 con 0x7f19840d1f50 2023-11-29T03:15:42.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.345+0000 7f1980ff9640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1970066920 0x7f1970068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:42.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.345+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mon.1 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f197411f6f0 con 0x7f19840d1f50 2023-11-29T03:15:42.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.345+0000 7f19837fe640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1970066920 0x7f1970068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:42.351 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.349+0000 7f19837fe640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1970066920 0x7f1970068de0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19840b2210 tx=0x7f1978009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:42.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.349+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mon.1 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19740ecde0 con 0x7f19840d1f50 2023-11-29T03:15:42.833 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.829+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1984068860 con 0x7f1970066920 2023-11-29T03:15:42.834 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.829+0000 7f1980ff9640 1 -- 172.21.15.16:0/2001697554 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1984068860 con 0x7f1970066920 2023-11-29T03:15:42.834 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 4 to deep-scrub 2023-11-29T03:15:42.838 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1970066920 msgr2=0x7f1970068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1970066920 0x7f1970068de0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f19840b2210 tx=0x7f1978009040 comp rx=0 tx=0).stop 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 msgr2=0x7f198406c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 0x7f198406c880 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1974019560 tx=0x7f19740196f0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 shutdown_connections 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f198415d540 0x7f19840cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f19840d3690 0x7f19840cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1970066920 0x7f1970068de0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 --2- 172.21.15.16:0/2001697554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19840d1f50 0x7f198406c880 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:42.839 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.833+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 >> 172.21.15.16:0/2001697554 conn(0x7f198408ccf0 msgr2=0x7f19840cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:42.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.837+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 shutdown_connections 2023-11-29T03:15:42.840 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:42.837+0000 7f198a49a640 1 -- 172.21.15.16:0/2001697554 wait complete. 2023-11-29T03:15:42.890 INFO:tasks.ceph:Scrubbing osd.5 2023-11-29T03:15:42.890 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:43.316 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.313+0000 7f1a7fa79640 1 Processor -- start 2023-11-29T03:15:43.317 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.313+0000 7f1a7fa79640 1 -- start start 2023-11-29T03:15:43.320 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7fa79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7806b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7fa79640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a78161b10 0x7f1a7806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7fa79640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a7806b520 con 0x7f1a7806d050 2023-11-29T03:15:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7fa79640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a7806d480 con 0x7f1a78161b10 2023-11-29T03:15:43.321 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7fa79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78140b80 con 0x7f1a781407a0 2023-11-29T03:15:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7d815640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7806b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7d014640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f1a78161b10 0x7f1a7806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7e016640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f1a7806d050 0x7f1a78140e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58306/0 (socket says 172.21.15.16:58306) 2023-11-29T03:15:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7e016640 1 -- 172.21.15.16:0/290579026 learned_addr learned my addr 172.21.15.16:0/290579026 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:43.322 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.317+0000 7f1a7d815640 1 --2- 172.21.15.16:0/290579026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7806b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:43640/0 (socket says 172.21.15.16:43640) 2023-11-29T03:15:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.321+0000 7f1a7d815640 1 -- 172.21.15.16:0/290579026 >> v2:172.21.15.16:3300/0 conn(0x7f1a78161b10 msgr2=0x7f1a7806cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.321+0000 7f1a7d815640 1 --2- 172.21.15.16:0/290579026 >> v2:172.21.15.16:3300/0 conn(0x7f1a78161b10 0x7f1a7806cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.321+0000 7f1a7d815640 1 -- 172.21.15.16:0/290579026 >> v1:172.21.15.16:6789/0 conn(0x7f1a7806d050 legacy=0x7f1a78140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.321+0000 7f1a7c813640 1 -- 172.21.15.16:0/290579026 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101192991 0 0) 0x7f1a7806b520 con 0x7f1a7806d050 2023-11-29T03:15:43.323 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.321+0000 7f1a7d815640 1 -- 172.21.15.16:0/290579026 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a7806bef0 con 0x7f1a781407a0 2023-11-29T03:15:43.332 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.329+0000 7f1a7d815640 1 --2- 172.21.15.16:0/290579026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7806b9b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a740097c0 tx=0x7f1a7401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b347a3c37b9af24 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.329+0000 7f1a7c813640 1 -- 172.21.15.16:0/290579026 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740ab650 con 0x7f1a781407a0 2023-11-29T03:15:43.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.329+0000 7f1a7c813640 1 -- 172.21.15.16:0/290579026 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a740ab7b0 con 0x7f1a781407a0 2023-11-29T03:15:43.333 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.329+0000 7f1a7c813640 1 -- 172.21.15.16:0/290579026 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a740abb40 con 0x7f1a781407a0 2023-11-29T03:15:43.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.329+0000 7f1a7fa79640 1 -- 172.21.15.16:0/290579026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 msgr2=0x7f1a7806b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.334 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.329+0000 7f1a7fa79640 1 --2- 172.21.15.16:0/290579026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7806b9b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a740097c0 tx=0x7f1a7401c450 comp rx=0 tx=0).stop 2023-11-29T03:15:43.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.333+0000 7f1a7fa79640 1 -- 172.21.15.16:0/290579026 shutdown_connections 2023-11-29T03:15:43.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.333+0000 7f1a7fa79640 1 --2- 172.21.15.16:0/290579026 >> v2:172.21.15.16:3300/0 conn(0x7f1a78161b10 0x7f1a7806cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.333+0000 7f1a7fa79640 1 --2- 172.21.15.16:0/290579026 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7806b9b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.335 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.333+0000 7f1a7fa79640 1 -- 172.21.15.16:0/290579026 >> 172.21.15.16:0/290579026 conn(0x7f1a780cc240 msgr2=0x7f1a780cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.333+0000 7f1a7fa79640 1 -- 172.21.15.16:0/290579026 shutdown_connections 2023-11-29T03:15:43.336 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.333+0000 7f1a7fa79640 1 -- 172.21.15.16:0/290579026 wait complete. 2023-11-29T03:15:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.337+0000 7f1a7fa79640 1 Processor -- start 2023-11-29T03:15:43.340 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.337+0000 7f1a7fa79640 1 -- start start 2023-11-29T03:15:43.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7fa79640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a7806d050 0x7f1a780ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.343 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7fa79640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7813c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7fa79640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a78161b10 0x7f1a78157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7fa79640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a78155990 con 0x7f1a7806d050 2023-11-29T03:15:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7fa79640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780adc30 con 0x7f1a78161b10 2023-11-29T03:15:43.344 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7fa79640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a780adf10 con 0x7f1a781407a0 2023-11-29T03:15:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d815640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a7806d050 0x7f1a780ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d815640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a7806d050 0x7f1a780ad2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35318/0 (socket says 172.21.15.16:35318) 2023-11-29T03:15:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7813c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d815640 1 -- 172.21.15.16:0/294277759 learned_addr learned my addr 172.21.15.16:0/294277759 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:43.345 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7e016640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a78161b10 0x7f1a78157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 -- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a78161b10 msgr2=0x7f1a78157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a78161b10 0x7f1a78157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 -- 172.21.15.16:0/294277759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a7806d050 msgr2=0x7f1a780ad2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f1a7806d050 0x7f1a780ad2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.346 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 -- 172.21.15.16:0/294277759 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a74009420 con 0x7f1a781407a0 2023-11-29T03:15:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.341+0000 7f1a7d014640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7813c070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e870 tx=0x7f1a6800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800ee60 con 0x7f1a781407a0 2023-11-29T03:15:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a6800c940 con 0x7f1a781407a0 2023-11-29T03:15:43.347 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a6800ccd0 con 0x7f1a781407a0 2023-11-29T03:15:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a781555b0 con 0x7f1a781407a0 2023-11-29T03:15:43.348 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a780ad9d0 con 0x7f1a781407a0 2023-11-29T03:15:43.349 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a78141970 con 0x7f1a781407a0 2023-11-29T03:15:43.350 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.345+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f1a68013470 con 0x7f1a781407a0 2023-11-29T03:15:43.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a6e7fc640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a5c066920 0x7f1a5c068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.352 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a68084060 con 0x7f1a781407a0 2023-11-29T03:15:43.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a7d815640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a5c066920 0x7f1a5c068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a6e7fc640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f1a5c06c780 0x7f1a5c06eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.353 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 --> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a5c06f250 con 0x7f1a5c06c780 2023-11-29T03:15:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a680865e0 con 0x7f1a781407a0 2023-11-29T03:15:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.349+0000 7f1a7e016640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f1a5c06c780 0x7f1a5c06eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.354 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.353+0000 7f1a7d815640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a5c066920 0x7f1a5c068de0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1a740097c0 tx=0x7f1a740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.355 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.353+0000 7f1a7e016640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f1a5c06c780 0x7f1a5c06eba0 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.369+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== osd.5 v2:172.21.15.64:6816/1005985598 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1a5c06f250 con 0x7f1a5c06c780 2023-11-29T03:15:43.413 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.409+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 --> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a7806b1b0 con 0x7f1a5c06c780 2023-11-29T03:15:43.433 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.429+0000 7f1a6e7fc640 1 -- 172.21.15.16:0/294277759 <== osd.5 v2:172.21.15.64:6816/1005985598 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1a70004df0 con 0x7f1a5c06c780 2023-11-29T03:15:43.434 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:43.434 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:43.434 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:43.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f1a5c06c780 msgr2=0x7f1a5c06eba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6816/1005985598,v1:172.21.15.64:6817/1005985598] conn(0x7f1a5c06c780 0x7f1a5c06eba0 crc :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.435 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a5c066920 msgr2=0x7f1a5c068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f1a5c066920 0x7f1a5c068de0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f1a740097c0 tx=0x7f1a740a7000 comp rx=0 tx=0).stop 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 msgr2=0x7f1a7813c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 --2- 172.21.15.16:0/294277759 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f1a781407a0 0x7f1a7813c070 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1a6800e870 tx=0x7f1a6800ed30 comp rx=0 tx=0).stop 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7e016640 1 -- 172.21.15.16:0/294277759 reap_dead start 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 shutdown_connections 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 >> 172.21.15.16:0/294277759 conn(0x7f1a780cc240 msgr2=0x7f1a780af7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 shutdown_connections 2023-11-29T03:15:43.436 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.433+0000 7f1a7fa79640 1 -- 172.21.15.16:0/294277759 wait complete. 2023-11-29T03:15:43.464 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-29T03:15:43.881 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.877+0000 7f72cafb5640 1 Processor -- start 2023-11-29T03:15:43.882 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.877+0000 7f72cafb5640 1 -- start start 2023-11-29T03:15:43.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72cafb5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f72c40d3210 0x7f72c40d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72cafb5640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f72c40b3700 0x7f72c40b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72cafb5640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c40d3ba0 con 0x7f72c415d480 2023-11-29T03:15:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72cafb5640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40b3250 con 0x7f72c40b3700 2023-11-29T03:15:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72cafb5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c40ce8f0 con 0x7f72c40d3210 2023-11-29T03:15:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72c9fb3640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f72c415d480 0x7f72c40cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58308/0 (socket says 172.21.15.16:58308) 2023-11-29T03:15:43.886 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72c9fb3640 1 -- 172.21.15.16:0/3769469837 learned_addr learned my addr 172.21.15.16:0/3769469837 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:43.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72ca7b4640 1 --2- 172.21.15.16:0/3769469837 >> v2:172.21.15.16:3300/0 conn(0x7f72c40b3700 0x7f72c40b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.881+0000 7f72c97b2640 1 --2- 172.21.15.16:0/3769469837 >> v2:172.21.15.64:3300/0 conn(0x7f72c40d3210 0x7f72c40d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72c8fb1640 1 -- 172.21.15.16:0/3769469837 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657474833 0 0) 0x7f72c0001120 con 0x7f72c415d480 2023-11-29T03:15:43.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72c8fb1640 1 -- 172.21.15.16:0/3769469837 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b0003530 con 0x7f72c415d480 2023-11-29T03:15:43.887 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72ca7b4640 1 -- 172.21.15.16:0/3769469837 >> v2:172.21.15.64:3300/0 conn(0x7f72c40d3210 msgr2=0x7f72c40d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:43.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72ca7b4640 1 --2- 172.21.15.16:0/3769469837 >> v2:172.21.15.64:3300/0 conn(0x7f72c40d3210 0x7f72c40d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72ca7b4640 1 -- 172.21.15.16:0/3769469837 >> v1:172.21.15.16:6789/0 conn(0x7f72c415d480 legacy=0x7f72c40cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.888 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72ca7b4640 1 -- 172.21.15.16:0/3769469837 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40cebd0 con 0x7f72c40b3700 2023-11-29T03:15:43.890 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.885+0000 7f72ca7b4640 1 --2- 172.21.15.16:0/3769469837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40b3700 0x7f72c40b3b50 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 crypto rx=0x7f72c40b2d90 tx=0x7f72bc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32727ef42c104593 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72c8fb1640 1 -- 172.21.15.16:0/3769469837 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a5960 con 0x7f72c40b3700 2023-11-29T03:15:43.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72c8fb1640 1 -- 172.21.15.16:0/3769469837 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc0a5ac0 con 0x7f72c40b3700 2023-11-29T03:15:43.891 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72c8fb1640 1 -- 172.21.15.16:0/3769469837 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc0a5e50 con 0x7f72c40b3700 2023-11-29T03:15:43.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 -- 172.21.15.16:0/3769469837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40b3700 msgr2=0x7f72c40b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.892 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3769469837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40b3700 0x7f72c40b3b50 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 crypto rx=0x7f72c40b2d90 tx=0x7f72bc01c880 comp rx=0 tx=0).stop 2023-11-29T03:15:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 -- 172.21.15.16:0/3769469837 shutdown_connections 2023-11-29T03:15:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3769469837 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40b3700 0x7f72c40b3b50 unknown :-1 s=CLOSED pgs=3314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3769469837 >> v2:172.21.15.64:3300/0 conn(0x7f72c40d3210 0x7f72c40d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 -- 172.21.15.16:0/3769469837 >> 172.21.15.16:0/3769469837 conn(0x7f72c408cc90 msgr2=0x7f72c409c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:43.893 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 -- 172.21.15.16:0/3769469837 shutdown_connections 2023-11-29T03:15:43.894 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.889+0000 7f72cafb5640 1 -- 172.21.15.16:0/3769469837 wait complete. 2023-11-29T03:15:43.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.893+0000 7f72cafb5640 1 Processor -- start 2023-11-29T03:15:43.898 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.893+0000 7f72cafb5640 1 -- start start 2023-11-29T03:15:43.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72cafb5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c40b3700 0x7f72c40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72cafb5640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 0x7f72c4151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72cafb5640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c415d480 0x7f72c415f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.901 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72cafb5640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c40c8fd0 con 0x7f72c40d3210 2023-11-29T03:15:43.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72cafb5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4152c60 con 0x7f72c40b3700 2023-11-29T03:15:43.902 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72c9fb3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c40b3700 0x7f72c40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72c97b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 0x7f72c4151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72cafb5640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c4152f40 con 0x7f72c415d480 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72ca7b4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c415d480 0x7f72c415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72c97b2640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 0x7f72c4151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35342/0 (socket says 172.21.15.16:35342) 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.897+0000 7f72c97b2640 1 -- 172.21.15.16:0/3582911317 learned_addr learned my addr 172.21.15.16:0/3582911317 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72c97b2640 1 -- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c415d480 msgr2=0x7f72c415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72c97b2640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c415d480 0x7f72c415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72c97b2640 1 -- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c40b3700 msgr2=0x7f72c40c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:43.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72c97b2640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c40b3700 0x7f72c40c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:43.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72c97b2640 1 -- 172.21.15.16:0/3582911317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009a70 con 0x7f72c40d3210 2023-11-29T03:15:43.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72c97b2640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 0x7f72c4151880 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 crypto rx=0x7f72b400e930 tx=0x7f72b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b4009690 con 0x7f72c40d3210 2023-11-29T03:15:43.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b400ca00 con 0x7f72c40d3210 2023-11-29T03:15:43.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c4153220 con 0x7f72c40d3210 2023-11-29T03:15:43.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b400cd70 con 0x7f72c40d3210 2023-11-29T03:15:43.905 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.901+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c415ed50 con 0x7f72c40d3210 2023-11-29T03:15:43.906 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.905+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c404e890 con 0x7f72c40d3210 2023-11-29T03:15:43.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.905+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f72b4013470 con 0x7f72c40d3210 2023-11-29T03:15:43.912 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.909+0000 7f72ba7fc640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72a80668d0 0x7f72a8068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:43.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.909+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72b40842d0 con 0x7f72c40d3210 2023-11-29T03:15:43.913 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.909+0000 7f72c9fb3640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72a80668d0 0x7f72a8068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:43.914 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.909+0000 7f72c9fb3640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72a80668d0 0x7f72a8068d90 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f72c0005890 tx=0x7f72c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:43.916 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:43.913+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72b4051970 con 0x7f72c40d3210 2023-11-29T03:15:44.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.381+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f72c4151f90 con 0x7f72a80668d0 2023-11-29T03:15:44.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.385+0000 7f72ba7fc640 1 -- 172.21.15.16:0/3582911317 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72c4151f90 con 0x7f72a80668d0 2023-11-29T03:15:44.387 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 5 to deep-scrub 2023-11-29T03:15:44.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72a80668d0 msgr2=0x7f72a8068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72a80668d0 0x7f72a8068d90 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f72c0005890 tx=0x7f72c0009040 comp rx=0 tx=0).stop 2023-11-29T03:15:44.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 msgr2=0x7f72c4151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 0x7f72c4151880 secure :-1 s=READY pgs=3315 cs=0 l=1 rev1=1 crypto rx=0x7f72b400e930 tx=0x7f72b400edf0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 shutdown_connections 2023-11-29T03:15:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f72c415d480 0x7f72c415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f72c40d3210 0x7f72c4151880 unknown :-1 s=CLOSED pgs=3315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f72a80668d0 0x7f72a8068d90 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 --2- 172.21.15.16:0/3582911317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72c40b3700 0x7f72c40c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 >> 172.21.15.16:0/3582911317 conn(0x7f72c408cc90 msgr2=0x7f72c415c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:44.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 shutdown_connections 2023-11-29T03:15:44.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.389+0000 7f72cafb5640 1 -- 172.21.15.16:0/3582911317 wait complete. 2023-11-29T03:15:44.442 INFO:tasks.ceph:Scrubbing osd.6 2023-11-29T03:15:44.443 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:44.667 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 Processor -- start 2023-11-29T03:15:44.668 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 -- start start 2023-11-29T03:15:44.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc415d5f0 0x7fafc40cebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fafc40d12a0 0x7fafc40d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.670 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc415d9d0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40ce750 con 0x7fafc40d12a0 2023-11-29T03:15:44.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.665+0000 7fafc359e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40d2020 con 0x7fafc415d5f0 2023-11-29T03:15:44.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fafc40d12a0 0x7fafc40d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.671 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7fafc40d12a0 0x7fafc40d1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35352/0 (socket says 172.21.15.16:35352) 2023-11-29T03:15:44.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 -- 172.21.15.16:0/2039066795 learned_addr learned my addr 172.21.15.16:0/2039066795 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:44.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc259c640 1 --2- 172.21.15.16:0/2039066795 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc415d5f0 0x7fafc40cebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.672 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc1d9b640 1 --1- 172.21.15.16:0/2039066795 >> v1:172.21.15.64:6789/0 conn(0x7fafc40d2ee0 0x7fafc40d3340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:35614/0 (socket says 172.21.15.16:35614) 2023-11-29T03:15:44.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 -- 172.21.15.16:0/2039066795 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc415d5f0 msgr2=0x7fafc40cebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:44.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 --2- 172.21.15.16:0/2039066795 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc415d5f0 0x7fafc40cebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 -- 172.21.15.16:0/2039066795 >> v1:172.21.15.64:6789/0 conn(0x7fafc40d2ee0 legacy=0x7fafc40d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.674 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.669+0000 7fafc2d9d640 1 -- 172.21.15.16:0/2039066795 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40ce100 con 0x7fafc40d12a0 2023-11-29T03:15:44.679 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc2d9d640 1 --2- 172.21.15.16:0/2039066795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc40d12a0 0x7fafc40d1730 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009e50 tx=0x7fafbc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c14868956c75d0d1 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:44.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc159a640 1 -- 172.21.15.16:0/2039066795 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0a58d0 con 0x7fafc40d12a0 2023-11-29T03:15:44.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc159a640 1 -- 172.21.15.16:0/2039066795 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc0a5a30 con 0x7fafc40d12a0 2023-11-29T03:15:44.680 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc159a640 1 -- 172.21.15.16:0/2039066795 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc0a5dc0 con 0x7fafc40d12a0 2023-11-29T03:15:44.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 -- 172.21.15.16:0/2039066795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc40d12a0 msgr2=0x7fafc40d1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.681 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 --2- 172.21.15.16:0/2039066795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc40d12a0 0x7fafc40d1730 secure :-1 s=READY pgs=3316 cs=0 l=1 rev1=1 crypto rx=0x7fafbc009e50 tx=0x7fafbc01c9e0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 -- 172.21.15.16:0/2039066795 shutdown_connections 2023-11-29T03:15:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 --2- 172.21.15.16:0/2039066795 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc40d12a0 0x7fafc40d1730 unknown :-1 s=CLOSED pgs=3316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 --2- 172.21.15.16:0/2039066795 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc415d5f0 0x7fafc40cebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 -- 172.21.15.16:0/2039066795 >> 172.21.15.16:0/2039066795 conn(0x7fafc408cc20 msgr2=0x7fafc409c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 -- 172.21.15.16:0/2039066795 shutdown_connections 2023-11-29T03:15:44.682 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.677+0000 7fafc359e640 1 -- 172.21.15.16:0/2039066795 wait complete. 2023-11-29T03:15:44.683 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 Processor -- start 2023-11-29T03:15:44.684 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 -- start start 2023-11-29T03:15:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafc40d12a0 0x7fafc406c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc40d2ee0 0x7fafc414edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc415d5f0 0x7fafc414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc414e920 con 0x7fafc415d5f0 2023-11-29T03:15:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4160990 con 0x7fafc40d12a0 2023-11-29T03:15:44.685 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc359e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc414dff0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc415d5f0 0x7fafc414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc1d9b640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc40d2ee0 0x7fafc414edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafc40d12a0 0x7fafc406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.687 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafc40d12a0 0x7fafc406c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56472/0 (socket says 172.21.15.16:56472) 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc2d9d640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc415d5f0 0x7fafc414f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35366/0 (socket says 172.21.15.16:35366) 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc259c640 1 -- 172.21.15.16:0/2366437060 learned_addr learned my addr 172.21.15.16:0/2366437060 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.681+0000 7fafc1d9b640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc40d2ee0 0x7fafc414edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:43662/0 (socket says 172.21.15.16:43662) 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc1d9b640 1 -- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafc40d12a0 msgr2=0x7fafc406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc1d9b640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafc40d12a0 0x7fafc406c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc1d9b640 1 -- 172.21.15.16:0/2366437060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc415d5f0 msgr2=0x7fafc414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.688 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc1d9b640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fafc415d5f0 0x7fafc414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc1d9b640 1 -- 172.21.15.16:0/2366437060 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc009b30 con 0x7fafc40d2ee0 2023-11-29T03:15:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc259c640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafc40d12a0 0x7fafc406c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:44.689 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc1d9b640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc40d2ee0 0x7fafc414edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c430 tx=0x7fafb800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb80074e0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb8007640 con 0x7fafc40d2ee0 2023-11-29T03:15:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8004a10 con 0x7fafc40d2ee0 2023-11-29T03:15:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc414e2d0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.690 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.685+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc41605d0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.691 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.689+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fafc40b3690 con 0x7fafc40d2ee0 2023-11-29T03:15:44.693 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.689+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fafb8004b70 con 0x7fafc40d2ee0 2023-11-29T03:15:44.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafb2ffd640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fafa4066950 0x7fafa4068e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fafb80838c0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.696 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafb2ffd640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7fafa406c7b0 0x7fafa406ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafc259c640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fafa4066950 0x7fafa4068e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 --> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fafa406f280 con 0x7fafa406c7b0 2023-11-29T03:15:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafb80882c0 con 0x7fafc40d2ee0 2023-11-29T03:15:44.697 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafc2d9d640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7fafa406c7b0 0x7fafa406ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafc2d9d640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7fafa406c7b0 0x7fafa406ebd0 crc :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:44.698 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.693+0000 7fafc259c640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fafa4066950 0x7fafa4068e10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009f70 tx=0x7fafb4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:44.718 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.713+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== osd.6 v2:172.21.15.64:6824/4135110643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fafa406f280 con 0x7fafa406c7b0 2023-11-29T03:15:44.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.753+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 --> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fafc414ea90 con 0x7fafa406c7b0 2023-11-29T03:15:44.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.757+0000 7fafb2ffd640 1 -- 172.21.15.16:0/2366437060 <== osd.6 v2:172.21.15.64:6824/4135110643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fafc414ea90 con 0x7fafa406c7b0 2023-11-29T03:15:44.762 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:44.762 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:44.762 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:44.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.757+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7fafa406c7b0 msgr2=0x7fafa406ebd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6824/4135110643,v1:172.21.15.64:6825/4135110643] conn(0x7fafa406c7b0 0x7fafa406ebd0 crc :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fafa4066950 msgr2=0x7fafa4068e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fafa4066950 0x7fafa4068e10 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009f70 tx=0x7fafb4009190 comp rx=0 tx=0).stop 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc40d2ee0 msgr2=0x7fafc414edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 --2- 172.21.15.16:0/2366437060 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fafc40d2ee0 0x7fafc414edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fafb800c430 tx=0x7fafb800c8f0 comp rx=0 tx=0).stop 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc2d9d640 1 -- 172.21.15.16:0/2366437060 reap_dead start 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 shutdown_connections 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 >> 172.21.15.16:0/2366437060 conn(0x7fafc408cc20 msgr2=0x7fafc40b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 shutdown_connections 2023-11-29T03:15:44.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:44.761+0000 7fafc359e640 1 -- 172.21.15.16:0/2366437060 wait complete. 2023-11-29T03:15:44.811 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-29T03:15:45.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.217+0000 7f84e98ea640 1 Processor -- start 2023-11-29T03:15:45.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.217+0000 7f84e98ea640 1 -- start start 2023-11-29T03:15:45.224 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e98ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e415d540 0x7f84e40b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:45.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e98ea640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f84e40d1f50 0x7f84e40d2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:45.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e98ea640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84e40b32c0 con 0x7f84e40d34c0 2023-11-29T03:15:45.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e98ea640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e415d920 con 0x7f84e40d1f50 2023-11-29T03:15:45.225 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e98ea640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e40b35a0 con 0x7f84e415d540 2023-11-29T03:15:45.226 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f84e40d1f50 0x7f84e40d2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:45.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e2ffd640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e415d540 0x7f84e40b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:45.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f84e40d1f50 0x7f84e40d2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:56478/0 (socket says 172.21.15.16:56478) 2023-11-29T03:15:45.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 -- 172.21.15.16:0/455256174 learned_addr learned my addr 172.21.15.16:0/455256174 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:45.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 -- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e415d540 msgr2=0x7f84e40b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:45.227 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 --2- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e415d540 0x7f84e40b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 -- 172.21.15.16:0/455256174 >> v1:172.21.15.64:6789/0 conn(0x7f84e40d34c0 legacy=0x7f84e40cfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:45.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.221+0000 7f84e27fc640 1 -- 172.21.15.16:0/455256174 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e40b3880 con 0x7f84e40d1f50 2023-11-29T03:15:45.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.225+0000 7f84e27fc640 1 --2- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e40d2f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009870 tx=0x7f84d801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44ca121949ad5362 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:45.229 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.225+0000 7f84e1ffb640 1 -- 172.21.15.16:0/455256174 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80aa670 con 0x7f84e40d1f50 2023-11-29T03:15:45.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.225+0000 7f84e1ffb640 1 -- 172.21.15.16:0/455256174 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d80aa7d0 con 0x7f84e40d1f50 2023-11-29T03:15:45.230 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.225+0000 7f84e1ffb640 1 -- 172.21.15.16:0/455256174 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d80aab60 con 0x7f84e40d1f50 2023-11-29T03:15:45.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 -- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 msgr2=0x7f84e40d2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:45.231 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 --2- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e40d2f80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f84d8009870 tx=0x7f84d801c510 comp rx=0 tx=0).stop 2023-11-29T03:15:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 -- 172.21.15.16:0/455256174 shutdown_connections 2023-11-29T03:15:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 --2- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e40d2f80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 --2- 172.21.15.16:0/455256174 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e415d540 0x7f84e40b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 -- 172.21.15.16:0/455256174 >> 172.21.15.16:0/455256174 conn(0x7f84e408ccf0 msgr2=0x7f84e409c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:45.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 -- 172.21.15.16:0/455256174 shutdown_connections 2023-11-29T03:15:45.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.229+0000 7f84e98ea640 1 -- 172.21.15.16:0/455256174 wait complete. 2023-11-29T03:15:45.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.233+0000 7f84e98ea640 1 Processor -- start 2023-11-29T03:15:45.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.233+0000 7f84e98ea640 1 -- start start 2023-11-29T03:15:45.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e98ea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e414c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:45.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e98ea640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e40d34c0 0x7f84e4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:45.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e98ea640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 0x7f84e415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:45.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e98ea640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414cbb0 con 0x7f84e415d540 2023-11-29T03:15:45.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e98ea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414ce90 con 0x7f84e40d1f50 2023-11-29T03:15:45.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e98ea640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e414d170 con 0x7f84e40d34c0 2023-11-29T03:15:45.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 0x7f84e415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:45.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 0x7f84e415f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:35374/0 (socket says 172.21.15.16:35374) 2023-11-29T03:15:45.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 -- 172.21.15.16:0/2750803697 learned_addr learned my addr 172.21.15.16:0/2750803697 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:45.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e2ffd640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:45.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e27fc640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e40d34c0 0x7f84e4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:45.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 -- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e40d34c0 msgr2=0x7f84e4155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:45.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e40d34c0 0x7f84e4155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 -- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 msgr2=0x7f84e414c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:45.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e414c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 -- 172.21.15.16:0/2750803697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d80094d0 con 0x7f84e415d540 2023-11-29T03:15:45.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84e37fe640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 0x7f84e415f0c0 secure :-1 s=READY pgs=3317 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00c770 tx=0x7f84dc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:45.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.237+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc003b80 con 0x7f84e415d540 2023-11-29T03:15:45.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.241+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84dc003ce0 con 0x7f84e415d540 2023-11-29T03:15:45.245 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.241+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84dc00aa90 con 0x7f84e415d540 2023-11-29T03:15:45.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.241+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e415b2f0 con 0x7f84e415d540 2023-11-29T03:15:45.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.241+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e414c880 con 0x7f84e415d540 2023-11-29T03:15:45.246 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.241+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e415b530 con 0x7f84e415d540 2023-11-29T03:15:45.249 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.245+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f84dc00abf0 con 0x7f84e415d540 2023-11-29T03:15:45.251 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.249+0000 7f84cbfff640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f84d00668d0 0x7f84d0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:45.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.249+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84dc083ed0 con 0x7f84e415d540 2023-11-29T03:15:45.252 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.249+0000 7f84e2ffd640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f84d00668d0 0x7f84d0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:45.254 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.249+0000 7f84e2ffd640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f84d00668d0 0x7f84d0068d90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009ac0 tx=0x7f84d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:45.264 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.261+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84e415b530 con 0x7f84e415d540 2023-11-29T03:15:45.728 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.725+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f84e414d000 con 0x7f84d00668d0 2023-11-29T03:15:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.725+0000 7f84cbfff640 1 -- 172.21.15.16:0/2750803697 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f84e414d000 con 0x7f84d00668d0 2023-11-29T03:15:45.729 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 6 to deep-scrub 2023-11-29T03:15:45.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f84d00668d0 msgr2=0x7f84d0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:45.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f84d00668d0 0x7f84d0068d90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f84d4009ac0 tx=0x7f84d4009190 comp rx=0 tx=0).stop 2023-11-29T03:15:45.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 msgr2=0x7f84e415f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:45.734 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 0x7f84e415f0c0 secure :-1 s=READY pgs=3317 cs=0 l=1 rev1=1 crypto rx=0x7f84dc00c770 tx=0x7f84dc00cc30 comp rx=0 tx=0).stop 2023-11-29T03:15:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 shutdown_connections 2023-11-29T03:15:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f84e415d540 0x7f84e415f0c0 unknown :-1 s=CLOSED pgs=3317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f84e40d34c0 0x7f84e4155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f84d00668d0 0x7f84d0068d90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 --2- 172.21.15.16:0/2750803697 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f84e40d1f50 0x7f84e414c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:45.735 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.729+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 >> 172.21.15.16:0/2750803697 conn(0x7f84e408ccf0 msgr2=0x7f84e40b5260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:45.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.733+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 shutdown_connections 2023-11-29T03:15:45.736 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:45.733+0000 7f84e98ea640 1 -- 172.21.15.16:0/2750803697 wait complete. 2023-11-29T03:15:45.785 INFO:tasks.ceph:Scrubbing osd.7 2023-11-29T03:15:45.785 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-29T03:15:46.205 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.201+0000 7f520909c640 1 Processor -- start 2023-11-29T03:15:46.206 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.201+0000 7f520909c640 1 -- start start 2023-11-29T03:15:46.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520909c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204161710 0x7f5204165d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520909c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5204146110 0x7f52040708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.209 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520909c640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5204070e00 con 0x7f5204070460 2023-11-29T03:15:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520909c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52041662d0 con 0x7f5204146110 2023-11-29T03:15:46.210 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520909c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520406c6d0 con 0x7f5204161710 2023-11-29T03:15:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520359e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5204146110 0x7f52040708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f5202d9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204161710 0x7f5204165d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520259c640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f5204070460 0x7f5204146f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58316/0 (socket says 172.21.15.16:58316) 2023-11-29T03:15:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.205+0000 7f520259c640 1 -- 172.21.15.16:0/458193514 learned_addr learned my addr 172.21.15.16:0/458193514 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.209+0000 7f5202d9d640 1 -- 172.21.15.16:0/458193514 >> v2:172.21.15.64:3300/0 conn(0x7f5204146110 msgr2=0x7f52040708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:46.211 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.209+0000 7f5202d9d640 1 --2- 172.21.15.16:0/458193514 >> v2:172.21.15.64:3300/0 conn(0x7f5204146110 0x7f52040708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.209+0000 7f5202d9d640 1 -- 172.21.15.16:0/458193514 >> v1:172.21.15.16:6789/0 conn(0x7f5204070460 legacy=0x7f5204146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.212 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.209+0000 7f5202d9d640 1 -- 172.21.15.16:0/458193514 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520406c9b0 con 0x7f5204161710 2023-11-29T03:15:46.220 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f5202d9d640 1 --2- 172.21.15.16:0/458193514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204161710 0x7f5204165d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f51f40097c0 tx=0x7f51f401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a323cdb27b7cd7 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f5201d9b640 1 -- 172.21.15.16:0/458193514 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40ab650 con 0x7f5204161710 2023-11-29T03:15:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f5201d9b640 1 -- 172.21.15.16:0/458193514 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f40ab7b0 con 0x7f5204161710 2023-11-29T03:15:46.221 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f5201d9b640 1 -- 172.21.15.16:0/458193514 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f40abb40 con 0x7f5204161710 2023-11-29T03:15:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f520909c640 1 -- 172.21.15.16:0/458193514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204161710 msgr2=0x7f5204165d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.222 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f520909c640 1 --2- 172.21.15.16:0/458193514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204161710 0x7f5204165d90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f51f40097c0 tx=0x7f51f401c450 comp rx=0 tx=0).stop 2023-11-29T03:15:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f520909c640 1 -- 172.21.15.16:0/458193514 shutdown_connections 2023-11-29T03:15:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f520909c640 1 --2- 172.21.15.16:0/458193514 >> v2:172.21.15.64:3300/0 conn(0x7f5204146110 0x7f52040708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f520909c640 1 --2- 172.21.15.16:0/458193514 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204161710 0x7f5204165d90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.217+0000 7f520909c640 1 -- 172.21.15.16:0/458193514 >> 172.21.15.16:0/458193514 conn(0x7f520406a5a0 msgr2=0x7f520406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.221+0000 7f520909c640 1 -- 172.21.15.16:0/458193514 shutdown_connections 2023-11-29T03:15:46.223 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.221+0000 7f520909c640 1 -- 172.21.15.16:0/458193514 wait complete. 2023-11-29T03:15:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.225+0000 7f520909c640 1 Processor -- start 2023-11-29T03:15:46.228 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.225+0000 7f520909c640 1 -- start start 2023-11-29T03:15:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5204070460 0x7f5204160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204146110 0x7f5204143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5204161710 0x7f520413c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040af530 con 0x7f5204161710 2023-11-29T03:15:46.232 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040ae920 con 0x7f5204070460 2023-11-29T03:15:46.233 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040aec00 con 0x7f5204146110 2023-11-29T03:15:46.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204146110 0x7f5204143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.234 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204146110 0x7f5204143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:43696/0 (socket says 172.21.15.16:43696) 2023-11-29T03:15:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 -- 172.21.15.16:0/3187740217 learned_addr learned my addr 172.21.15.16:0/3187740217 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f5202d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5204070460 0x7f5204160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520359e640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5204161710 0x7f520413c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 -- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5204070460 msgr2=0x7f5204160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5204070460 0x7f5204160a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.235 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 -- 172.21.15.16:0/3187740217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5204161710 msgr2=0x7f520413c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5204161710 0x7f520413c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 -- 172.21.15.16:0/3187740217 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f4009420 con 0x7f5204146110 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520359e640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f5204161710 0x7f520413c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520259c640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204146110 0x7f5204143ec0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c500 tx=0x7f51f800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8005cf0 con 0x7f5204146110 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8005e50 con 0x7f5204146110 2023-11-29T03:15:46.236 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80072f0 con 0x7f5204146110 2023-11-29T03:15:46.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.229+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040aeee0 con 0x7f5204146110 2023-11-29T03:15:46.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.233+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040af9c0 con 0x7f5204146110 2023-11-29T03:15:46.237 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.233+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f520414b130 con 0x7f5204146110 2023-11-29T03:15:46.239 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.237+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f51f8007450 con 0x7f5204146110 2023-11-29T03:15:46.241 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.237+0000 7f51eb7fe640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f51f00668d0 0x7f51f0068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.237+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51f80836a0 con 0x7f5204146110 2023-11-29T03:15:46.242 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.237+0000 7f51eb7fe640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f51f006c730 0x7f51f006eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.241+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 --> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51f006f200 con 0x7f51f006c730 2023-11-29T03:15:46.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.241+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51f8085c20 con 0x7f5204146110 2023-11-29T03:15:46.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.241+0000 7f5202d9d640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f51f00668d0 0x7f51f0068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.243 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.241+0000 7f520359e640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f51f006c730 0x7f51f006eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.241+0000 7f520359e640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f51f006c730 0x7f51f006eb50 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.244 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.241+0000 7f5202d9d640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f51f00668d0 0x7f51f0068d90 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f51f40af000 tx=0x7f51f40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.263 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.261+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== osd.7 v2:172.21.15.64:6800/946925986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f51f006f200 con 0x7f51f006c730 2023-11-29T03:15:46.302 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.301+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 --> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f52040aed40 con 0x7f51f006c730 2023-11-29T03:15:46.311 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f51eb7fe640 1 -- 172.21.15.16:0/3187740217 <== osd.7 v2:172.21.15.64:6800/946925986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f52040aed40 con 0x7f51f006c730 2023-11-29T03:15:46.311 INFO:teuthology.orchestra.run.smithi016.stdout:{ 2023-11-29T03:15:46.311 INFO:teuthology.orchestra.run.smithi016.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-29T03:15:46.312 INFO:teuthology.orchestra.run.smithi016.stdout:} 2023-11-29T03:15:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f51f006c730 msgr2=0x7f51f006eb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.312 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6800/946925986,v1:172.21.15.64:6801/946925986] conn(0x7f51f006c730 0x7f51f006eb50 crc :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f51f00668d0 msgr2=0x7f51f0068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f51f00668d0 0x7f51f0068d90 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f51f40af000 tx=0x7f51f40a7000 comp rx=0 tx=0).stop 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204146110 msgr2=0x7f5204143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 --2- 172.21.15.16:0/3187740217 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f5204146110 0x7f5204143ec0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f51f800c500 tx=0x7f51f800c9c0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520359e640 1 -- 172.21.15.16:0/3187740217 reap_dead start 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 shutdown_connections 2023-11-29T03:15:46.313 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 >> 172.21.15.16:0/3187740217 conn(0x7f520406a5a0 msgr2=0x7f5204148da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 shutdown_connections 2023-11-29T03:15:46.314 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.309+0000 7f520909c640 1 -- 172.21.15.16:0/3187740217 wait complete. 2023-11-29T03:15:46.361 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-29T03:15:46.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.757+0000 7fad7a879640 1 Processor -- start 2023-11-29T03:15:46.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.757+0000 7fad7a879640 1 -- start start 2023-11-29T03:15:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad7a879640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad74145810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.763 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad7a879640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7406c6d0 con 0x7fad74161710 2023-11-29T03:15:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad7a879640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad7406c9b0 con 0x7fad74070460 2023-11-29T03:15:46.764 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad7a879640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7406cc90 con 0x7fad740708c0 2023-11-29T03:15:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad73fff640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7fad74161710 0x7fad74165d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:58326/0 (socket says 172.21.15.16:58326) 2023-11-29T03:15:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad73fff640 1 -- 172.21.15.16:0/1204365178 learned_addr learned my addr 172.21.15.16:0/1204365178 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad78e16640 1 --2- 172.21.15.16:0/1204365178 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad74145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 <== mon.1 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631245264 0 0) 0x7fad7406c9b0 con 0x7fad74070460 2023-11-29T03:15:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad5c003530 con 0x7fad74070460 2023-11-29T03:15:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 <== mon.0 v1:172.21.15.16:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780296422 0 0) 0x7fad7406c6d0 con 0x7fad74161710 2023-11-29T03:15:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 --> v1:172.21.15.16:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7406c9b0 con 0x7fad74161710 2023-11-29T03:15:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad78e16640 1 -- 172.21.15.16:0/1204365178 >> v1:172.21.15.64:6789/0 conn(0x7fad74070460 legacy=0x7fad74145100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.766 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 <== mon.1 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 970865556 0 0) 0x7fad5c003530 con 0x7fad74070460 2023-11-29T03:15:46.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad78e16640 1 -- 172.21.15.16:0/1204365178 >> v1:172.21.15.16:6789/0 conn(0x7fad74161710 legacy=0x7fad74165d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.767 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.761+0000 7fad78e16640 1 -- 172.21.15.16:0/1204365178 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad7406cf70 con 0x7fad740708c0 2023-11-29T03:15:46.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.769+0000 7fad78e16640 1 --2- 172.21.15.16:0/1204365178 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad74145810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009dc0 tx=0x7fad6c01d2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1293bb92f7f6c9 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68001680 con 0x7fad740708c0 2023-11-29T03:15:46.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c0a56e0 con 0x7fad740708c0 2023-11-29T03:15:46.775 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad72ffd640 1 -- 172.21.15.16:0/1204365178 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0a5a70 con 0x7fad740708c0 2023-11-29T03:15:46.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 -- 172.21.15.16:0/1204365178 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 msgr2=0x7fad74145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 --2- 172.21.15.16:0/1204365178 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad74145810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009dc0 tx=0x7fad6c01d2e0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 -- 172.21.15.16:0/1204365178 shutdown_connections 2023-11-29T03:15:46.776 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 --2- 172.21.15.16:0/1204365178 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad74145810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 -- 172.21.15.16:0/1204365178 >> 172.21.15.16:0/1204365178 conn(0x7fad7406a5a0 msgr2=0x7fad7406a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:46.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 -- 172.21.15.16:0/1204365178 shutdown_connections 2023-11-29T03:15:46.777 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.773+0000 7fad7a879640 1 -- 172.21.15.16:0/1204365178 wait complete. 2023-11-29T03:15:46.781 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.777+0000 7fad7a879640 1 Processor -- start 2023-11-29T03:15:46.782 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.777+0000 7fad7a879640 1 -- start start 2023-11-29T03:15:46.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad7a879640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad74070460 0x7fad74149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad7a879640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad7413a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad7a879640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74161710 0x7fad7413abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad7a879640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad74133690 con 0x7fad74161710 2023-11-29T03:15:46.785 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad7a879640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad74160420 con 0x7fad74070460 2023-11-29T03:15:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad7a879640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad74160700 con 0x7fad740708c0 2023-11-29T03:15:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad737fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad7413a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad73fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad74070460 0x7fad74149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad78e16640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74161710 0x7fad7413abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad737fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad7413a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:43712/0 (socket says 172.21.15.16:43712) 2023-11-29T03:15:46.786 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.781+0000 7fad737fe640 1 -- 172.21.15.16:0/62467535 learned_addr learned my addr 172.21.15.16:0/62467535 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:46.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad78e16640 1 -- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 msgr2=0x7fad7413a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad78e16640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad7413a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad78e16640 1 -- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad74070460 msgr2=0x7fad74149220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:46.787 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad78e16640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad74070460 0x7fad74149220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:46.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad78e16640 1 -- 172.21.15.16:0/62467535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009a70 con 0x7fad74161710 2023-11-29T03:15:46.788 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad73fff640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad74070460 0x7fad74149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:46.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad78e16640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74161710 0x7fad7413abb0 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0ac000 tx=0x7fad74146560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0bd070 con 0x7fad74161710 2023-11-29T03:15:46.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c009450 con 0x7fad74161710 2023-11-29T03:15:46.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0ad850 con 0x7fad74161710 2023-11-29T03:15:46.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad74132fd0 con 0x7fad74161710 2023-11-29T03:15:46.789 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.785+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7415d7e0 con 0x7fad74161710 2023-11-29T03:15:46.790 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.789+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad741337d0 con 0x7fad74161710 2023-11-29T03:15:46.794 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.793+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7fad6c0b4040 con 0x7fad74161710 2023-11-29T03:15:46.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.793+0000 7fad70ff9640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fad600668d0 0x7fad60068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:46.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.793+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad6c11ddf0 con 0x7fad74161710 2023-11-29T03:15:46.796 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.793+0000 7fad73fff640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fad600668d0 0x7fad60068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:46.797 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.793+0000 7fad73fff640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fad600668d0 0x7fad60068d90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fad64005890 tx=0x7fad64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:46.809 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:46.805+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fad741337d0 con 0x7fad74161710 2023-11-29T03:15:47.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.281+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fad74161af0 con 0x7fad600668d0 2023-11-29T03:15:47.284 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.281+0000 7fad70ff9640 1 -- 172.21.15.16:0/62467535 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad640018f0 con 0x7fad600668d0 2023-11-29T03:15:47.285 INFO:teuthology.orchestra.run.smithi016.stderr:instructed osd(s) 7 to deep-scrub 2023-11-29T03:15:47.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fad600668d0 msgr2=0x7fad60068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fad600668d0 0x7fad60068d90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fad64005890 tx=0x7fad64009040 comp rx=0 tx=0).stop 2023-11-29T03:15:47.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74161710 msgr2=0x7fad7413abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.289 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74161710 0x7fad7413abb0 secure :-1 s=READY pgs=3320 cs=0 l=1 rev1=1 crypto rx=0x7fad6c0ac000 tx=0x7fad74146560 comp rx=0 tx=0).stop 2023-11-29T03:15:47.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 shutdown_connections 2023-11-29T03:15:47.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7fad74161710 0x7fad7413abb0 unknown :-1 s=CLOSED pgs=3320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7fad740708c0 0x7fad7413a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7fad600668d0 0x7fad60068d90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.290 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 --2- 172.21.15.16:0/62467535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fad74070460 0x7fad74149220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 >> 172.21.15.16:0/62467535 conn(0x7fad7406a5a0 msgr2=0x7fad740b3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:47.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 shutdown_connections 2023-11-29T03:15:47.291 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.285+0000 7fad7a879640 1 -- 172.21.15.16:0/62467535 wait complete. 2023-11-29T03:15:47.341 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-29T03:15:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.741+0000 7f710f3c4640 1 Processor -- start 2023-11-29T03:15:47.746 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.741+0000 7f710f3c4640 1 -- start start 2023-11-29T03:15:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710f3c4640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f710815d4e0 0x7f71080b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710f3c4640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710815dc50 con 0x7f7108072400 2023-11-29T03:15:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710f3c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f710815df30 con 0x7f71080b2e00 2023-11-29T03:15:47.748 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710f3c4640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710815e8d0 con 0x7f710815d4e0 2023-11-29T03:15:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710d160640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f710815d4e0 0x7f71080b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710d160640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f710815d4e0 0x7f71080b28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50200/0 (socket says 172.21.15.16:50200) 2023-11-29T03:15:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710d160640 1 -- 172.21.15.16:0/142881697 learned_addr learned my addr 172.21.15.16:0/142881697 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710d160640 1 -- 172.21.15.16:0/142881697 >> v1:172.21.15.64:6789/0 conn(0x7f71080b2e00 legacy=0x7f7108071cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710d160640 1 -- 172.21.15.16:0/142881697 >> v1:172.21.15.16:6789/0 conn(0x7f7108072400 legacy=0x7f71080cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:47.749 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.745+0000 7f710d160640 1 -- 172.21.15.16:0/142881697 --> v2:172.21.15.16:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710815e210 con 0x7f710815d4e0 2023-11-29T03:15:47.752 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f710d160640 1 --2- 172.21.15.16:0/142881697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f710815d4e0 0x7f71080b28c0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f7104009870 tx=0x7f710401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647d4709a7921491 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f70fffff640 1 -- 172.21.15.16:0/142881697 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040aa650 con 0x7f710815d4e0 2023-11-29T03:15:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f70fffff640 1 -- 172.21.15.16:0/142881697 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71040aa7b0 con 0x7f710815d4e0 2023-11-29T03:15:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f70fffff640 1 -- 172.21.15.16:0/142881697 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040aab40 con 0x7f710815d4e0 2023-11-29T03:15:47.753 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f710f3c4640 1 -- 172.21.15.16:0/142881697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f710815d4e0 msgr2=0x7f71080b28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f710f3c4640 1 --2- 172.21.15.16:0/142881697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f710815d4e0 0x7f71080b28c0 secure :-1 s=READY pgs=3322 cs=0 l=1 rev1=1 crypto rx=0x7f7104009870 tx=0x7f710401c4d0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f710f3c4640 1 -- 172.21.15.16:0/142881697 shutdown_connections 2023-11-29T03:15:47.754 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f710f3c4640 1 --2- 172.21.15.16:0/142881697 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f710815d4e0 0x7f71080b28c0 unknown :-1 s=CLOSED pgs=3322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.749+0000 7f710f3c4640 1 -- 172.21.15.16:0/142881697 >> 172.21.15.16:0/142881697 conn(0x7f710806a5a0 msgr2=0x7f710806a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 -- 172.21.15.16:0/142881697 shutdown_connections 2023-11-29T03:15:47.755 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 -- 172.21.15.16:0/142881697 wait complete. 2023-11-29T03:15:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 Processor -- start 2023-11-29T03:15:47.756 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 -- start start 2023-11-29T03:15:47.757 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 0x7f7108148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:47.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f710815d4e0 0x7f71081489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:47.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7108153270 0x7f7108153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:47.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7108153c60 con 0x7f7108153270 2023-11-29T03:15:47.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710814bda0 con 0x7f710815d4e0 2023-11-29T03:15:47.758 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710f3c4640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f710814bff0 con 0x7f7108072400 2023-11-29T03:15:47.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710d160640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 0x7f7108148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:47.759 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710d961640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7108153270 0x7f7108153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710d160640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 0x7f7108148170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3301/0 says I am v2:172.21.15.16:59080/0 (socket says 172.21.15.16:59080) 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710d160640 1 -- 172.21.15.16:0/351814046 learned_addr learned my addr 172.21.15.16:0/351814046 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.753+0000 7f710c95f640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f710815d4e0 0x7f71081489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710d160640 1 -- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f710815d4e0 msgr2=0x7f71081489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710d160640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f710815d4e0 0x7f71081489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710d160640 1 -- 172.21.15.16:0/351814046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7108153270 msgr2=0x7f7108153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710d160640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7108153270 0x7f7108153720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710d160640 1 -- 172.21.15.16:0/351814046 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71040094d0 con 0x7f7108072400 2023-11-29T03:15:47.760 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710d160640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 0x7f7108148170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71040ac040 tx=0x7f710401ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:47.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040b3800 con 0x7f7108072400 2023-11-29T03:15:47.761 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71040b3980 con 0x7f7108072400 2023-11-29T03:15:47.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71040b3d30 con 0x7f7108072400 2023-11-29T03:15:47.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710814c2d0 con 0x7f7108072400 2023-11-29T03:15:47.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710814c890 con 0x7f7108072400 2023-11-29T03:15:47.762 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.757+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710814ca80 con 0x7f7108072400 2023-11-29T03:15:47.765 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.761+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f71040c6390 con 0x7f7108072400 2023-11-29T03:15:47.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.765+0000 7f70fdffb640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f70ec066920 0x7f70ec068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:47.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.765+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f710411ebf0 con 0x7f7108072400 2023-11-29T03:15:47.768 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.765+0000 7f710c95f640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f70ec066920 0x7f70ec068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:47.770 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.765+0000 7f710c95f640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f70ec066920 0x7f70ec068de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7108071980 tx=0x7f70f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:47.773 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.769+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71040ec1c0 con 0x7f7108072400 2023-11-29T03:15:47.936 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.933+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 --> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7108068860 con 0x7f70ec066920 2023-11-29T03:15:47.939 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f70fdffb640 1 -- 172.21.15.16:0/351814046 <== mgr.4100 v2:172.21.15.64:6832/2559396587 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49257 (secure 0 0 0) 0x7f7108068860 con 0x7f70ec066920 2023-11-29T03:15:47.940 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:47.940 INFO:teuthology.orchestra.run.smithi016.stderr:dumped all 2023-11-29T03:15:47.941 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f70ec066920 msgr2=0x7f70ec068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f70ec066920 0x7f70ec068de0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f7108071980 tx=0x7f70f8009040 comp rx=0 tx=0).stop 2023-11-29T03:15:47.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 msgr2=0x7f7108148170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:47.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 0x7f7108148170 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71040ac040 tx=0x7f710401ad10 comp rx=0 tx=0).stop 2023-11-29T03:15:47.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 shutdown_connections 2023-11-29T03:15:47.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f7108153270 0x7f7108153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.942 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f70ec066920 0x7f70ec068de0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f710815d4e0 0x7f71081489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 --2- 172.21.15.16:0/351814046 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f7108072400 0x7f7108148170 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:47.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 >> 172.21.15.16:0/351814046 conn(0x7f710806a5a0 msgr2=0x7f710815c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:47.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 shutdown_connections 2023-11-29T03:15:47.943 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:47.937+0000 7f710f3c4640 1 -- 172.21.15.16:0/351814046 wait complete. 2023-11-29T03:15:47.965 INFO:teuthology.orchestra.run.smithi016.stdout:{"pg_ready":true,"pg_map":{"version":17316,"stamp":"2023-11-29T03:15:46.745402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12534216,"kb_used_data":4744,"kb_used_omap":36860,"kb_used_meta":12492547,"kb_avail":742440504,"statfs":{"total":773094113280,"available":760259076096,"internally_reserved":0,"allocated":4857856,"data_stored":2633368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37745340,"internal_metadata":12792368452},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"1.0","version":"40'163","reported_seq":532,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-11-29T03:15:40.102446+0000","last_change":"2023-11-29T03:15:40.102495+0000","last_active":"2023-11-29T03:15:40.102446+0000","last_peered":"2023-11-29T03:15:40.102446+0000","last_clean":"2023-11-29T03:15:40.102446+0000","last_became_active":"2023-11-28T17:39:24.133999+0000","last_became_peered":"2023-11-28T17:39:24.133999+0000","last_unstale":"2023-11-29T03:15:40.102446+0000","last_undegraded":"2023-11-29T03:15:40.102446+0000","last_fullsized":"2023-11-29T03:15:40.102446+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"40'163","last_scrub_stamp":"2023-11-29T03:15:40.102327+0000","last_deep_scrub":"40'163","last_deep_scrub_stamp":"2023-11-29T03:15:40.102327+0000","last_clean_scrub_stamp":"2023-11-29T03:15:40.102327+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:19:29.224856+0000","scrub_duration":0.60148606199999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":6,"up_from":15,"seq":64424516345,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1353672,"kb_used_data":448,"kb_used_omap":5738,"kb_used_meta":1347477,"kb_avail":93018168,"statfs":{"total":96636764160,"available":95250604032,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5876368,"internal_metadata":1379816816},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.5229999999999999,"5min":1.2669999999999999,"15min":1.248},"min":{"1min":0.38300000000000001,"5min":0.36699999999999999,"15min":0.33500000000000002},"max":{"1min":6.3360000000000003,"5min":6.3360000000000003,"15min":6.665},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.831,"5min":1.4019999999999999,"15min":1.4359999999999999},"min":{"1min":0.48399999999999999,"5min":0.318,"15min":0.318},"max":{"1min":5.1829999999999998,"5min":5.1829999999999998,"15min":8.4800000000000004},"last":0.39500000000000002}]},{"osd":1,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3779999999999999,"15min":1.4890000000000001},"min":{"1min":0.45000000000000001,"5min":0.371,"15min":0.371},"max":{"1min":8.0229999999999997,"5min":8.0229999999999997,"15min":8.6069999999999993},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.794,"5min":1.4690000000000001,"15min":1.4379999999999999},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.40300000000000002},"max":{"1min":7.3799999999999999,"5min":7.3799999999999999,"15min":8.6630000000000003},"last":0.75}]},{"osd":2,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.6950000000000001,"15min":1.502},"min":{"1min":0.50700000000000001,"5min":0.372,"15min":0.372},"max":{"1min":3.9409999999999998,"5min":8.1790000000000003,"15min":11.333},"last":0.98699999999999999},{"interface":"front","average":{"1min":2.278,"5min":1.8220000000000001,"15min":1.6339999999999999},"min":{"1min":0.56499999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":12.827,"5min":12.827,"15min":12.827},"last":0.68400000000000005}]},{"osd":3,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":3.2749999999999999,"5min":1.9219999999999999,"15min":1.6799999999999999},"min":{"1min":0.67200000000000004,"5min":0.44600000000000001,"15min":0.439},"max":{"1min":25.420000000000002,"5min":25.420000000000002,"15min":25.420000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":2.988,"5min":1.9139999999999999,"15min":1.7130000000000001},"min":{"1min":0.78200000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":26.690000000000001,"5min":26.690000000000001,"15min":26.690000000000001},"last":0.70299999999999996}]},{"osd":4,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":0.83299999999999996,"15min":0.747},"min":{"1min":0.38,"5min":0.35399999999999998,"15min":0.33900000000000002},"max":{"1min":11.890000000000001,"5min":11.890000000000001,"15min":11.890000000000001},"last":0.504},{"interface":"front","average":{"1min":2.3860000000000001,"5min":1.1379999999999999,"15min":0.878},"min":{"1min":0.40000000000000002,"5min":0.39300000000000002,"15min":0.378},"max":{"1min":32.695,"5min":32.695,"15min":32.695},"last":0.46700000000000003}]},{"osd":5,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.95299999999999996,"15min":0.89700000000000002},"min":{"1min":0.47799999999999998,"5min":0.41599999999999998,"15min":0.35999999999999999},"max":{"1min":1.909,"5min":3.637,"15min":6.8789999999999996},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.109,"5min":0.97499999999999998,"15min":0.89900000000000002},"min":{"1min":0.502,"5min":0.45600000000000002,"15min":0.44500000000000001},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.8049999999999997},"last":0.58399999999999996}]},{"osd":7,"last update":"Wed Nov 29 03:14:56 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88300000000000001,"15min":0.85899999999999999},"min":{"1min":0.48299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":4.3250000000000002,"5min":4.6639999999999997,"15min":4.7270000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.117,"5min":0.95399999999999996,"15min":0.89700000000000002},"min":{"1min":0.54800000000000004,"5min":0.47699999999999998,"15min":0.39700000000000002},"max":{"1min":8.0719999999999992,"5min":8.0719999999999992,"15min":8.0719999999999992},"last":0.59799999999999998}]}]},{"osd":5,"up_from":15,"seq":64424516349,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1286348,"kb_used_data":1028,"kb_used_omap":3640,"kb_used_meta":1281671,"kb_avail":93085492,"statfs":{"total":96636764160,"available":95319543808,"internally_reserved":0,"allocated":1052672,"data_stored":771947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3727398,"internal_metadata":1312432090},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":1.4510000000000001,"15min":1.379},"min":{"1min":0.503,"5min":0.35799999999999998,"15min":0.311},"max":{"1min":4.9829999999999997,"5min":12.811999999999999,"15min":12.811999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.129,"5min":1.286,"15min":1.3540000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.2610000000000001,"5min":5.3259999999999996,"15min":7.3369999999999997},"last":0.93400000000000005}]},{"osd":1,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":1.5129999999999999,"5min":1.637,"15min":1.5840000000000001},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.39300000000000002},"max":{"1min":4.7359999999999998,"5min":11.077,"15min":11.077},"last":0.59299999999999997},{"interface":"front","average":{"1min":1.056,"5min":1.482,"15min":1.4239999999999999},"min":{"1min":0.40300000000000002,"5min":0.38200000000000001,"15min":0.38},"max":{"1min":4.4850000000000003,"5min":8.9410000000000007,"15min":8.9410000000000007},"last":0.77900000000000003}]},{"osd":2,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":1.9319999999999999,"15min":1.647},"min":{"1min":0.56499999999999995,"5min":0.46400000000000002,"15min":0.36899999999999999},"max":{"1min":5.3650000000000002,"5min":12.478,"15min":12.478},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.9359999999999999,"5min":1.861,"15min":1.7909999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.43099999999999999},"max":{"1min":13.722,"5min":13.722,"15min":13.722},"last":0.91300000000000003}]},{"osd":3,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":1.4970000000000001,"5min":1.9319999999999999,"15min":1.7050000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":4.5670000000000002,"5min":7.3659999999999997,"15min":7.3659999999999997},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.413,"5min":1.845,"15min":1.6879999999999999},"min":{"1min":0.65200000000000002,"5min":0.60099999999999998,"15min":0.55500000000000005},"max":{"1min":4.4320000000000004,"5min":6.742,"15min":7.1379999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.82399999999999995,"15min":0.79000000000000004},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.32800000000000001},"max":{"1min":2.7090000000000001,"5min":3.6070000000000002,"15min":3.6070000000000002},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.93200000000000005,"15min":0.84899999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":2.891,"5min":4.1500000000000004,"15min":4.1500000000000004},"last":0.98299999999999998}]},{"osd":6,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.878,"15min":0.871},"min":{"1min":0.376,"5min":0.376,"15min":0.34000000000000002},"max":{"1min":2.1320000000000001,"5min":6.0129999999999999,"15min":6.0129999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.90700000000000003,"15min":0.872},"min":{"1min":0.55300000000000005,"5min":0.46400000000000002,"15min":0.39100000000000001},"max":{"1min":1.2989999999999999,"5min":7.8019999999999996,"15min":7.8019999999999996},"last":0.88500000000000001}]},{"osd":7,"last update":"Wed Nov 29 03:15:43 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.97999999999999998,"15min":0.91200000000000003},"min":{"1min":0.46000000000000002,"5min":0.38,"15min":0.371},"max":{"1min":4.7480000000000002,"5min":7.0780000000000003,"15min":7.0780000000000003},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.99099999999999999,"15min":0.96899999999999997},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":2.4860000000000002,"5min":6.0919999999999996,"15min":6.0919999999999996},"last":0.85899999999999999}]}]},{"osd":4,"up_from":15,"seq":64424516343,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1704712,"kb_used_data":448,"kb_used_omap":5001,"kb_used_meta":1699254,"kb_avail":92667128,"statfs":{"total":96636764160,"available":94891139072,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5121709,"internal_metadata":1740036435},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.2949999999999999,"15min":1.359},"min":{"1min":0.41599999999999998,"5min":0.317,"15min":0.317},"max":{"1min":5.96,"5min":6.3280000000000003,"15min":12.282},"last":0.84599999999999997},{"interface":"front","average":{"1min":2.3100000000000001,"5min":1.665,"15min":1.5820000000000001},"min":{"1min":0.374,"5min":0.36099999999999999,"15min":0.33900000000000002},"max":{"1min":21.513000000000002,"5min":21.513000000000002,"15min":21.513000000000002},"last":0.67000000000000004}]},{"osd":1,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":2.3180000000000001,"5min":1.637,"15min":1.6850000000000001},"min":{"1min":0.57799999999999996,"5min":0.54400000000000004,"15min":0.46300000000000002},"max":{"1min":7.3650000000000002,"5min":7.3650000000000002,"15min":9.1530000000000005},"last":0.90200000000000002},{"interface":"front","average":{"1min":2.3980000000000001,"5min":1.675,"15min":1.7330000000000001},"min":{"1min":0.66300000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":7.4059999999999997,"5min":7.4059999999999997,"15min":9.1859999999999999},"last":0.95799999999999996}]},{"osd":2,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.351,"15min":1.5509999999999999},"min":{"1min":0.57799999999999996,"5min":0.495,"15min":0.34200000000000003},"max":{"1min":3.448,"5min":4,"15min":10.791},"last":0.98099999999999998},{"interface":"front","average":{"1min":2.4409999999999998,"5min":1.752,"15min":1.649},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.40799999999999997},"max":{"1min":7.9189999999999996,"5min":7.9189999999999996,"15min":7.9189999999999996},"last":0.86699999999999999}]},{"osd":3,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.5609999999999999,"5min":1.6359999999999999,"15min":1.575},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.40000000000000002},"max":{"1min":4.6390000000000002,"5min":6.4279999999999999,"15min":8.5470000000000006},"last":0.64200000000000002},{"interface":"front","average":{"1min":1.829,"5min":1.8049999999999999,"15min":1.6830000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46100000000000002},"max":{"1min":7.2489999999999997,"5min":7.2489999999999997,"15min":8.3309999999999995},"last":0.82599999999999996}]},{"osd":5,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.40999999999999998,"5min":0.35899999999999999,"15min":0.34599999999999997},"max":{"1min":7.2229999999999999,"5min":7.2229999999999999,"15min":7.2229999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.747,"15min":0.79400000000000004},"min":{"1min":0.43099999999999999,"5min":0.34200000000000003,"15min":0.33700000000000002},"max":{"1min":4.6799999999999997,"5min":4.6799999999999997,"15min":5.1890000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.71999999999999997,"15min":0.77800000000000002},"min":{"1min":0.40999999999999998,"5min":0.35799999999999998,"15min":0.32800000000000001},"max":{"1min":3.383,"5min":3.383,"15min":5.6660000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.2689999999999999,"5min":0.90900000000000003,"15min":0.877},"min":{"1min":0.501,"5min":0.47599999999999998,"15min":0.39500000000000002},"max":{"1min":7.2759999999999998,"5min":7.2759999999999998,"15min":7.2759999999999998},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed Nov 29 03:15:21 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.83299999999999996,"15min":0.84399999999999997},"min":{"1min":0.54000000000000004,"5min":0.432,"15min":0.376},"max":{"1min":4.6360000000000001,"5min":4.6360000000000001,"15min":4.6360000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.4390000000000001,"5min":0.98399999999999999,"15min":0.93999999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.44400000000000001},"max":{"1min":7.319,"5min":7.319,"15min":7.319},"last":0.80300000000000005}]}]},{"osd":3,"up_from":15,"seq":64424516302,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1816328,"kb_used_data":448,"kb_used_omap":6687,"kb_used_meta":1809184,"kb_avail":92555512,"statfs":{"total":96636764160,"available":94776844288,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6847688,"internal_metadata":1852605240},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2709999999999999,"5min":2.383,"15min":2.3530000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.41999999999999998},"max":{"1min":4.6719999999999997,"5min":9.8610000000000007,"15min":11.345000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":3.5859999999999999,"5min":2.6539999999999999,"15min":2.4940000000000002},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.31},"max":{"1min":9.6219999999999999,"5min":11.801,"15min":11.801},"last":1.5429999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.3140000000000001,"5min":2.6760000000000002,"15min":2.645},"min":{"1min":0.76300000000000001,"5min":0.53300000000000003,"15min":0.40100000000000002},"max":{"1min":4.867,"5min":11.289,"15min":11.289},"last":1.712},{"interface":"front","average":{"1min":2.6520000000000001,"5min":2.931,"15min":2.8090000000000002},"min":{"1min":0.73899999999999999,"5min":0.57099999999999995,"15min":0.48799999999999999},"max":{"1min":5.8179999999999996,"5min":19.702999999999999,"15min":19.702999999999999},"last":1.278}]},{"osd":2,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.4020000000000001,"5min":3.1059999999999999,"15min":3.0049999999999999},"min":{"1min":0.73199999999999998,"5min":0.71099999999999997,"15min":0.51900000000000002},"max":{"1min":5.5039999999999996,"5min":12.75,"15min":12.75},"last":0.83599999999999997},{"interface":"front","average":{"1min":3.29,"5min":3.0950000000000002,"15min":2.948},"min":{"1min":0.93899999999999995,"5min":0.77900000000000003,"15min":0.46600000000000003},"max":{"1min":14.326000000000001,"5min":14.962,"15min":14.962},"last":1.9099999999999999}]},{"osd":4,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.165,"15min":2.21},"min":{"1min":0.73299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":8.5289999999999999,"5min":8.5289999999999999,"15min":9.1799999999999997},"last":1.1220000000000001},{"interface":"front","average":{"1min":2.1869999999999998,"5min":2.4529999999999998,"15min":2.3900000000000001},"min":{"1min":0.77400000000000002,"5min":0.70199999999999996,"15min":0.55300000000000005},"max":{"1min":5.1840000000000002,"5min":7.5700000000000003,"15min":8.5679999999999996},"last":1.849}]},{"osd":5,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2120000000000002,"5min":2.5649999999999999,"15min":2.5129999999999999},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.60799999999999998},"max":{"1min":5.2949999999999999,"5min":7.6280000000000001,"15min":8.6910000000000007},"last":1.1819999999999999},{"interface":"front","average":{"1min":2.0790000000000002,"5min":2.3420000000000001,"15min":2.3929999999999998},"min":{"1min":0.78700000000000003,"5min":0.624,"15min":0.52100000000000002},"max":{"1min":4.931,"5min":9.6920000000000002,"15min":10.722},"last":2.1829999999999998}]},{"osd":6,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":3.2890000000000001,"5min":2.363,"15min":2.3879999999999999},"min":{"1min":0.81999999999999995,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":8.6440000000000001,"5min":8.6440000000000001,"15min":9.3770000000000007},"last":1.369},{"interface":"front","average":{"1min":2.3610000000000002,"5min":2.694,"15min":2.6539999999999999},"min":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.59599999999999997},"max":{"1min":5.4029999999999996,"5min":7.9139999999999997,"15min":8.7949999999999999},"last":1.423}]},{"osd":7,"last update":"Wed Nov 29 03:15:01 2023","interfaces":[{"interface":"back","average":{"1min":2.2389999999999999,"5min":2.556,"15min":2.569},"min":{"1min":0.79400000000000004,"5min":0.66000000000000003,"15min":0.56000000000000005},"max":{"1min":5.0460000000000003,"5min":10.939,"15min":10.939},"last":2.0539999999999998},{"interface":"front","average":{"1min":3.3279999999999998,"5min":2.5289999999999999,"15min":2.5609999999999999},"min":{"1min":0.77700000000000002,"5min":0.622,"15min":0.622},"max":{"1min":8.7479999999999993,"5min":8.7479999999999993,"15min":9.5099999999999998},"last":1.776}]}]},{"osd":2,"up_from":15,"seq":64424516293,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1265160,"kb_used_data":448,"kb_used_omap":3496,"kb_used_meta":1261207,"kb_avail":93106680,"statfs":{"total":96636764160,"available":95341240320,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3580142,"internal_metadata":1291476754},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.1339999999999999,"5min":4.2690000000000001,"15min":2.98},"min":{"1min":0.58999999999999997,"5min":0.46200000000000002,"15min":0.309},"max":{"1min":28.393999999999998,"5min":158.864,"15min":158.864},"last":0.88800000000000001},{"interface":"front","average":{"1min":2.3610000000000002,"5min":4.1740000000000004,"15min":3.0990000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.48999999999999999},"max":{"1min":8.3040000000000003,"5min":156.66200000000001,"15min":156.66200000000001},"last":1.4319999999999999}]},{"osd":1,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.0569999999999999,"5min":2.6669999999999998,"15min":2.6970000000000001},"min":{"1min":0.57299999999999995,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":12.154,"5min":17.699999999999999,"15min":17.699999999999999},"last":1.177},{"interface":"front","average":{"1min":2.7040000000000002,"5min":2.8610000000000002,"15min":2.706},"min":{"1min":0.93700000000000006,"5min":0.437,"15min":0.40000000000000002},"max":{"1min":6.8259999999999996,"5min":18.989999999999998,"15min":18.989999999999998},"last":1.778}]},{"osd":3,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1219999999999999,"5min":2.5590000000000002,"15min":2.5},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.48799999999999999},"max":{"1min":4.3499999999999996,"5min":11.087999999999999,"15min":11.087999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":3.5139999999999998,"5min":2.9169999999999998,"15min":2.887},"min":{"1min":0.67400000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":12.266,"5min":12.266,"15min":12.792999999999999},"last":1.4179999999999999}]},{"osd":4,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.0739999999999998,"5min":2.2010000000000001,"15min":2.1899999999999999},"min":{"1min":0.58099999999999996,"5min":0.47599999999999998,"15min":0.44500000000000001},"max":{"1min":5.7110000000000003,"5min":7.5780000000000003,"15min":7.5780000000000003},"last":1.5880000000000001},{"interface":"front","average":{"1min":2.04,"5min":2.105,"15min":2.137},"min":{"1min":0.45600000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":5.3730000000000002,"5min":5.9770000000000003,"15min":9.3719999999999999},"last":1.004}]},{"osd":5,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":3.399,"5min":2.5920000000000001,"15min":2.3439999999999999},"min":{"1min":0.65400000000000003,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":28.186,"5min":28.186,"15min":28.186},"last":1.319},{"interface":"front","average":{"1min":2.181,"5min":2.3439999999999999,"15min":2.3439999999999999},"min":{"1min":0.65100000000000002,"5min":0.54100000000000004,"15min":0.48299999999999998},"max":{"1min":5.9909999999999997,"5min":7.8209999999999997,"15min":9.5350000000000001},"last":1.7190000000000001}]},{"osd":6,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.1789999999999998,"5min":2.2599999999999998,"15min":2.343},"min":{"1min":0.503,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":5.4850000000000003,"5min":6.181,"15min":9.5020000000000007},"last":1.073},{"interface":"front","average":{"1min":3.5619999999999998,"5min":2.843,"15min":2.5720000000000001},"min":{"1min":0.83499999999999996,"5min":0.629,"15min":0.48699999999999999},"max":{"1min":28.300999999999998,"5min":28.300999999999998,"15min":28.300999999999998},"last":1.3680000000000001}]},{"osd":7,"last update":"Wed Nov 29 03:14:49 2023","interfaces":[{"interface":"back","average":{"1min":2.6120000000000001,"5min":2.5510000000000002,"15min":2.516},"min":{"1min":1.0369999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.6270000000000007,"5min":8.6270000000000007,"15min":9.3109999999999999},"last":1.657},{"interface":"front","average":{"1min":2.3959999999999999,"5min":2.3799999999999999,"15min":2.4990000000000001},"min":{"1min":0.56599999999999995,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":5.5789999999999997,"5min":6.2759999999999998,"15min":9.5790000000000006},"last":1.042}]}]},{"osd":1,"up_from":15,"seq":64424516312,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1708300,"kb_used_data":1028,"kb_used_omap":3411,"kb_used_meta":1703852,"kb_avail":92663540,"statfs":{"total":96636764160,"available":94887464960,"internally_reserved":0,"allocated":1052672,"data_stored":771947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3493385,"internal_metadata":1744744951},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":3.1720000000000002,"5min":2.5310000000000001,"15min":2.5489999999999999},"min":{"1min":0.52700000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":11.449,"5min":11.505000000000001,"15min":14.603999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":2.9489999999999998,"5min":2.5529999999999999,"15min":2.5739999999999998},"min":{"1min":0.66700000000000004,"5min":0.51900000000000002,"15min":0.41599999999999998},"max":{"1min":6.9420000000000002,"5min":11.196999999999999,"15min":12.343},"last":1.1319999999999999}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.9470000000000001,"5min":2.7759999999999998,"15min":2.6499999999999999},"min":{"1min":0.53800000000000003,"5min":0.498,"15min":0.498},"max":{"1min":25.795000000000002,"5min":25.795000000000002,"15min":25.795000000000002},"last":1.2609999999999999},{"interface":"front","average":{"1min":3.8460000000000001,"5min":2.944,"15min":2.774},"min":{"1min":0.629,"5min":0.56799999999999995,"15min":0.41499999999999998},"max":{"1min":14.885,"5min":14.885,"15min":14.885},"last":0.58999999999999997}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":4.2629999999999999,"5min":3.2330000000000001,"15min":3.024},"min":{"1min":0.91000000000000003,"5min":0.57899999999999996,"15min":0.42499999999999999},"max":{"1min":16.693999999999999,"5min":16.693999999999999,"15min":16.722999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":3.5489999999999999,"5min":3.1989999999999998,"15min":3.0270000000000001},"min":{"1min":0.98299999999999998,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":10.692,"5min":10.692,"15min":12.992000000000001},"last":1.54}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.6779999999999999,"5min":2.6139999999999999,"15min":2.3199999999999998},"min":{"1min":0.66100000000000003,"5min":0.58299999999999996,"15min":0.56799999999999995},"max":{"1min":27.562000000000001,"5min":27.562000000000001,"15min":27.562000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.5649999999999999,"5min":2.3900000000000001,"15min":2.327},"min":{"1min":0.67800000000000005,"5min":0.52000000000000002,"15min":0.505},"max":{"1min":9.8710000000000004,"5min":11.590999999999999,"15min":12.345000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.492,"5min":2.1720000000000002,"15min":2.3799999999999999},"min":{"1min":0.69699999999999995,"5min":0.56999999999999995,"15min":0.56599999999999995},"max":{"1min":6.758,"5min":6.8280000000000003,"15min":11.984},"last":0.97799999999999998},{"interface":"front","average":{"1min":2.7160000000000002,"5min":2.6059999999999999,"15min":2.46},"min":{"1min":0.61599999999999999,"5min":0.61499999999999999,"15min":0.58999999999999997},"max":{"1min":25.920999999999999,"5min":25.920999999999999,"15min":25.920999999999999},"last":1.0489999999999999}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.637,"5min":2.2599999999999998,"15min":2.5249999999999999},"min":{"1min":0.78500000000000003,"5min":0.65000000000000002,"15min":0.53400000000000003},"max":{"1min":7.1280000000000001,"5min":7.1280000000000001,"15min":12.113},"last":1.355},{"interface":"front","average":{"1min":2.8519999999999999,"5min":2.8620000000000001,"15min":2.6200000000000001},"min":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.55400000000000005},"max":{"1min":26.326000000000001,"5min":26.326000000000001,"15min":26.326000000000001},"last":1.419}]},{"osd":7,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.7709999999999999,"5min":2.4769999999999999,"15min":2.4940000000000002},"min":{"1min":0.72399999999999998,"5min":0.55700000000000005,"15min":0.49199999999999999},"max":{"1min":10.005000000000001,"5min":11.557,"15min":12.457000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":2.7309999999999999,"5min":2.4489999999999998,"15min":2.637},"min":{"1min":1.0189999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":7.2300000000000004,"5min":7.2300000000000004,"15min":12.210000000000001},"last":1.45}]}]},{"osd":0,"up_from":15,"seq":64424516305,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1656904,"kb_used_data":448,"kb_used_omap":5919,"kb_used_meta":1650528,"kb_avail":92714936,"statfs":{"total":96636764160,"available":94940094464,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6061868,"internal_metadata":1690140884},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.516,"5min":2.9329999999999998,"15min":2.4460000000000002},"min":{"1min":0.748,"5min":0.58099999999999996,"15min":0.437},"max":{"1min":9.7439999999999998,"5min":15.596,"15min":15.596},"last":0.54500000000000004},{"interface":"front","average":{"1min":2.6070000000000002,"5min":2.9740000000000002,"15min":2.7069999999999999},"min":{"1min":0.55200000000000005,"5min":0.495,"15min":0.36699999999999999},"max":{"1min":6.6710000000000003,"5min":12.222,"15min":12.621},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.137,"5min":2.9060000000000001,"15min":3.0459999999999998},"min":{"1min":0.60599999999999998,"5min":0.504,"15min":0.36699999999999999},"max":{"1min":5.085,"5min":12.913,"15min":61.551000000000002},"last":1.3180000000000001},{"interface":"front","average":{"1min":3.3260000000000001,"5min":3.2719999999999998,"15min":3.202},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.434},"max":{"1min":7.0350000000000001,"5min":12.842000000000001,"15min":61.359999999999999},"last":1.3640000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5939999999999999,"5min":2.6880000000000002,"15min":2.6280000000000001},"min":{"1min":0.74099999999999999,"5min":0.436,"15min":0.433},"max":{"1min":6.7919999999999998,"5min":12.379,"15min":12.379},"last":0.629},{"interface":"front","average":{"1min":2.653,"5min":3.3759999999999999,"15min":3.0510000000000002},"min":{"1min":0.85699999999999998,"5min":0.60899999999999999,"15min":0.54300000000000004},"max":{"1min":9.1210000000000004,"5min":16.524999999999999,"15min":16.524999999999999},"last":1.1439999999999999}]},{"osd":4,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.6869999999999998,"15min":2.3370000000000002},"min":{"1min":0.58099999999999996,"5min":0.53900000000000003,"15min":0.41199999999999998},"max":{"1min":6.3970000000000002,"5min":12.987,"15min":12.987},"last":1.4510000000000001},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.4870000000000001,"15min":2.359},"min":{"1min":0.64000000000000001,"5min":0.49299999999999999,"15min":0.38400000000000001},"max":{"1min":5.6100000000000003,"5min":13.177,"15min":13.177},"last":1.2649999999999999}]},{"osd":5,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":2.6179999999999999,"15min":2.4319999999999999},"min":{"1min":0.75800000000000001,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":5.3079999999999998,"5min":16.318000000000001,"15min":16.318000000000001},"last":1.681},{"interface":"front","average":{"1min":2.3900000000000001,"5min":2.8889999999999998,"15min":2.5249999999999999},"min":{"1min":0.65800000000000003,"5min":0.57999999999999996,"15min":0.44800000000000001},"max":{"1min":6.4870000000000001,"5min":15.59,"15min":15.59},"last":1.536}]},{"osd":6,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.3010000000000002,"5min":2.5739999999999998,"15min":2.8479999999999999},"min":{"1min":0.67800000000000005,"5min":0.53700000000000003,"15min":0.434},"max":{"1min":5.6559999999999997,"5min":13.308,"15min":99.003},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.9339999999999999,"5min":2.702,"15min":2.9020000000000001},"min":{"1min":0.80600000000000005,"5min":0.59899999999999998,"15min":0.55500000000000005},"max":{"1min":5.3949999999999996,"5min":16.431999999999999,"15min":97.721000000000004},"last":1.51}]},{"osd":7,"last update":"Wed Nov 29 03:14:50 2023","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.9489999999999998,"15min":2.681},"min":{"1min":0.621,"5min":0.621,"15min":0.56200000000000006},"max":{"1min":6.5739999999999998,"5min":13.103,"15min":13.103},"last":1.635},{"interface":"front","average":{"1min":2.3940000000000001,"5min":2.7349999999999999,"15min":2.6459999999999999},"min":{"1min":0.58999999999999997,"5min":0.57599999999999996,"15min":0.47699999999999998},"max":{"1min":5.7300000000000004,"5min":13.397,"15min":13.397},"last":1.5740000000000001}]}]},{"osd":7,"up_from":14,"seq":60129549055,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1742792,"kb_used_data":448,"kb_used_omap":2965,"kb_used_meta":1739370,"kb_avail":92629048,"statfs":{"total":96636764160,"available":94852145152,"internally_reserved":0,"allocated":458752,"data_stored":181579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3036782,"internal_metadata":1781115282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.456,"15min":1.361},"min":{"1min":0.438,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":5.4039999999999999,"5min":10.583,"15min":10.583},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.7629999999999999,"15min":1.5980000000000001},"min":{"1min":0.47499999999999998,"5min":0.41499999999999998,"15min":0.317},"max":{"1min":4.3150000000000004,"5min":8.3100000000000005,"15min":8.3100000000000005},"last":0.94299999999999995}]},{"osd":1,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.5,"15min":1.486},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.38100000000000001},"max":{"1min":4.3410000000000002,"5min":8.2929999999999993,"15min":8.2929999999999993},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.655,"5min":1.802,"15min":1.591},"min":{"1min":0.66600000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":5.4450000000000003,"5min":18.013000000000002,"15min":18.013000000000002},"last":1.2050000000000001}]},{"osd":2,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":2.1899999999999999,"5min":1.601,"15min":1.587},"min":{"1min":0.46999999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":6.835,"5min":9.2279999999999998,"15min":9.2279999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.355,"5min":1.6910000000000001,"15min":1.585},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.47899999999999998},"max":{"1min":4.6219999999999999,"5min":8.7949999999999999,"15min":8.7949999999999999},"last":1.2370000000000001}]},{"osd":3,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":1.655,"5min":1.532,"15min":1.651},"min":{"1min":0.40999999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":6.0979999999999999,"5min":6.0979999999999999,"15min":8.7189999999999994},"last":1.113},{"interface":"front","average":{"1min":1.647,"5min":1.903,"15min":1.7769999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.47399999999999998},"max":{"1min":4.5990000000000002,"5min":12.199,"15min":12.199},"last":0.91500000000000004}]},{"osd":4,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.747,"15min":0.747},"min":{"1min":0.34799999999999998,"5min":0.33500000000000002,"15min":0.29999999999999999},"max":{"1min":3.7890000000000001,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.84799999999999998,"15min":0.79400000000000004},"min":{"1min":0.40000000000000002,"5min":0.38,"15min":0.32200000000000001},"max":{"1min":3.1379999999999999,"5min":13.602,"15min":13.602},"last":0.71999999999999997}]},{"osd":5,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.98699999999999999,"15min":0.86499999999999999},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.32400000000000001},"max":{"1min":1.8779999999999999,"5min":13.058,"15min":13.058},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.83899999999999997,"15min":0.85599999999999998},"min":{"1min":0.39800000000000002,"5min":0.38300000000000001,"15min":0.38100000000000001},"max":{"1min":3.835,"5min":3.835,"15min":4.6399999999999997},"last":0.76000000000000001}]},{"osd":6,"last update":"Wed Nov 29 03:14:52 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.1399999999999999,"15min":0.96499999999999997},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.34599999999999997},"max":{"1min":5.3559999999999999,"5min":20.718,"15min":20.718},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.92400000000000004,"15min":0.872},"min":{"1min":0.47599999999999998,"5min":0.45400000000000001,"15min":0.39700000000000002},"max":{"1min":0.91300000000000003,"5min":13.648,"15min":13.648},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-29T03:15:47.969 DEBUG:teuthology.orchestra.run.smithi016:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-29T03:15:48.372 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.369+0000 7f235d8c9640 1 Processor -- start 2023-11-29T03:15:48.373 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.369+0000 7f235d8c9640 1 -- start start 2023-11-29T03:15:48.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f235d8c9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f235815d540 0x7f23580b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:48.376 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f235d8c9640 1 -- --> v1:172.21.15.16:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580b32c0 con 0x7f23580d3690 2023-11-29T03:15:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f235d8c9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23580b35a0 con 0x7f23580d1f50 2023-11-29T03:15:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f235d8c9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f235815d920 con 0x7f235815d540 2023-11-29T03:15:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f2356ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f235815d540 0x7f23580b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:48.377 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f23577fe640 1 --1- >> v1:172.21.15.16:6789/0 conn(0x7f23580d3690 0x7f23580cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.16:6789/0 says I am v1:172.21.15.16:33136/0 (socket says 172.21.15.16:33136) 2023-11-29T03:15:48.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f23577fe640 1 -- 172.21.15.16:0/2981546190 learned_addr learned my addr 172.21.15.16:0/2981546190 (peer_addr_for_me v1:172.21.15.16:0/0) 2023-11-29T03:15:48.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f2356ffd640 1 -- 172.21.15.16:0/2981546190 >> v1:172.21.15.64:6789/0 conn(0x7f23580d1f50 legacy=0x7f23580d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f2356ffd640 1 -- 172.21.15.16:0/2981546190 >> v1:172.21.15.16:6789/0 conn(0x7f23580d3690 legacy=0x7f23580cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.373+0000 7f2356ffd640 1 -- 172.21.15.16:0/2981546190 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23580b3880 con 0x7f235815d540 2023-11-29T03:15:48.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.377+0000 7f2356ffd640 1 --2- 172.21.15.16:0/2981546190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235815d540 0x7f23580b29c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23480097c0 tx=0x7f234801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe9f02507862e3b server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.377+0000 7f2355ffb640 1 -- 172.21.15.16:0/2981546190 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480ac620 con 0x7f235815d540 2023-11-29T03:15:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.377+0000 7f2355ffb640 1 -- 172.21.15.16:0/2981546190 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23480ac780 con 0x7f235815d540 2023-11-29T03:15:48.382 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.377+0000 7f2355ffb640 1 -- 172.21.15.16:0/2981546190 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480acb10 con 0x7f235815d540 2023-11-29T03:15:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 -- 172.21.15.16:0/2981546190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235815d540 msgr2=0x7f23580b29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 --2- 172.21.15.16:0/2981546190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235815d540 0x7f23580b29c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f23480097c0 tx=0x7f234801c3c0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 -- 172.21.15.16:0/2981546190 shutdown_connections 2023-11-29T03:15:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 --2- 172.21.15.16:0/2981546190 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f235815d540 0x7f23580b29c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 -- 172.21.15.16:0/2981546190 >> 172.21.15.16:0/2981546190 conn(0x7f235808ccf0 msgr2=0x7f235809c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:48.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 -- 172.21.15.16:0/2981546190 shutdown_connections 2023-11-29T03:15:48.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.381+0000 7f235d8c9640 1 -- 172.21.15.16:0/2981546190 wait complete. 2023-11-29T03:15:48.388 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.385+0000 7f235d8c9640 1 Processor -- start 2023-11-29T03:15:48.389 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.385+0000 7f235d8c9640 1 -- start start 2023-11-29T03:15:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f235d8c9640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 0x7f23580cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f235d8c9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23580d3690 0x7f2358150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f235d8c9640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f235815d540 0x7f2358156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f235d8c9640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2358150dc0 con 0x7f23580d1f50 2023-11-29T03:15:48.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f235d8c9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2358156ec0 con 0x7f23580d3690 2023-11-29T03:15:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f235d8c9640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23581571a0 con 0x7f235815d540 2023-11-29T03:15:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f2356ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 0x7f23580cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:48.393 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23577fe640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f235815d540 0x7f2358156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f2356ffd640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 0x7f23580cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50226/0 (socket says 172.21.15.16:50226) 2023-11-29T03:15:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f2356ffd640 1 -- 172.21.15.16:0/3198636474 learned_addr learned my addr 172.21.15.16:0/3198636474 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:48.394 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23567fc640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23580d3690 0x7f2358150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23577fe640 1 -- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23580d3690 msgr2=0x7f2358150880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23577fe640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23580d3690 0x7f2358150880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23577fe640 1 -- 172.21.15.16:0/3198636474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 msgr2=0x7f23580cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23577fe640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 0x7f23580cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f23577fe640 1 -- 172.21.15.16:0/3198636474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348009420 con 0x7f235815d540 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.389+0000 7f2356ffd640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 0x7f23580cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-29T03:15:48.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.393+0000 7f23577fe640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f235815d540 0x7f2358156670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f235000caa0 tx=0x7f235000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.393+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235000ab40 con 0x7f235815d540 2023-11-29T03:15:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.393+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235000aca0 con 0x7f235815d540 2023-11-29T03:15:48.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.393+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350012600 con 0x7f235815d540 2023-11-29T03:15:48.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.393+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2358157480 con 0x7f235815d540 2023-11-29T03:15:48.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.393+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2358157a40 con 0x7f235815d540 2023-11-29T03:15:48.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.397+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2358157c60 con 0x7f235815d540 2023-11-29T03:15:48.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.397+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f2350012760 con 0x7f235815d540 2023-11-29T03:15:48.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.401+0000 7f233ffff640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2344066920 0x7f2344068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:48.404 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.401+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2350083e60 con 0x7f235815d540 2023-11-29T03:15:48.405 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.401+0000 7f2356ffd640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2344066920 0x7f2344068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:48.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.401+0000 7f2356ffd640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2344066920 0x7f2344068de0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2348019ff0 tx=0x7f2348008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:48.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.405+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2350051430 con 0x7f235815d540 2023-11-29T03:15:48.885 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.881+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f2358068860 con 0x7f235815d540 2023-11-29T03:15:48.903 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.901+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2350051430 con 0x7f235815d540 2023-11-29T03:15:48.904 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.901+0000 7f233ffff640 1 -- 172.21.15.16:0/3198636474 <== mon.2 v2:172.21.15.64:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f2350054a50 con 0x7f235815d540 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2344066920 msgr2=0x7f2344068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2344066920 0x7f2344068de0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2348019ff0 tx=0x7f2348008040 comp rx=0 tx=0).stop 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f235815d540 msgr2=0x7f2358156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f235815d540 0x7f2358156670 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f235000caa0 tx=0x7f235000cf60 comp rx=0 tx=0).stop 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 shutdown_connections 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f235815d540 0x7f2358156670 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.909 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f2344066920 0x7f2344068de0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f23580d3690 0x7f2358150880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 --2- 172.21.15.16:0/3198636474 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f23580d1f50 0x7f23580cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 >> 172.21.15.16:0/3198636474 conn(0x7f235808ccf0 msgr2=0x7f23580aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 shutdown_connections 2023-11-29T03:15:48.910 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:48.905+0000 7f235d8c9640 1 -- 172.21.15.16:0/3198636474 wait complete. 2023-11-29T03:15:48.960 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-29T03:15:48.960 DEBUG:teuthology.orchestra.run.smithi016:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-29T03:15:49.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.369+0000 7f6cfb59e640 1 Processor -- start 2023-11-29T03:15:49.374 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.369+0000 7f6cfb59e640 1 -- start start 2023-11-29T03:15:49.378 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.373+0000 7f6cfb59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6cfc06acb0 0x7f6cfc071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:49.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.373+0000 7f6cfb59e640 1 --2- >> v2:172.21.15.16:3300/0 conn(0x7f6cfc0af440 0x7f6cfc071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:49.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cfb59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc15d770 con 0x7f6cfc15d390 2023-11-29T03:15:49.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cfb59e640 1 -- --> v2:172.21.15.16:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c6d60 con 0x7f6cfc0af440 2023-11-29T03:15:49.379 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cfb59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c6a80 con 0x7f6cfc06acb0 2023-11-29T03:15:49.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6cfc06acb0 0x7f6cfc071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:49.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6cfc06acb0 0x7f6cfc071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:57936/0 (socket says 172.21.15.16:57936) 2023-11-29T03:15:49.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/2687198443 learned_addr learned my addr 172.21.15.16:0/2687198443 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:49.380 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cfa59c640 1 --1- 172.21.15.16:0/2687198443 >> v1:172.21.15.64:6789/0 conn(0x7f6cfc15d390 0x7f6cfc06a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.16:33192/0 (socket says 172.21.15.16:33192) 2023-11-29T03:15:49.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cfad9d640 1 --2- 172.21.15.16:0/2687198443 >> v2:172.21.15.16:3300/0 conn(0x7f6cfc0af440 0x7f6cfc071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:49.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/2687198443 >> v2:172.21.15.16:3300/0 conn(0x7f6cfc0af440 msgr2=0x7f6cfc071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-29T03:15:49.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 --2- 172.21.15.16:0/2687198443 >> v2:172.21.15.16:3300/0 conn(0x7f6cfc0af440 0x7f6cfc071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/2687198443 >> v1:172.21.15.64:6789/0 conn(0x7f6cfc15d390 legacy=0x7f6cfc06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:49.381 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.377+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/2687198443 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc160fb0 con 0x7f6cfc06acb0 2023-11-29T03:15:49.383 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cf9d9b640 1 --2- 172.21.15.16:0/2687198443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc071450 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0cfcf0 tx=0x7f6cf001c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b1dfdc7ef93741 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:49.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cf959a640 1 -- 172.21.15.16:0/2687198443 <== mon.1 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00ac410 con 0x7f6cfc06acb0 2023-11-29T03:15:49.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cf959a640 1 -- 172.21.15.16:0/2687198443 <== mon.1 v2:172.21.15.64:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6cf00ac570 con 0x7f6cfc06acb0 2023-11-29T03:15:49.384 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cf959a640 1 -- 172.21.15.16:0/2687198443 <== mon.1 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00ac920 con 0x7f6cfc06acb0 2023-11-29T03:15:49.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 -- 172.21.15.16:0/2687198443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 msgr2=0x7f6cfc071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:49.385 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/2687198443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc071450 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0cfcf0 tx=0x7f6cf001c3b0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 -- 172.21.15.16:0/2687198443 shutdown_connections 2023-11-29T03:15:49.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/2687198443 >> v2:172.21.15.16:3300/0 conn(0x7f6cfc0af440 0x7f6cfc071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.386 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/2687198443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc071450 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 -- 172.21.15.16:0/2687198443 >> 172.21.15.16:0/2687198443 conn(0x7f6cfc0cc960 msgr2=0x7f6cfc0ccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:49.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 -- 172.21.15.16:0/2687198443 shutdown_connections 2023-11-29T03:15:49.387 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.381+0000 7f6cfb59e640 1 -- 172.21.15.16:0/2687198443 wait complete. 2023-11-29T03:15:49.391 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.389+0000 7f6cfb59e640 1 Processor -- start 2023-11-29T03:15:49.392 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.389+0000 7f6cfb59e640 1 -- start start 2023-11-29T03:15:49.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc14f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:49.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 0x7f6cfc15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:49.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6cfc15d390 0x7f6cfc15bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:49.395 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 -- --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc159180 con 0x7f6cfc0af440 2023-11-29T03:15:49.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc158600 con 0x7f6cfc06acb0 2023-11-29T03:15:49.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 -- --> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc1588e0 con 0x7f6cfc15d390 2023-11-29T03:15:49.396 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc14f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 0x7f6cfc15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfad9d640 1 --2- >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6cfc15d390 0x7f6cfc15bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 --2- >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 0x7f6cfc15b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.16:3300/0 says I am v2:172.21.15.16:50242/0 (socket says 172.21.15.16:50242) 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/4275482752 learned_addr learned my addr 172.21.15.16:0/4275482752 (peer_addr_for_me v2:172.21.15.16:0/0) 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfa59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc14f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.16:57946/0 (socket says 172.21.15.16:57946) 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6cfc15d390 msgr2=0x7f6cfc15bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:49.397 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6cfc15d390 0x7f6cfc15bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 msgr2=0x7f6cfc14f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:49.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc14f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.398 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 -- 172.21.15.16:0/4275482752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf00094d0 con 0x7f6cfc0af440 2023-11-29T03:15:49.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cf9d9b640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 0x7f6cfc15b570 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0018fc0 tx=0x7f6cf0019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:49.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00b65f0 con 0x7f6cfc0af440 2023-11-29T03:15:49.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6cf00b6750 con 0x7f6cfc0af440 2023-11-29T03:15:49.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf00b6b20 con 0x7f6cfc0af440 2023-11-29T03:15:49.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.393+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc158bc0 con 0x7f6cfc0af440 2023-11-29T03:15:49.399 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.397+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc15c580 con 0x7f6cfc0af440 2023-11-29T03:15:49.401 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.397+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc04e890 con 0x7f6cfc0af440 2023-11-29T03:15:49.403 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.401+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 4 ==== mgrmap(e 5) v1 ==== 86170+0+0 (secure 0 0 0) 0x7f6cf00b6c80 con 0x7f6cfc0af440 2023-11-29T03:15:49.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.401+0000 7f6ceaffd640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6cdc0668d0 0x7f6cdc068d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-29T03:15:49.406 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.401+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6cf011ed20 con 0x7f6cfc0af440 2023-11-29T03:15:49.407 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.405+0000 7f6cfa59c640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6cdc0668d0 0x7f6cdc068d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-29T03:15:49.408 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.405+0000 7f6cfa59c640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6cdc0668d0 0x7f6cdc068d90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6cec000f70 tx=0x7f6cec007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-29T03:15:49.410 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.405+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6cf00ec270 con 0x7f6cfc0af440 2023-11-29T03:15:49.984 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.980+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 --> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cfc0726a0 con 0x7f6cfc0af440 2023-11-29T03:15:49.985 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.980+0000 7f6ceaffd640 1 -- 172.21.15.16:0/4275482752 <== mon.0 v2:172.21.15.16:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3699 (secure 0 0 0) 0x7f6cf00ee1a0 con 0x7f6cfc0af440 2023-11-29T03:15:49.985 INFO:teuthology.orchestra.run.smithi016.stdout: 2023-11-29T03:15:49.986 INFO:teuthology.orchestra.run.smithi016.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4772,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6837/3052024118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6835","nonce":3052024118},{"type":"v1","addr":"172.21.15.64:6837","nonce":3052024118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4775,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6834/2150257023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6832","nonce":2150257023},{"type":"v1","addr":"172.21.15.16:6834","nonce":2150257023}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4778,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.16:6835/1163947768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.16:6833","nonce":1163947768},{"type":"v1","addr":"172.21.15.16:6835","nonce":1163947768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5335,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6836/3526447842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3526447842},{"type":"v1","addr":"172.21.15.64:6836","nonce":3526447842}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-11-29T03:15:49.986 INFO:teuthology.orchestra.run.smithi016.stderr:dumped fsmap epoch 19 2023-11-29T03:15:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6cdc0668d0 msgr2=0x7f6cdc068d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6cdc0668d0 0x7f6cdc068d90 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f6cec000f70 tx=0x7f6cec007e50 comp rx=0 tx=0).stop 2023-11-29T03:15:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 msgr2=0x7f6cfc15b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-29T03:15:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 0x7f6cfc15b570 secure :-1 s=READY pgs=3324 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0018fc0 tx=0x7f6cf0019150 comp rx=0 tx=0).stop 2023-11-29T03:15:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 shutdown_connections 2023-11-29T03:15:49.989 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:3301/0,v1:172.21.15.64:6790/0] conn(0x7f6cfc15d390 0x7f6cfc15bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.16:3300/0,v1:172.21.15.16:6789/0] conn(0x7f6cfc0af440 0x7f6cfc15b570 unknown :-1 s=CLOSED pgs=3324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:6832/2559396587,v1:172.21.15.64:6833/2559396587] conn(0x7f6cdc0668d0 0x7f6cdc068d90 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 --2- 172.21.15.16:0/4275482752 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6cfc06acb0 0x7f6cfc14f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-29T03:15:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 >> 172.21.15.16:0/4275482752 conn(0x7f6cfc0cc960 msgr2=0x7f6cfc0b1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-29T03:15:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 shutdown_connections 2023-11-29T03:15:49.990 INFO:teuthology.orchestra.run.smithi016.stderr:2023-11-29T03:15:49.984+0000 7f6cfb59e640 1 -- 172.21.15.16:0/4275482752 wait complete. 2023-11-29T03:15:50.039 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-29T03:15:50.039 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-29T03:15:50.040 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-29T03:15:50.040 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:15:55.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-11-29T03:15:56.142 INFO:tasks.ceph.mds.a:Stopped 2023-11-29T03:15:56.142 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-29T03:15:56.142 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:02.245 INFO:tasks.ceph.mds.c:Stopped 2023-11-29T03:16:02.246 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-29T03:16:02.246 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:02.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-11-29T03:16:02.292 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-11-29T03:16:08.348 INFO:tasks.ceph.mds.b:Stopped 2023-11-29T03:16:08.349 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-29T03:16:08.349 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:08.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-11-29T03:16:14.451 INFO:tasks.ceph.mds.d:Stopped 2023-11-29T03:16:14.451 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-29T03:16:14.452 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-29T03:16:14.452 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:20.554 INFO:tasks.ceph.osd.0:Stopped 2023-11-29T03:16:20.555 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-29T03:16:20.555 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:21.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-11-29T03:16:26.657 INFO:tasks.ceph.osd.1:Stopped 2023-11-29T03:16:26.657 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-29T03:16:26.658 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:27.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-11-29T03:16:27.337 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-11-29T03:16:32.760 INFO:tasks.ceph.osd.2:Stopped 2023-11-29T03:16:32.760 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-29T03:16:32.761 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:33.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-11-29T03:16:33.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-11-29T03:16:38.862 INFO:tasks.ceph.osd.3:Stopped 2023-11-29T03:16:38.863 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-29T03:16:38.863 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:39.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-11-29T03:16:39.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-11-29T03:16:44.969 INFO:tasks.ceph.osd.4:Stopped 2023-11-29T03:16:44.971 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-29T03:16:44.971 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:45.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-11-29T03:16:45.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-11-29T03:16:50.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-11-29T03:16:50.770 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-11-29T03:16:51.073 INFO:tasks.ceph.osd.5:Stopped 2023-11-29T03:16:51.074 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-29T03:16:51.074 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:16:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-11-29T03:16:56.377 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-11-29T03:16:57.176 INFO:tasks.ceph.osd.6:Stopped 2023-11-29T03:16:57.177 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-29T03:16:57.177 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:17:01.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-11-29T03:17:01.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-11-29T03:17:03.280 INFO:tasks.ceph.osd.7:Stopped 2023-11-29T03:17:03.281 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-29T03:17:03.282 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-29T03:17:03.282 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:17:07.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-11-29T03:17:07.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-11-29T03:17:09.384 INFO:tasks.ceph.mgr.y:Stopped 2023-11-29T03:17:09.386 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-29T03:17:09.386 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:17:12.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-11-29T03:17:12.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-11-29T03:17:15.488 INFO:tasks.ceph.mgr.x:Stopped 2023-11-29T03:17:15.489 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-29T03:17:15.489 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-29T03:17:15.490 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:17:17.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-11-29T03:17:17.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-11-29T03:17:21.592 INFO:tasks.ceph.mon.a:Stopped 2023-11-29T03:17:21.593 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-29T03:17:21.593 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:17:22.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-11-29T03:17:22.897 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-11-29T03:17:27.695 INFO:tasks.ceph.mon.b:Stopped 2023-11-29T03:17:27.696 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-29T03:17:27.696 INFO:teuthology.orchestra.run:waiting for 300 2023-11-29T03:17:27.997 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-11-29T03:17:32.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-11-29T03:17:33.798 INFO:tasks.ceph.mon.c:Stopped 2023-11-29T03:17:33.800 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-29T03:17:33.801 DEBUG:teuthology.orchestra.run.smithi016:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-11-29T03:17:33.955 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-29T03:17:33.956 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-29T03:17:34.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-29T03:17:34.373 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-29T03:17:34.988 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-29T03:17:34.989 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-29T03:17:35.645 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi016.front.sepia.ceph.com 2023-11-29T03:17:35.646 DEBUG:teuthology.orchestra.run.smithi016:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-29T03:17:36.350 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-29T03:17:36.350 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-29T03:17:36.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-29T03:17:36.679 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-29T03:17:36.978 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-29T03:17:36.979 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-29T03:17:37.436 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi064.front.sepia.ceph.com 2023-11-29T03:17:37.436 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-29T03:17:37.736 INFO:tasks.ceph:Archiving mon data... 2023-11-29T03:17:37.738 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/data/mon.a.tgz 2023-11-29T03:17:37.738 DEBUG:teuthology.orchestra.run.smithi016:> mktemp 2023-11-29T03:17:37.760 INFO:teuthology.orchestra.run.smithi016.stdout:/tmp/tmp.nTt6jBQRYY 2023-11-29T03:17:37.763 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nTt6jBQRYY 2023-11-29T03:17:37.999 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-11-29T03:17:38.126 DEBUG:teuthology.orchestra.run.smithi016:> sudo chmod 0666 /tmp/tmp.nTt6jBQRYY 2023-11-29T03:17:38.232 DEBUG:teuthology.orchestra.remote:smithi016:/tmp/tmp.nTt6jBQRYY is 581KB 2023-11-29T03:17:38.322 DEBUG:teuthology.orchestra.run.smithi016:> rm -fr /tmp/tmp.nTt6jBQRYY 2023-11-29T03:17:38.345 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/data/mon.b.tgz 2023-11-29T03:17:38.346 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2023-11-29T03:17:38.356 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.Uv4aqmw2Xc 2023-11-29T03:17:38.356 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Uv4aqmw2Xc 2023-11-29T03:17:38.564 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.Uv4aqmw2Xc 2023-11-29T03:17:38.669 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.Uv4aqmw2Xc is 585KB 2023-11-29T03:17:38.777 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.Uv4aqmw2Xc 2023-11-29T03:17:38.787 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/data/mon.c.tgz 2023-11-29T03:17:38.787 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2023-11-29T03:17:38.843 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.77lhPkEXOo 2023-11-29T03:17:38.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.77lhPkEXOo 2023-11-29T03:17:39.000 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.77lhPkEXOo 2023-11-29T03:17:39.080 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.77lhPkEXOo is 585KB 2023-11-29T03:17:39.152 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.77lhPkEXOo 2023-11-29T03:17:39.163 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-29T03:17:39.164 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T03:17:39.171 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-29T03:17:39.280 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-29T03:17:39.281 DEBUG:teuthology.orchestra.run.smithi016:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-29T03:17:39.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-29T03:17:39.337 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-29T03:17:39.339 INFO:teuthology.orchestra.run.smithi016.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-29T03:17:39.359 INFO:tasks.ceph:Archiving crash dumps... 2023-11-29T03:17:39.363 DEBUG:teuthology.misc:Transferring archived files from smithi016:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/remote/smithi016/crash 2023-11-29T03:17:39.364 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T03:17:39.423 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/remote/smithi064/crash 2023-11-29T03:17:39.424 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-29T03:17:39.447 INFO:tasks.ceph:Shutting down logrotate 2023-11-29T03:17:39.454 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T03:17:39.478 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-29T03:17:39.490 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 1957, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 256, in ceph_log logrotater.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 221, in end self.thread.get() File "src/gevent/greenlet.py", line 803, in gevent._gevent_cgreenlet.Greenlet.get File "src/gevent/greenlet.py", line 371, in gevent._gevent_cgreenlet.Greenlet._raise_exception File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/gevent/_compat.py", line 65, in reraise raise value.with_traceback(tb) File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_47c1c547372ed5bff7984647dc200bac0e019caf/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi016 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T03:17:39.493 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-29T03:17:39.494 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T03:17:39.516 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-29T03:17:39.607 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-29T03:17:39.617 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-29T03:17:39.617 DEBUG:teuthology.orchestra.run.smithi016:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T03:17:39.625 DEBUG:teuthology.orchestra.run.smithi064:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-29T03:17:39.687 INFO:teuthology.orchestra.run.smithi064.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T03:17:39.688 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================== 2023-11-29T03:17:39.688 INFO:teuthology.orchestra.run.smithi064.stdout:*hv01.front.sepi 44.4.53.2 2 u 606 1024 377 0.182 +0.723 0.384 2023-11-29T03:17:39.689 INFO:teuthology.orchestra.run.smithi064.stdout:+hv02.front.sepi 63.231.80.2 3 u 615 1024 377 0.175 +1.647 0.221 2023-11-29T03:17:39.689 INFO:teuthology.orchestra.run.smithi064.stdout:+hv03.front.sepi 74.6.168.72 3 u 672 1024 377 0.216 -1.461 2.409 2023-11-29T03:17:39.689 INFO:teuthology.orchestra.run.smithi064.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-29T03:17:39.704 INFO:teuthology.orchestra.run.smithi016.stdout: remote refid st t when poll reach delay offset jitter 2023-11-29T03:17:39.704 INFO:teuthology.orchestra.run.smithi016.stdout:============================================================================== 2023-11-29T03:17:39.704 INFO:teuthology.orchestra.run.smithi016.stdout:*hv01.front.sepi 44.4.53.2 2 u 46 1024 377 0.276 +0.313 0.503 2023-11-29T03:17:39.704 INFO:teuthology.orchestra.run.smithi016.stdout:+hv02.front.sepi 63.231.80.2 3 u 349 1024 377 0.221 +1.435 0.138 2023-11-29T03:17:39.704 INFO:teuthology.orchestra.run.smithi016.stdout:+hv03.front.sepi 74.6.168.72 3 u 179 1024 377 0.277 -0.739 2.852 2023-11-29T03:17:39.705 INFO:teuthology.orchestra.run.smithi016.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-11-29T03:17:39.706 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-29T03:17:39.716 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-29T03:17:39.717 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-29T03:17:39.725 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-29T03:17:39.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-29T03:17:39.742 INFO:teuthology.task.internal:Duration was 35440.990066 seconds 2023-11-29T03:17:39.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-29T03:17:39.751 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-29T03:17:39.751 DEBUG:teuthology.orchestra.run.smithi016:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T03:17:39.758 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-29T03:17:40.035 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-29T03:17:40.036 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi016.front.sepia.ceph.com 2023-11-29T03:17:40.036 DEBUG:teuthology.orchestra.run.smithi016:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T03:17:40.120 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi064.front.sepia.ceph.com 2023-11-29T03:17:40.121 DEBUG:teuthology.orchestra.run.smithi064:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-29T03:17:40.145 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-29T03:17:40.146 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T03:17:40.155 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-29T03:17:40.393 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-29T03:17:40.393 DEBUG:teuthology.orchestra.run.smithi016:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T03:17:40.401 DEBUG:teuthology.orchestra.run.smithi064:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-29T03:17:41.407 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-29T03:17:41.418 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-29T03:17:41.419 DEBUG:teuthology.orchestra.run.smithi016:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T03:17:41.487 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-29T03:17:41.538 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-29T03:17:41.548 DEBUG:teuthology.orchestra.run.smithi016:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T03:17:41.555 DEBUG:teuthology.orchestra.run.smithi064:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-29T03:17:41.594 INFO:teuthology.orchestra.run.smithi016.stdout:kernel.core_pattern = core 2023-11-29T03:17:41.609 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = core 2023-11-29T03:17:41.650 DEBUG:teuthology.orchestra.run.smithi016:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T03:17:41.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T03:17:41.714 DEBUG:teuthology.orchestra.run.smithi064:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-29T03:17:41.722 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-29T03:17:41.722 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-29T03:17:41.732 INFO:teuthology.task.internal:Transferring archived files... 2023-11-29T03:17:41.734 DEBUG:teuthology.misc:Transferring archived files from smithi016:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/remote/smithi016 2023-11-29T03:17:41.734 DEBUG:teuthology.orchestra.run.smithi016:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T03:17:41.819 DEBUG:teuthology.misc:Transferring archived files from smithi064:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397/remote/smithi064 2023-11-29T03:17:41.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-29T03:17:41.849 INFO:teuthology.task.internal:Removing archive directory... 2023-11-29T03:17:41.850 DEBUG:teuthology.orchestra.run.smithi016:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-29T03:17:41.857 DEBUG:teuthology.orchestra.run.smithi064:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-29T03:17:41.903 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-29T03:17:41.915 INFO:teuthology.task.internal:Not uploading archives. 2023-11-29T03:17:41.915 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-29T03:17:41.925 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-29T03:17:41.925 DEBUG:teuthology.orchestra.run.smithi016:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T03:17:41.932 DEBUG:teuthology.orchestra.run.smithi064:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-29T03:17:41.946 INFO:teuthology.orchestra.run.smithi016.stdout: 658043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 03:17 /home/ubuntu/cephtest 2023-11-29T03:17:41.959 INFO:teuthology.orchestra.run.smithi064.stdout: 658042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 29 03:17 /home/ubuntu/cephtest 2023-11-29T03:17:41.961 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-29T03:17:41.973 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-29T03:17:41.985 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi016 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T03:17:41.985 INFO:teuthology.nuke:Checking targets against current locks 2023-11-29T03:17:42.015 DEBUG:teuthology.nuke:shortname: smithi016 2023-11-29T03:17:42.016 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T03:17:42.037 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi016.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 17:17:45.391072', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMEONz5/0REs4kaPFzuqc3CUzT2Iui4Fc5bEN24go+O6oR4tcmVqOOp6Ezg1reI0HtVSWrgDd9K4GuUbgNapwaI='} 2023-11-29T03:17:42.055 DEBUG:teuthology.nuke:shortname: smithi064 2023-11-29T03:17:42.055 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-29T03:17:42.079 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:23:42-fs-wip-vshankar-testing-20231127.102654-testing-default-smithi/7469397', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 17:17:45.389613', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHlPwKfI8SIgiQx/P75SqVsuwDtjp9touOtALSJxcXOwZ/cTe0oNGrXEX6TjeM9LEvSwmX9eGi0fJbwXaDoB48c='} 2023-11-29T03:17:42.087 INFO:teuthology.orchestra.console.smithi016:Power off 2023-11-29T03:17:42.087 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T03:17:42.111 DEBUG:teuthology.orchestra.console.smithi016:power off output: Chassis Power Control: Down/Off 2023-11-29T03:17:42.111 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:42.132 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-11-29T03:17:42.148 INFO:teuthology.orchestra.console.smithi064:Power off 2023-11-29T03:17:42.148 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-29T03:17:42.171 DEBUG:teuthology.orchestra.console.smithi064:power off output: Chassis Power Control: Down/Off 2023-11-29T03:17:42.171 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:42.198 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-29T03:17:46.133 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:46.199 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:46.244 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is on 2023-11-29T03:17:46.309 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-29T03:17:50.248 DEBUG:teuthology.orchestra.console.smithi016:pexpect command: ipmitool -H smithi016.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:50.310 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:50.361 DEBUG:teuthology.orchestra.console.smithi016:check power output: Chassis Power is off 2023-11-29T03:17:50.422 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is on 2023-11-29T03:17:50.462 INFO:teuthology.orchestra.console.smithi016:Power off completed 2023-11-29T03:17:54.425 DEBUG:teuthology.orchestra.console.smithi064:pexpect command: ipmitool -H smithi064.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-29T03:17:54.538 DEBUG:teuthology.orchestra.console.smithi064:check power output: Chassis Power is off 2023-11-29T03:17:54.639 INFO:teuthology.orchestra.console.smithi064:Power off completed 2023-11-29T03:17:54.744 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 client.1-kernel-sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 35440.990065574646 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=1e505c41250949faa9497e2a782da9bd status: fail success: false 2023-11-29T03:17:54.745 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-29T03:17:54.827 INFO:teuthology.run:FAIL